New weight learning strategy for fully connected feedforward neural networks

Appropriate weight initialization settings, along with the ReLU activation function, have become cornerstones of modern deep learning, enabling the training and deployment of highly effective and efficient neural network models across diverse ...

When a sigmoidal feedforward neural network (SFNN) is trained by the gradient-based algorithms, the quality of the overall learning process strongly depends on the initial weights. To improve the algorithm stability and avoid local minima, a Mutual ...

Artificial neural network is an important force to promote the development of artificial intelligence, but it usually needs to be trained before use. The initial weight given randomly is the most widely used method when training neural networks. However,...