Neural network and method of neural network training

A neural network includes inputs for receiving input signals, synapses connected to the inputs and having corrective weights, and neurons having outputs connected with the inputs via the synapses. Each neuron generates a neuron sum by summing corrective weights selected from the respective synapse. A controller receives a desired output signal, determines a deviation of the neuron sum from the desired output signal value, and modifies respective corrective weights using the determined deviation. Adding up the modified corrective weights to determine the neuron sum minimizes the deviation and trains the network. A structure-forming module rearranges connections between network elements during the training and a signal allocation module distributes the input signals among the network elements during the training. A training module commands and coordinates operation of the structure-forming and the signal allocation modules and the controller to reorganize the network structure during the training to control the training in real time in real-time.