function of activation
linear neural network
E.A. Samoilin, V.M. Chelakhov
The task of definition of parameters of discrete dependence of supervision containing as normal (Gaussian), and non-stationary (abnormal) components is considered. The analysis of applicability of a classical method of the least squares (MLS), method of global numerical optimization and device linear neural networks (NN) to the decision of the given task is carried out (spent). The analysis of these methods has allowed to make important remove (conclusion) consisting that for decrease (reduction) of absolute mistakes estimations of required parameters, the training adaptive linear neuron should begin with abnormal measurements and to come to an end on normal. In a case, when the abnormal measurements take place in index points of time of supervision, the training neuron begins with this anomaly; therefore use of a cortege-method is not required. If Anomaly are in final points of a time interval of supervision, or in regular intervals are distributed (allocated) on this interval, to lower absolute mistakes estimation of parameters probably on the basis of formation of the certain sequence of training pairs (input (entrance) – output (exit)), such, at which abnormal measurements (at first follow by way of decrease (reduction) «Anomaly»), and then – normal. Thus the sequence of the training pairs generated by the mentioned above rule, is named cortege of training set.
As a cortege-method of training set (i.e. the formations of trains of training pairs) in conditions of the task, formulated in clause, are considered algorithms of construction of variation numbers (lines) deviation of supervision and numbers (lines) of analogues first derivative – local final differences.
Thus, use of a cortege-method defines (determines) a sequence of training adaptive linear neuron, which begins with training pairs having greatest deviation (or the final difference) (i.e. anomaly) and comes to an end on pairs with least deviation (or final difference).
The results of numerical researches submitted in clause, testify about higher accuracy the characteristics linear NN, using an offered method, in comparison with a traditional network, and also classical MLS.