D. A. Aminev¹, V. A. Danilevich², A. A. Demin³, A. Samman4 

1  V.A. Trapeznikov Institute of Control Sciences of RAS (Moscow, Russia)

2–4  Department IU4 of Designing and Technology of Electronic Equipment, Bauman Moscow State Technical University (Moscow, Russia)

Nowadays, touch displays are becoming more common. This design combines an input device and an output device, and also allows you to create the most convenient interfaces for interacting with the user. Input recognition significantly expands the functionality of touch input, providing the ability to apply recognition of entered characters to launch a variety of functions and applications. Such systems existing today are not flexible enough in configuration and use.

This paper presents the process of developing an infrared touch panel input data analysis system. A neural network is configured and trained to solve the problem of recognizing handwritten characters. The functional purpose of the program units has been briefly presented: graphical interface, COM-port reader, neural network. A graphical interface has been developed that visualizes the used touch matrix and displays function buttons, input and output fields. The interface consists of a main work window, a macro view and setup window, and an auto-identification timer setup window. A program block has been developed that allows you to create a neural network according to given settings, make a request to it and train it. Additional program functionality has been developed that allows you to run external files using the entered symbol, partially automating the program, helping the user. All developed modules have been functionally tested individually and the entire program together. Principles of neural networks training have been analyzed. Experiments have been carried out in which training of a neural network with different settings and training parameters is implemented. Among these parameters are: the number of epochs of learning, the speed of learning, the number of neurons of the hidden layer. As a result of the experiments performed, factors affecting the quality of neural network training have been identified. As a result of the training, a set of coefficients has been obtained that ensures stable operation of the neural network. The accuracy of the neural network is 96%, and the recognition speed is less than a second.

Aminev D.A., Danilevich V.A., Demin A.A., Samman A. Recognition of handwritten characters on the sensor matrix using a neural network. Neurocomputers. 2021. Vol. 23. No. 1. P. 32–42. DOI: 10.18127/j19998554-202101-04. (in Russian)

1. Tarik R. Sozdaem nejronnuyu set': Per. s angl. SPb.: OOO «Al'fa-kniga». 2017. (in Russian)
2. Vlasov A.I., Papulin S.Yu. Analiz dannykh s ispol'zovaniem gistogrammnoj modeli kombinatsii priznakov. Nejrokomp'yutery: razrabotka, primenenie. 2019. T. 21. № 5. S. 18–27. (in Russian)
3. Dzhoshi P. Iskusstvennyj intellekt s primerami na Python: Per. s angl. SPb.: OOO «Dialektika». 2019. (in Russian)
4. Vlasov A.I., Krivoshein A.I., Terent'ev D.S., Shakhnov V.A. Issledovanie kondensatornoj reshetki kompozitnoj emkostnoj sensornoj paneli. Rossijskaya mikroelektronika. 2018. T. 47. № 5. S. 299–306. (in Russian)
5. Demin A.A., Terent'ev D.S., Shakhnov V.A. Al'ternativnaya tekhnologiya izgotovleniya sensornogo emkostnogo ekrana. Datchiki i sistemy. 2013. № 9 (172). S. 56–64. (in Russian)
6. Terent'ev D.S., Vlasov A.I., Tokarev S.V. Proektsionno-emkostnoj sensornyj ekran dlya vstraivaemykh mobil'nykh system. Prikaspijskij zhurnal: upravlenie i vysokie tekhnologii. 2013. № 1 (21). S. 16–26. (in Russian)
7. Vlasov A.I., Terent'ev D.S., Shakhnov V.A. Grafenovyj gibkij sensornyj ekran so vstroennym analogo-tsifrovym preobrazovatelem. Rossijskaya mikroelektronika. 2017. T. 46. № 3. S. 192–199. (in Russian)
8. Terent'ev D.S., Vlasov A.I. Bortovye sensornye paneli s daktiloskopicheskimi datchikami na transporte. Datchiki i sistemy. 2014. № 4 (179). S. 45–55. (in Russian)
9. Demin A.A. Metody avtomatizirovannoj otsenki kalligrafii. Programmnye produkty i sistemy. 2011. № 1. S. 20–23. (in Russian)
10. Demin A.A., Vlasov A.I., Shakhnov V.A. Metody i sredstva vizual'nykh uprazhnenij dlya adaptivnoj korrektsii tonkoj motoriki kistej ruk v usloviyakh nevesomosti. Vestnik Moskovskogo gosudarstvennogo tekhnicheskogo universiteta im. N.E. Baumana. Ser. Priborostroenie. 2015. № 3 (102). S. 23–38. (in Russian)
11. Balukhto A.N., Bulaev V.I., Buryj E.V. i dr. Nejrokomp'yutery v sistemakh obrabotki izobrazhenij. Ser. Biblioteka zhurnala «Nejrokomp'yutery: razrabotka, primenenie». T. 7. M.: Radiotekhnika. 2003. (in Russian)
12. Shakhnov V.A., Vlasov A.I., Polyakov Yu.A., Kuznetsov A.S. Nejrokomp'yutery: arkhitektura i skhemotekhnika. Ser. Prilozhenie k zhurnalu «Informatsionnye tekhnologii». № 9. M.: Mashinostroenie. 2000. (in Russian)
13. Vlasov A.I. Apparatnaya realizatsiya nejrovychislitel'nykh upravlyayushchikh system. Pribory i sistemy. Upravlenie, kontrol', diagnostika. 1999. № 2. S. 61–65. (in Russian)