A.Yu. Loskutov, O.V. Melnik, E.R. Muratov, M.B. Nikiforov

Ryazan State Radio Engineering University n. a. akad. V.F. Utkin (Ryazan, Russia)

Heart rate is one of the main physiological indicators of the body, and the parameters of heart rate variability reflect various aspects of the functional and psychoemotional status. Automatic determination of a person's condition based on video sequence analysis is an important problem in various areas related to ensuring the safety of production, air and transport communications, prevention of crimes and terrorist threats, etc. Therefore, an important task is to develop methods and algorithms for analyzing video images that allow remote monitoring of heart rate parameters.

Purpose – development and software implementation of a method for non-contact assessment of heart rate based on spectral analysis of a video image of a person's face recorded using a traditional video camera.

A method for non-contact measurement of heart rate has been developed, including the stages of data collection and preprocessing, spectral analysis of video images and analysis of the information obtained to calculate the results. The difference between the values of the average heart rate recorded using contact sensors and using the developed software does not exceed 3-4 beats per minute. The proposed approach can be implemented as part of various information systems where it is required to control the functional and psycho-emotional status of a person, for example, systems for operator’s status monitoring.

Loskutov A.Yu., Melnik O.V., Muratov E.R., Nikiforov M.B. Non-contact heart rate assessment based on spectral analysis of video images. Biomedicine Radioengineering. 2021. V. 24. № 4. P. 33–39. DOI: 10.18127/j15604136-202104-05 (in Russian)

1. Muratov Y.R., Nikiforov M.B., Tarasov A.S., Skachkov A.M. Video-Computer Technology of Real Time Vehicle Driver Fatigue Monitoring. Advances in Neural Computation, Machine Learning, and Cognitive Research III XXI International. Springer Nature Switzerland AG 2020. P. 106–115. 
2. Mihajlov V.M. Variabel'nost' ritma serdca. Opyt prakticheskogo primeneniya. Ivanovo: 2010. 183 s. (in Russian).
3. Sudakov K.V. Individual'naya ustojchivost' k emocional'nomu stressu. M.: NII normal'noj fiziologii im. P.K. Anohina RAMN. 1998. C. 82– 100 (in Russian).
4. Kubryak O.V. Vospriyatie serdcebienij i kognitivnye aspekty kardioritma. M.: URSS: Librokom 2010. 112 s. (in Russian).
5. Kalakutskij L.I., Manelis E.S. Apparatura i metody klinicheskogo monitoringa. M.: Vysshaya shkola. 2004. 156 s. (in Russian).
6. Prahl S. Optical absorption of hemoglobin. Oregon Medical Laser Center. (1999). [Elektronnyj resurs] http://omlc.ogi.edu/spectra/ hemoglobin/
7. He Liu, Yadong Wang, Lei Wang. A review of non-contact, low-cost physiological information measurement based on photoplethysmographic imaging. Conference proceedings: Annual International Conference of the IEEE Engineering in Medicineand Biology Society. IEEE Engineeringin Medicine and Biology Society. Annual Conference, 2012. 2012. P. 2088–2091.
8. Hassan M.A., Malik A.S., Fofi D., Saad N., Karasfi B., Ali Y.S., Meriaudeau F. Heart rate estimation using facial video: Areview. Biomedical Signal Processing and Control. 2017. V. 38. P. 346–360.
9. Wenjin Wang, Sander Stuijk, and Gerard de Haan. A Novel Algorithm for Remote Photoplethysmography: Spatial Subspace Rotation. IEEE transactions on biomedical engineering. September 2016.V. 63(9). P. 1974–1984. 
10. US8977347. Video-based estimation of heart rate variability. L.K. Mestha, S. Kyal, B. Xu, H.J. Madhu. 2015.