S.S. Zhumazhanova¹

1 Omsk State Technical University 

Systems for remote detection of a person's state today have enormous potential, but the identification features of states in each system are different. States of mental and physical stress have a huge impact on the performance of the operator's work tasks, and it is important to distinguish between them.

The purpose of the work is to review research on identifying states of physical and mental stress by analyzing the temperature of the subject's face and body; conducting experiments aimed at inducing a state of mental stress using the Stroop verbal-color test and physical stress after exercise and analyzing the main differences between the states and the perspectives for their use.

Significant differences were found between the mean temperatures of the areas under physical stress and the standard deviation of temperatures under mental stress.

The research results can be applied in applications, monitoring systems for the state of operators of complex technical and technological facilities.

Stress is as a high level of emotional arousal, usually associated with mental or physical stress. To determine the stressful state of a person, a continuous analysis of physiological signals – ECG, EEG, skin temperature, respiratory rate is carried out. To overcome the limitations associated with the use of contact sensors for recording physiological parameters, methods of computational psychophysiology based on IR-imaging have been used recently.

A review of the work on the formation of a thermal picture during and after physical and mental stress is provided. Experiments were carried out to register changes in the thermal patterns of the face and neck regions of 84 subjects after physical exercises and in a state of mental stress when passing the Stroop verbal-color test.

A technique for automatic detection of 26 anatomical areas of face and neck regions was developed. The average value and standard deviation of temperatures of all selected areas of the face and neck regions in a state of physical stress are lower than in other states. The lowest temperature in a state of physical stress is observed in the area of the face under the nose and above the lip, which can be explained by the increased respiratory rate that occurs during and after exercise. In general, the low temperature readings compared to other conditions under consideration can be explained by increased sweating, lowering body temperature and narrowing of the lumen of blood vessels observed during exercise.

Under mental stress, the average temperature values remain the same as in normal state, however, the standard deviation exceeds the same values during stress when passing the Stroop color test. Such leaps are especially noticeable in areas No. 5 and 6 – the inner corners of the eyes, as well as No. 21 and 22 – the area of the face under the nose, which is explained by the concentration of attention during the test and the frequent change in RR (increase/decrease in RR).

Accounting for such changes will help expand the capabilities of new applications for assessing the current state of the subject.

Zhumazhanova S.S. Difference of thermal patterns of the face and neck regions in states of physical and mental stresses. Biomedicine Radioengineering. 2021. V. 24. № 1. P. 13–21. DOI: 10.18127/j15604136-202101-02 (In Russian).

1. Global status report on road safety 2018 [Electronic resource]. URL: https://www.who.int/publications-detail/global-status-reporton-road-safety-2018 (accessed: 08.04.2020).
2. Lyu T., Song W., Du K. Human Factors Analysis of Air Traffic Safety Based on HFACS-BN Model: 23. Appl. Sci. Multidisciplinary Digital Publishing Institute. 2019. V. 9. № 23. P. 5049.
3. The State of Industrial Cyber Security 2019 [Electronic resource]. Applied Risk. URL: https://applied-risk.com/resources/the-stateof-industrial-cyber-security-2019 (accessed: 10.04.2020).
4. Security I., Institute P. 2019 Cost of a Data Breach Report. P. 76.
5. ICL’s 5 Safety Principles [Electronic resource]. ICL. URL: http://icl-group-sustainability.com/reports/changing-the-safety-culture/ (accessed: 10.04.2020).
6. Moriarty C.D. Practical Human Factors for Pilots. Academic Press. 2014. 305 p.
7. Mariotti A. The effects of chronic stress on health: new insights into the molecular mechanisms of brain–body communication. Future Sci. OA. 2015. V. 1. № 3.
8. Research I., Marriott B.M. Physiological Responses to Exercise in the Heat. Nutritional Needs in Hot Environments: Applications for Military Personnel in Field Operations. National Academies Press (US). 1993.
9. Zontak A., Sideman S., Verbitsky O., Beyar R. Dynamic Thermography: Analysis of Hand Temperature During Exercise. Ann. Biomed. Eng. 1998. V. 26. № 6. P. 988–993.
10. Merla A., Di Donato L., Romani G.L. Infrared functional imaging: analysis of skin temperature during exercise. Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology. 2002. V. 2. P. 1141–1142.
11. Taelman J., vandeput S., Spaepen A., Huffel van S. Influence of Mental Stress on Heart Rate and Heart Rate Variability. 4th European Conference of the International Federation for Medical and Biological Engineering. Ed. Vander Sloten J. et al. Berlin: Heidelberg: Springer. 2009. P. 1366–1369.
12. Or C.K.L., Duffy V.G. Development of a facial skin temperature-based methodology for non-intrusive mental workload measurement. 2007.
13. Pavlidis I., Tsiamyrtzis P., Shastri D., Wesley A., Zhou Y., Lindner J. Peter, Buddharaju P., Joseph R., Mandapati A., Dunkin B., Bass B. Fast by Nature – How Stress Patterns Define Human Experience and Performance in Dexterous Tasks: 1. Sci. Rep. Nature Publishing Group. 2012. V. 2. № 1. P. 1–9.
14. Shastri D., Merla A., Tsiamyrtzis P., Pavlidis I. Imaging facial signs of neurophysiological responses. IEEE Trans. Biomed. Eng. 2009. V. 56. № 2. P. 477–484.
15. Puri C., Olson L., Pavlidis I. StressCam: non-contact measurement of users’ emotional states through thermal imaging. CHI EA ’05. 2005.
16. Cardone D., Pinti P., Merla A. Thermal Infrared Imaging-Based Computational Psychophysiology for Psychometrics. Comput. Math. Methods Med. 2015. V. 2015.
17. Kang J., McGinley J., McFadyen G., Babski-Reeves K. Determining learning level and effective training times using thermography. 2006.
18. Heikens M.J, Gorbach A.M., Eden H.S., Savastano D.M., Chen K.Y., Skarulis M.C., Yanovski J.A. Core body temperature in obesity. Am. J. Clin. Nutr. 2011. V. 93. № 5. P. 963–967.
19. Karthikeyan P., Murugappan M., Yaacob S. A review on stress inducement stimuli for assessing human stress using physiological signals. 2011 IEEE 7th International Colloquium on Signal Processing and its Applications. 2011. P. 420–425.
20. ZHumazhanova S.S., Lukin D.V., Belgorodcev A.A. Razrabotka metodiki vydelenija uchastkov lica i shei na termogrammakh i izobrazhenijakh v vidimom spektre dlja posledujushhego analiza v celjakh vyjavlenija psikhofiziologicheskogo sostojanija subekta (Obzor) // Voprosy Zashhity Informacii. Nauchno-tekhnicheskijj centr oboronnogo kompleksa «Kompas». 2018. № 4 (123). P. 24–35.
21. Kenny G.P., McGinn R. Restoration of thermoregulation after exercise. J. Appl. Physiol. American Physiological Society. 2016.  V. 122. № 4. P. 933–944.
22. Ferreira J.J.A. Mendonça L.C.S., Nunes L.A.O., Andrade Filho A.C.C., Rebelatto J.R., Salvini T.F. Exercise-Associated Thermographic Changes in Young and Elderly Subjects. Ann. Biomed. Eng. 2008. V. 36. № 8. P. 1420–1427.
23. Kenny G.P., Salvini T.F. Muscle temperature transients before, during, and after exercise measured using an intramuscular multisensor probe. J. Appl. Physiol. American Physiological Society. 2003. V. 94. № 6. P. 2350–2357.