Quantitative criteria and the concept of flight personnel diagnostics based on videooculography data

Л.С. Куравский; П.А. Мармалюк; Г.А. Юрьев; О.Б. Беляева; О.Ю. Прокопьева

Quantitative criteria and the concept of flight personnel diagnostics based on videooculography data

Л.С. Куравский¹, П.А. Мармалюк², Г.А. Юрьев³, О.Б. Беляева⁴, О.Ю. Прокопьева⁵

research article Pages: 24-43

¹ д.т.н., профессор, декан, факультет «Информационные технологии», Московский городской психолого-педагогический университет
² к.т.н., доцент, факультет «Информационные технологии», Московский городской психолого-педагогический университет
³ к.ф.-м.н., доцент, факультет «Информационные технологии», Московский городской психолого-педагогический университет
⁴ студент, факультет «Информационные технологии», Московский городской психолого-педагогический университет
⁵ магистрант, факультет «Информационные технологии», Московский городской психолого-педагогический университет

Keywords: eye tracking Markov model multifactor Markov network diagnostics flight simulator factor analysis

Abstract

Presented is the description of a new conceptual approach to fight crew-s diagnostic using aviation simulator training outcomes. It is based on representation of pilot-s gaze movement with the aid of a continuous-time Markov process. Under consideration are the procedures of underlying model identification, its goodness-of-fit estimation and construction of a classifier, which makes it possible to estimate the proximity of tested pilots - to the patterns related to different reference groups. The final criterion for assessment of flight crew-s proficiency, which is based on several flying exercises outcomes, is derived using integral quantitative diagnostic indicators defined by the identified model parameters. Presented experimental and calculation results evidence about applicability of the described approach. It is possible to develop automated diagnostic systems, which are based on the presented apparatus, for flight skills assessment by analyzing flying exercises outcomes.

How to cite

Куравский Л.С., Мармалюк П.А., Юрьев Г.А., Беляева О.Б., Прокопьева О.Ю. Количественные критерии и концепция диагностики лётного состава по данным видеоокулографии // Нейрокомпьютеры: разработка, применение. 2015. № 9. С. 24–43.

References

Barabanshhikov V.A. Vosprijatie individualno-psikhologicheskikh osobennostejj cheloveka po izobrazheniju celogo i chastichno otkrytogo lica // EHksperimentalnaja psikhologija. 2008. № 1. S. 62-83.
Barabanshhikov V.A. Okulomotornye struktury vosprijatija. M.: IP RAN. 1997. 384 s.
Barabanshhikov V.A., ZHegallo A.V. Registracija i analiz napravlennosti vzora cheloveka. M.: IP RAN. 2013. 316 s.
Beregovojj G.T., Zavalova N.D., Lomov B.F., Ponomarenko V.A. EHksperimentalno-psikhologicheskie issledovanija v aviacii i kosmonavtike. M.: Nauka. 1978. 303 s.
Kim Dzh.O., Mjuller CH.U., Klekka U.R. Faktornyjj, diskriminantnyjj i klasternyjj analiz. M.: Finansy i statistika. 1989. 215 s.
Kramer G.Matematicheskie metody statistiki. M.: Mir. 1976. 648 s.
Kuravskijj L.S. JUrev G.A. Verojatnostnyjj metod filtracii artefaktov pri adaptivnom testirovanii. EHksperimentalnaja psikhologija. 2012. T. 5. № 1. S. 119-131.
Kuravskijj L.S., Baranov S.N., Kornienko P.A. Obuchaemye mnogofaktornye seti Markova i ikh primenenie dlja issledovanija psikhologicheskikh kharakteristik // Nejjrokompjutery: razrabotka i primenenie. 2005. № 12. S. 65-76.
Kuravskijj L.S., Margolis A.A., JUrev G.A. Principy programmnojj realizacii psikhologicheskogo trenazhjora // Psikhologicheskaja nauka i obrazovanie. 2008. № 5. S. 182-188.
Kuravskijj L.S., Margolis A.A., JUrev G.A., Marmaljuk P.A. Koncepcija sistemy podderzhki prinjatija reshenijj dlja psikhologicheskogo testirovanija // Psikhologicheskaja nauka i obrazovanie. 2012. № 1. S. 56-65.
Kuravskijj L.S., Marmaljuk P.A., Alkhimov V.I., JUrev G.A. Matematicheskie osnovy novogo podkhoda k postroeniju procedur testirovanija // EHksperimentalnaja psikhologija. 2012. T. 5. № 4. S. 75-98.
Kuravskijj L.S., Marmaljuk P.A., Barabanshhikov V.A., Bezrukikh M.M., Demidov A.A., Ivanov V.V., JUrev G.A. Obuchaemye struktury kak osnova programmnogo obespechenija dlja diagnostiki navykov i kompetencijj // Nejjrokompjutery: razrabotka i primenenie. 2013. № 5. S. 46-60.
Kuravskijj L.S., Marmaljuk P.A., JUrev G.A., Baranov S.N., Poleshhuk G.N., Smirnov A.A., SHishov A.N. Diagnostika ljotnogo sostava po rezultatam raboty na aviacionnykh trenazhjorakh // Nejjrokompjutery: razrabotka, primenenie. № 10. S. 14-23.
Kuravskijj L.S., Ushakov D.V., Marmaljuk P.A., Panfilova A.S. Issledovanie faktornykh vlijanijj na razvitie psikhologicheskikh kharakteristik s primeneniem novogo podkhoda k ocenke adekvatnosti modelejj nabljudenijam // Informacionnye tekhnologii. 2011. № 11. C. 67-77.
Kuravskijj L.S., JUrev G.A. Adaptivnoe testirovanie kak markovskijj process: modeli i ikh identifikacija // Nejjrokompjutery: razrabotka i primenenie. 2011. № 2. S. 21-29.
Kuravskijj L.S., JUrev G.A. Ispolzovanie markovskikh modelejj pri obrabotke rezultatov testirovanija // Voprosy psikhologii. 2011. № 2. S. 112-120.
Leontev A.N. Kategorija dejatelnosti v sovremennojj psikhologii // Voprosy psikhologii. 1979. № 3. S. 11-15.
Lomov B.F.O sistemnom podkhode v psikhologii // Voprosy psikhologii. 1975. № 2. S. 31-45.
Louli D., Maksvell A. Faktornyjj analiz kak statisticheskijj metod // M.: Mir. 1967. 144 s.
Markovskie modeli v zadachakh diagnostiki i prognozirovanija: Ucheb. posobie / pod red. L.S. Kuravskogo.M.: RUSAVIA. 2013. 172 s.
Rukovodstvo po ljotnojj ehkspluatacii vertoljota Mi-8MTV. Ministerstvo transporta RF. M.: 1994.
Oboznov A.A.Psikhicheskaja reguljacija operatorskojj dejatelnosti (v osobykh uslovijakh rabochejj sredy). M.: IPRAN. 2003. 184 s.
Kuravsky L.S., Malykh S.B. Application of Markov models for analysis of development of psychological characteristics // Australian Journal of Educational & Developmental Psychology. 2004. V. 2. P.29-40.
Kuravsky L.S., Malykh S.B. On the application of queuing theory to analysis of twin data // Twin Research. June 2000. V. 3. Issue 2. P. 92-98.
Kuravsky L.S. and Baranov S.N. The concept of multifactor Markov networks and its application to forecasting and diagnostics of technical systems // Proc. Condition Monitoring 2005. Cambridge. United Kingdom. July 2005. P. 111-117.
Kuravsky L.S., Marmalyuk P.A., Baranov S.N., Yuryev G.A. Monitoring of flight crew condition using oculomotor activity measurements // In: Proc. 12th International Conference on Condition Monitoring & Machinery Failure Prevention Technologies. Oxford. UK. June 2015. 8 P.
Kuravsky L.S., Marmalyuk P.A., Yuryev G.A., Dumin P.N. A Numerical Technique for the Identification of Discrete-State Continuous-Time Markov Models // Applied Mathematical Sciences. 2015. V. 9. № 8. 379-391.
Kuravsky L.S., Marmalyuk P.A., Yuryev G.A., Dumin P.N., Panfilova A.S. Probabilistic Modeling of a Testing Procedure // Applied Mathematical Sciences. 2015. V. 9. № 82. R. 4053-4066.
Kuravsky L.S., Marmalyuk P.A., Baranov S.N., Alkhimov V.I., Yuryev G.A., Artyukhina S.V. A New Technique for Testing Professional Skills and Competencies and Examples of its Practical Applications // Applied Mathematical Sciences. 2015. V. 9. № 21. P. 1003-1026.

[1] Barabanshhikov V.A. Vosprijatie individualno-psikhologicheskikh osobennostejj cheloveka po izobrazheniju celogo i chastichno otkrytogo lica // EHksperimentalnaja psikhologija. 2008. № 1. S. 62-83.

[2] Barabanshhikov V.A. Okulomotornye struktury vosprijatija. M.: IP RAN. 1997. 384 s.

[3] Barabanshhikov V.A., ZHegallo A.V. Registracija i analiz napravlennosti vzora cheloveka. M.: IP RAN. 2013. 316 s.

[4] Beregovojj G.T., Zavalova N.D., Lomov B.F., Ponomarenko V.A. EHksperimentalno-psikhologicheskie issledovanija v aviacii i kosmonavtike. M.: Nauka. 1978. 303 s.

[5] Kim Dzh.O., Mjuller CH.U., Klekka U.R. Faktornyjj, diskriminantnyjj i klasternyjj analiz. M.: Finansy i statistika. 1989. 215 s.

[6] Kramer G.Matematicheskie metody statistiki. M.: Mir. 1976. 648 s.

[7] Kuravskijj L.S. JUrev G.A. Verojatnostnyjj metod filtracii artefaktov pri adaptivnom testirovanii. EHksperimentalnaja psikhologija. 2012. T. 5. № 1. S. 119-131.

[8] Kuravskijj L.S., Baranov S.N., Kornienko P.A. Obuchaemye mnogofaktornye seti Markova i ikh primenenie dlja issledovanija psikhologicheskikh kharakteristik // Nejjrokompjutery: razrabotka i primenenie. 2005. № 12. S. 65-76.

[9] Kuravskijj L.S., Margolis A.A., JUrev G.A. Principy programmnojj realizacii psikhologicheskogo trenazhjora // Psikhologicheskaja nauka i obrazovanie. 2008. № 5. S. 182-188.

[10] Kuravskijj L.S., Margolis A.A., JUrev G.A., Marmaljuk P.A. Koncepcija sistemy podderzhki prinjatija reshenijj dlja psikhologicheskogo testirovanija // Psikhologicheskaja nauka i obrazovanie. 2012. № 1. S. 56-65.

[11] Kuravskijj L.S., Marmaljuk P.A., Alkhimov V.I., JUrev G.A. Matematicheskie osnovy novogo podkhoda k postroeniju procedur testirovanija // EHksperimentalnaja psikhologija. 2012. T. 5. № 4. S. 75-98.

[12] Kuravskijj L.S., Marmaljuk P.A., Barabanshhikov V.A., Bezrukikh M.M., Demidov A.A., Ivanov V.V., JUrev G.A. Obuchaemye struktury kak osnova programmnogo obespechenija dlja diagnostiki navykov i kompetencijj // Nejjrokompjutery: razrabotka i primenenie. 2013. № 5. S. 46-60.

[13] Kuravskijj L.S., Marmaljuk P.A., JUrev G.A., Baranov S.N., Poleshhuk G.N., Smirnov A.A., SHishov A.N. Diagnostika ljotnogo sostava po rezultatam raboty na aviacionnykh trenazhjorakh // Nejjrokompjutery: razrabotka, primenenie. № 10. S. 14-23.

[14] Kuravskijj L.S., Ushakov D.V., Marmaljuk P.A., Panfilova A.S. Issledovanie faktornykh vlijanijj na razvitie psikhologicheskikh kharakteristik s primeneniem novogo podkhoda k ocenke adekvatnosti modelejj nabljudenijam // Informacionnye tekhnologii. 2011. № 11. C. 67-77.

[15] Kuravskijj L.S., JUrev G.A. Adaptivnoe testirovanie kak markovskijj process: modeli i ikh identifikacija // Nejjrokompjutery: razrabotka i primenenie. 2011. № 2. S. 21-29.

[16] Kuravskijj L.S., JUrev G.A. Ispolzovanie markovskikh modelejj pri obrabotke rezultatov testirovanija // Voprosy psikhologii. 2011. № 2. S. 112-120.

[17] Leontev A.N. Kategorija dejatelnosti v sovremennojj psikhologii // Voprosy psikhologii. 1979. № 3. S. 11-15.

[18] Lomov B.F.O sistemnom podkhode v psikhologii // Voprosy psikhologii. 1975. № 2. S. 31-45.

[19] Louli D., Maksvell A. Faktornyjj analiz kak statisticheskijj metod // M.: Mir. 1967. 144 s.

[20] Markovskie modeli v zadachakh diagnostiki i prognozirovanija: Ucheb. posobie / pod red. L.S. Kuravskogo.M.: RUSAVIA. 2013. 172 s.

[21] Rukovodstvo po ljotnojj ehkspluatacii vertoljota Mi-8MTV. Ministerstvo transporta RF. M.: 1994.

[22] Oboznov A.A.Psikhicheskaja reguljacija operatorskojj dejatelnosti (v osobykh uslovijakh rabochejj sredy). M.: IPRAN. 2003. 184 s.

[23] Kuravsky L.S., Malykh S.B. Application of Markov models for analysis of development of psychological characteristics // Australian Journal of Educational & Developmental Psychology. 2004. V. 2. P.29-40.

[24] Kuravsky L.S., Malykh S.B. On the application of queuing theory to analysis of twin data // Twin Research. June 2000. V. 3. Issue 2. P. 92-98.

[25] Kuravsky L.S. and Baranov S.N. The concept of multifactor Markov networks and its application to forecasting and diagnostics of technical systems // Proc. Condition Monitoring 2005. Cambridge. United Kingdom. July 2005. P. 111-117.

[26] Kuravsky L.S., Marmalyuk P.A., Baranov S.N., Yuryev G.A. Monitoring of flight crew condition using oculomotor activity measurements // In: Proc. 12th International Conference on Condition Monitoring & Machinery Failure Prevention Technologies. Oxford. UK. June 2015. 8 P.

[27] Kuravsky L.S., Marmalyuk P.A., Yuryev G.A., Dumin P.N. A Numerical Technique for the Identification of Discrete-State Continuous-Time Markov Models // Applied Mathematical Sciences. 2015. V. 9. № 8. 379-391.

[28] Kuravsky L.S., Marmalyuk P.A., Yuryev G.A., Dumin P.N., Panfilova A.S. Probabilistic Modeling of a Testing Procedure // Applied Mathematical Sciences. 2015. V. 9. № 82. R. 4053-4066.

[29] Kuravsky L.S., Marmalyuk P.A., Baranov S.N., Alkhimov V.I., Yuryev G.A., Artyukhina S.V. A New Technique for Testing Professional Skills and Competencies and Examples of its Practical Applications // Applied Mathematical Sciences. 2015. V. 9. № 21. P. 1003-1026.

Abstract

How to cite

Related articles