350 rub
Journal Biomedical Radioelectronics №2 for 2015 г.
Article in number:
Speech signal analysis in human functional state research
Authors:
N.N. Lebedeva Dr.Sc.(Biol.), Professor, Head of Laboratory, Institute of Higher Nervous Activity and Neurophysiology of RAS, Moscow
E.D. Karimova Research Scientist, Institute of Higher Nervous Activity and Neurophysiology of RAS
E.A. Kazimirova Junior Research Scientist, Institute of Higher Nervous Activity and Neurophysiology of RAS
Abstract:
Despite of there are classic methods for human functional state specification (such as EEG, ECG, EMG, CGR et ce-tera), each of them has some disadvantages. Therefore, new physiological correlates of human state changes are still required. Speech signal seems to be representative since speech changes together with condition and practical as far as voice recording is non-invasive and requires no contact sensor.
Acoustic speech characteristics (like formants, fundamental frequency and speech rate) indicate emotional state and the degree of fatigue. Another type of speech analysis is non-linear which consider, for instance, correlation dimension (D2). This method is founded on Taken\\\'s theorem and allows reconstruct phase space trajectory based on the values of one variable, taken with time lag. D2 could be calculated for signal of different length. Presumably, D2 for phrase reflects mental processes stability and D2 for words or other short segment reflects autonomic system state. Non-linear characteristics of healthy human and human with voice tract pathology are different. Moreover, using them it is possible to determine emotional state. This research area seems to be very promising but insufficiently developed yet.
It is important to mark different kinds of experiment design. There are various way to get speech data such as asked participants to read sentences or to react on stimulus and this will influence on results. Nowadays the pat-terns of non-linear parameters changes need confirmation by classic physiological methods. Researches in this way enable to clarify the relationship between speech function and the human functional state and, on the next stage, correlate speech parameters dynamics with neurophysiological changes.
Pages: 3-12
References
- Ilin E.P. EHmocii i chuvstva. S.Pb.: Izd. dom «Piter». 2011. 782 s.
- Lebedeva N.N., Karimova E.D. Akusticheskie kharakteristiki rechevogo signala kak pokazatel funkcionalnogo sostojanija cheloveka // Uspekhi fiziologicheskikh nauk. 2014. T. 45. № 1. S. 57-95.
- Rusalova M.N. EHksperimentalnoe issledovanie ehmocionalnykh reakcijj cheloveka. M.: Nauka. 1979. 171 s.
- Sokolov E.I., Belova E.V. K voprosu ob ehlektrokardiograficheskikh korreljatakh ehmocionalnogo naprjazhenija // Fiziologija cheloveka. 1982. T. 8. № 4. S. 609 - 614.
- Lindsli D. EHmocii: EHksperimentalnaja psikhologija. M.: Izd-vo IL. 1960. T. 1. S. 629-685.
- Scherer, K.R. Psychological models of emotion // The neuropsychology of emotion / Ed. Borod. Oxford/New York: Oxford University Press. 2000. P. 137-162.
- Mayne T., Bonanno G.D. Emotions: Current issues and future directions. Guilford Press. 2001. 425 p.
- Juslin P. N., Laukaa P. Communication of emotions in vocal expression and music performance: Different channels, same code - // Psychological bulletin. 2003. V. 129. № 5. P. 770.
- Vygotskijj L.S. Myshlenie i rech. Izd. 5-e, ispr. M.: Labirint. 1999. 352 s.
- Burlak S. Proiskhozhdenie jazyka: fakty, issledovanija, gipotezy. M.: Astrel: Corpus. 2011. 464 s.
- CHernigovskaja T.V. Homo Loquens: ehvoljucija cerebralnykh funkcijj i jazyka // ZHurnal ehvoljucionnojj biokhimii i fiziologii. 2004. T. 40. № 5. S. 400 - 406.
- Rossinskaja E.R. Kriminalistika: voprosy i otvety. M.: Izd-vo JUnit-Dana. 1999. 351 s.
- Cohen A.S., Docherty N.M. Affective reactivity of speech and emotional experience in patients with schizophrenia // Schizophrenia Research. 2004. V. 69. № 1. P. 7 - 14.
- Frolov M.V., Milovanova G.B.Osobennosti kontrolja sostojanija cheloveka-operatora po pokazateljam osnovnogo tona i spektra ego rechi // Fiziologija cheloveka. 2009. T. 35. № 2. S. 136 - 138.
- Manjorov V.KH. Psikhodiagnostika lichnosti po golosu i rechi // Prakticheskaja psikhologija. SPb. 1997.
- JArceva V.N. Lingvisticheskijj ehnciklopedicheskijj slovar. M.: Sovetskaja ehnciklopedija. 1990. 685 s.
- Nosenko EH.L. K probleme ehmocionalnojj variativnosti rechi // Rech i ehmocii. L. 1975. S. 61 - 67.
- Nikonov A.V. Rechevaja dejatelnost i psikhofiziologicheskoe sostojanie cheloveka-operatora // Aktualnye voprosy fiziologii truda. Gorkijj. 1982. CH. III. S. 56-57.
- Popov V.A., Simonov P.V., Tishhenko A.G., Frolov I.V., KHachaturjanc L.S. Analiz intonacionnojj kharakteristiki rechi kak pokazatelja ehmocionalnogo sostojanija cheloveka v uslovijakh kosmicheskogo poleta // ZHurnal vysshejj nervnojj dejatelnosti. 1966. T. 16. № 6. S. 974 - 983.
- Lukjanov A.N., Frolov M.V. Signaly sostojanija cheloveka-operatora. M.: Nauka, 1969. 247 s.
- Aldoshina I.A., Pritts R. Muzykalnaja akustika. SPb.: Kompozitor. 2006. 720 s.
- Kratchfild D.P., Farmer D.D., Pakkard N.KH, SHou R.S. KHaos // V mire nauki ScientificAmerican (izdanie na russkom jazyke). 1987. № 2. S. 16-28.
- Vasserman E.L., Kartashev N.K., Polonnikov R.I. Fraktalnaja dinamika ehlektricheskojj aktivnosti mozga. SPb.: Nauka, 2004. 208 s.
- Takens F. Detecting strange attractors in turbulence // Dynamical Systems and Turbulence. Heidelberg: Springer-Verlag. 1981. R. 366-381.
- Malineckijj G.G., Potapov A.B. Sovremennye problemy nelinejjnojj dinamiki. M.: EHditorial URSS. 2000. 336 s.
- Sidorov K.V., Filatova N.N. Analiz priznakov ehmocionalno-okrashennojj rechi // Vestnik TvGTU. 2012. Vyp. 20. S. 26 - 32.
- Voss R., Clarce J. 1/f noise in music and speech // Nature. 1975. V. 258. P. 317 - 318.
- Kniffki K.Q., Mandel W., Tran Fia P. Temporal fluctuation in biorhytms: expression of self-organized criticality // Fractals. 1993. V. 1. № 3. P. 380 - 388.
- Kob M., Henrich N., Howard D., Herzel H., Tokuda I., Wolfe, J. Analysing and understanding the singing voice: recent progress and open questions // Current Bioinformatics. 2011. № 6. P. 362 - 374.
- Wolfe J.,Schubert E., Buckley K., Eliott R., Koboroff B., Chen J., Stevens C. Speech and music: acoustics and signals and the relation between them // Inaugural Conference on Music Communication Science. Sydney. 2007. P. 176 - 179.
- Henriquez P., Alonso J.B., Ferrer M.A., Travieso C.M., Godino-Llorente J.I. Diaz-de-Maria F. Characterization of Healthy and Pathological Voice Through Measures Based on Nonlinear Dynamics // IEEE transactions on audio, speech, and language processing. 2009. V. 17. № 6. P. 1186-1195.
- Filatova N.N., Sidorov K.V. Model interpretacii znaka ehmocijj po estestvennojj rechi // Izvestija JUFU. 2012. № 9. S. 39-44.
- Skljarov O.P.Fraktaly i krupnomasshtabnaja vremennaja struktura akusticheskogo rechevogo signala i muzyki // EHlektronnyjj zhurnal «Tekhnicheskaja akustika». 2004. № 21. S. 1-10.
- Satoh K., Kobayashi T., Yana K. Fractal dimension of fluctuations in fundamental period of speech // Noise in Physical Systems and 1/f fluctuations / ed. by Musha T., Sato S. and Yamamoto. M. Ohmsha Ltd. 1991. P. 505-508.
- Lebedeva N.N., Potapova R.K., Vekhov A.V., Karimova E.D., Kazimirova E.A. Akusticheskie kharakteristiki rechevogo signala i psikhofiziologicheskie korreljaty razlichnykh ehmocionalnykh sostojanijj v modelnykh ehksperimentakh // Biomedicinskaja radioehlektronika. 2013. № 12. S.35 - 43.
- Lebedeva N.N., Sidorova O.A., Maragejj R.A., Kotrovskaja A.N.Fraktalnyjj analiz rechevogo signala pri razlichnykh ehmocionalnykh sostojanijakh v modelnykh ehksperimentakh // Biomedicinskaja radioehlektronika. 2010. № 1. C. 3 - 7.
- Lebedeva N.N., Karimova E.D., Kazimirova E.A. Akusticheskie kharakteristiki rechi i individualnye osobennosti cheloveka // Biomedicinskaja radioehlektronika. 2013. № 6. S. 29 - 35.
- Gustafson-Capková S.Emotions in Speech: Tagset and Acoustic Correlates // Speech technology, term paper. 2001. P. 1 - 13.
- Iljuchenok I.R., Savostjanov A.N., Valeev R.G. Dinamika spektralnykh kharakteristik teta- i alfa-diapazonov EHEHG pri negativnojj ehmocionalnojj reakcii // ZHurnal vysshejj nervnojj dejatelnosti. 2001. T. 51. № 5. S. 563 - 571.
- Romanenko V.O. EHmocionalnye kharakteristiki vokalnojj rechi i ikh svjaz s akusticheskimi parametrami // Obshhestvo. Sreda. Razvitie. 2011. №3. S. 124 - 127.