350 rub
Journal Biomedical Radioelectronics №11 for 2011 г.
Article in number:
The Extra Linguistic Component Estimation of Speech Signal in Emotional States Simulated Situations
Authors:
N.N. Lebedeva, O.A. Sidorova, A.V. Vekhov, A.N. Kotrovskaya
Abstract:
The problem of recognition of different types of human emotions on the basis of speech signal character-istics is of interest both in the theoretical aspect and for solution of different applied tasks. It is especially important for the objective definition of a human state under extreme conditions when a speaker is beyond the visibility range. The authors of the article developed the software for the analysis of emotionally colored speech signals, which makes it possible to calculate spectral speech characteristics, such as peak frequencies (formants, overtones) and the spectral power density, and to plot the noise approximant of a spectrum for determination of the fractal dimension of speech signal. The fractal analysis was applied to volunteers - speech signal in simulated emotional states. Significant differences in fractal dimension were revealed between the simulated states of fear, joy, and anger as compared to a neutral state. For hole volunteers group the most prominent changes in the parameter under study were observed during simulation of anger (an increase of 24,1 %) and joy (an increase of 19,2 %); simulation of fear decreased the dimension by 8,4 %. These data are similar data obtained (in our latest experiments) for actors - in the same simulated emotional states (these data were assumed as standard). Taking into account that the growth of the fractal dimension increases "the diversity" within the respective process, i.e., its intonational modulation, which brings the process under study closer to random processes, whereas the fall of this parameter, on the contrary, increases its similarity with determinate (fully defined) processes, it can be suggested that fear is associated with speech monotony, and more active emotional states involve an increase in intonation diversity. Analysis of the fractal dimension of a speech signal on the basis of its acoustic characteristics suggests that the emotions directed "outward" (for communication) are accompanied by greater intonation variety, i.e., by an increase in the fractal dimension of emotionally colored speech. Fear is a negative emotion directed "inward". It is thought to be opposed to joy, one of the main positive reactions directed "outward", from oneself. Anger, though being a negative reaction, is bright and active and also directed outward (from oneself). Variation cardio measure indices show cardiovascular regulation changes at simulated emotional states. The application of the fractal analysis to the estimation of experimental results not only supplements them but may be valuable for the construction of operative express methods of the estimation of the human functional state.
Pages: 41-50
References
  1. Бодалев А. А.Восприятие и понимание человека человеком. М. 1982.
  2. Пашина А.X., Морозов В.П. Опознавание личности по голосу на основе его нормального и инвертированного во времени звучания // Психологический журнал. 1990. Т. 11. № 3. С. 70 - 78.
  3. Витт Н.В.Личностно-ситуационная опосредованность выражения и распознавания эмоций в речи // Вопросы психологии. 1991. №1. С. 95 107.
  4. Дмитриева Е.С., Гельман В.Я, Зайцева К.А, Орлов A.M. Онтогенетические особенности психофизиологических механизмов восприятия эмоционального компонента речи у музыкально одаренных детей // ЖВНД. 2004. Т.54. №5. С. 581 591
  5. Морозов В.П.Эмоциональный слух человека // Журнал эволюционной биохимии и физиологии. 1985. Т. XXI. №6. С. 569 - 577.
  6. Манёров В.Х.Психодиагностика личности по голосу и речи // В сб. Практическая психология. СПб. 1997.
  7. Фролов М.В., Милованова Г.Б. Электрофизиологические помехи и контроль состояния человека-оператора. М.: УРСС. 1996. 160 с.
  8. Никонов А.В.К вопросу о возможности непрерывной оценки эмоционального состояния человека-оператора во время полета по его речевым сообщениям // Речь и эмоции: Материалы симпозиума 11-14 ноября 1974 г. Л. 1975.
  9. Рамишвили Г.С.Автоматическое опознавание говорящего по голосу. М. 1981.
  10. Frijda N. Recognition of emotion // Advances in Exp. Soc. Psychol. 1969. V. 4. Р. 167 - 223.
  11. Пашина А.Х.К проблеме распознавания эмоционального контекста звуковой речи // Вопросы психологии. 1991. № 1. С. 88 - 96.
  12. Satoh K., Kobayashi T., Yana K. Fractal dimension of fluctuations in fundamental period of speech - In: Noise in Physical Systems and 1/f fluctuations/ Ed. by T. Musha, S. Sato andM. Yamamoto. Ohmsha Ltd. 1991. P. 505 - 508.
  13. Mandelbrot B.B. Fractals: Form, Chance and Dimension - San Francisco Freeman.1977.; Voss R., Clarce J.   1/f noise in music and speech // Nature. 1975. V. 258. P.317 - 318.
  14. Kniffki K. Q., Mandel W., Tran Fia P.Temporal fluctuation in biorhytms: expression of self-organized criticality - ? Fractals, 1993, v.1, №3, p 380-388.
  15. Voss R., Clarce J.   1/f noise in music and speech // Nature. 1975. V. 258. P. 317 - 318.
  16. Лебедева Н.Н., Сидорова О.А., Марагей Р.А., Котровская А.Н.Фрактальный анализ речевого сигнала при различении эмоционального состояния в модельных экспериментах // Биомедицинская радиоэлектроника. 2010. № 1. С. 3 - 7.
  17. Криволапчук И.А. Психофизиологическая цена напряженной информационной нагрузки у детей и подростков 5-14 лет // Физиология человека. 2008. Т.34. №4. С. 28 - 35.
  18. Манеров В.X.Экспериментально-теоретические основы социальной идентификации и интерпретации говорящего: Автореф.: дисс. докт. наук. СПб. 1993.
  19. SpaniasA.S. «Speechcoding: atutorialreview» // Proc. oftheIEEE. 1994. V. 82. № 10. P. 1541 - 1582.
  20. McAulayR.J., QuatieriT.F. «Sinusoidal Coding» in Speech Coding and Synthesis. Amsterdam: Elsevier Science Publishers. 1995.P. 121 - 176.
  21. Назаров М.В. Методы цифровой обработки и передачи речевых сигналов. М.: Радио и связь. 1985.
  22. Рабинер Л.Р. Цифровая обработка речевых сигналов. М.: Радио и связь. 1981.
  23. Сидорова О.А. Нейропсихология эмоций. М.: Наука. 2001. 149 с.