Yu. G. Gorshkov - Ph.D.(Eng.), Associate Professor, Department of Information Security, Post-Doctorate Fellow, Department of Medical-Engineering Information Technologies (BMT-2), Bauman Moscow State Technical University

This paper examines the principles for building speech analysis systems to assess a person-s emotional state. The Speech Technology Center (St. Petersburg) has developed a methodology to identify and analyze the acoustic characteristics of speech to assess changes in a speaker-s psycho-physiological state. The diagnostic system includes the hardware and software suite "IKAR-Lab". An expert-s time consumption to process audio recordings and obtain data of a speaker-s emotional tension is 8 to 10 times greater than the duration of the speech signal under analysis. It provides a methodology for assessing the state of emotional tension based on a multilevel wavelet analysis of speech signal. Software «WaveView VSA» has been developed to build sonograms with a high time-frequency resolution. The paper provides the structure of a speech study system «Fon-NI» and audio recording device parameters. Wavelet sonograms are obtained and a speaker-s emotional tension is assessed in real time. It compares the time-frequency characteristics of sonograms of speech sounds based on the Fourier transform and a multilevel wavelet transform. We have built up and processed an audio database of 352 six-year students with an increased emotional burden during exams and the defense of their graduation paper. It provides examples of the processing of speech signals recorded under different emotional tensions in speakers.

 

1. Galunov V.I. O vozmozhnosti opredeleniya e'moczional'nogo sostoyaniya govoryashhego po rechi // Rechevy'e texnologii. 2008. № 1. S. 60 - 66.
2. Gorshkov Ju.G. Novy'e resheniya rechevy'x texnologij bezopasnosti // Speczial'naya texnika. Moskva. 2006. № 4. S. 41 - 47.
3. Osy'shnaya D.P., Samoxina M.A., Ivanov L.N.  K voprosu o «golosovom poligrafe» (ch. 1, 2) // Saratov: Laboratoriya MMPJaiP SGU im. N.G. Cherny'shevskogo. 2011. S. 1 ? 5.
4. Gorshkov Ju.G. Analiz i zasekrechivanie rechevogo signala: Uchebnoe posobie. Moskva: Izd-vo MGTU im. N.E'. Baumana. 2007. 34 s.
5. Gorshkov Ju.G. Apparatno-programmny'e sredstva oczenki e'moczional'nogo sostoyaniya cheloveka po akusticheskim signalam // Instrumental'naya detekcziya lzhi - 15 let na strazhe zakona: itogi projdennogo i perspektivy' razvitiya. Mezhdunar. nauchno-praktich. Konf. speczialistov-poligrafologov pravooxranitel'ny'x organov.  Kazan'. 21 - 24 sentyabrya. 2009.
6. Gorshkov Ju.G. Issledovatel'skij kompleks chastotno-vremennogo analiza rechevogo signala s ispol'zovaniem vejvlet-texnologii // Vestnik Moskovskogo gosudarstvennogo texnicheskogo universiteta im. N.E'. Baumana. Ser. Priborostroenie. 2011. № 4. S. 78 - 87. 
7. Gorshkov Ju.G. Vy'sokotochnaya obrabotka rechevy'x signalov s ispol'zovaniem mnogourovnevogo vejvlet-analiza // Materialy' VIII Mezhdunar. otraslevoj nauchno-texn. konf. «Texnologii informaczionnogo obshhestva». Sekcziya 4. Cifrovoe teleradioveshhanie i audiovideoinformatika. Moskva. 20 - 21 fevralya. 2014. S. 16.