350 rub
Journal Information-measuring and Control Systems №11 for 2011 г.
Article in number:
Evaluation Methods for Systems of Situation Video Monitoring in a Meeting Room
Keywords: Computer vision smart space video monitoring speaker detection audiovisual signal processing
Authors:
Al. L. Ronzhin
Abstract:
This paper presents evaluation methods of video monitoring systems, which analyze situation during a meeting as well as detect and track participants, record speaker-s talks. Video monitoring system complexity depends on conditions and limitations, which are superposed by specific application, geometric parameters of observation area and signal quality. Several metrics are employed for evaluation of accuracy of video monitoring systems work - precision and accuracy of multiple object tracking. Several criteria were employed for evaluation of the proposed algorithm for speaker detection and recording: (1) initial delay between audio and video streams; (2) a length of recorded avi file; (3) number of duplicated frames. During the experiments 36 avi files were recorded in the discussion work mode. After manual checking it was detected that 89% of the files have speaker-s speech and 11% are false alarm files with noises. Such noises are produced at process of tester standing up from a chair, because in such a moment chair-s mechanical details make high noise. Also mistakes in detecting sitting participants influence on appearance of false files. A result of experiments shows, that avi file in mean consists of 40% duplicated frames. That frames consist of frames added in process for eliminating of initial delay between audio and video streams and frames added in synchronization process.
Pages: 12-16
References
  1. Lampi, F., Automatic Lecture Recording. Dissertation. The University of Mannheim, Germany. 2010.
  2. Erol, B., Li, Y., An overview of technologies for e-meeting and e-lecture // Proc. IEEE International Conference on Multimedia and Expo. 2005. P. 6-12.
  3. Rui, Y., Gupta, A., Grudin J., He, L., Automating lecture capture and broadcast: Technology and videography // Multimedia Systems. 2004. V. 10. P. 3-15.
  4. Rienks, R., Nijholt, A., Barthelmess, P.,Pro-active meeting assistants: attention please! // AI & Society V. 23(2), Springer. 2009. P. 213-231.
  5. ЮсуповР.М., РонжинА.Л.От умных приборов к интеллектуальному пространству // Вестник Российской Академии Наук: научный и общественно-политический журнал. 2010. Т. 80. Вып. 1. C. 45-51.
  6. Ронжин А. Л., Карпов А. А. Проектирование интерактивных приложений с многомодальным интерфейсом // Доклады ТУСУРа. 2010. № 1 (21). Ч. 1. С. 124-127.
  7. Фаворская М. Н.Оценка движения объектов в сложных сценах на основе тензорного подхода // Цифровая обработка сигналов. № 1. М.: Рязань. 2010. С. 2-9.
  8. Zhang, C., Yin, P., Rui, Y., Cutler, R., Viola, P., Sun, X., Pinto, N., and Zhang, Z., Boosting-Based Multimodal Speaker Detection for Distributed Meeting Videos // IEEE Transactions on Multimedia. 2008. V. 10. № 8. Р. 1541-1552.
  9. Viola, P., Jones, M., and Snow, D., Detecting pedestrians using patterns of motion and appearance // in Proc. IEEE ICCV. 2003. Р. 734-741.
  10. Bernardin, K., Elbs, A., and Stiefelhagen, R., Multiple object tracking performance metrics and evaluation in a smart room environment // in Proc. Int. Works. VisualSurveillance. Graz. Austria. 2006. P. 5-13.
  11. Ронжин Ал. Л., Ронжин Ан. Л. Система аудиовизуального мониторинга участников совещания в интеллектуальном зале // Доклады ТУСУРа. 2011. Ч. 1. № 1 (22). С. 153-157.