350 rub
Journal Neurocomputers №11 for 2012 г.
Article in number:
Technology for development of virtual reality systems based on brain-computer interface with utilization of cloud computing environment
Keywords:
brain-computer interface
virtual reality
cloud computing
cognitive visualization
human-computer interaction
Authors:
A.A. Bezgodov, K.V. Knyazkov, S.V. Kovalchuk, A.V. Boukhanovsky
Abstract:
The article presents new approach for building interactive virtual reality systems. The approach is based on the composition of three key technologies: virtual reality, brain-computer interfaces (BCI), and cloud computing. The main goal is building of the instrumental toolbox for solving contemporary e-Science tasks, which often require analysis of large and complex data. The approach is based on common semantic descriptive union of simulation data, visual 3d-scene within virtual reality environment and cognitive image within the user-s psyche. The basis for the semantic union is formed by Virtual Simulation Objects (VSO) concept, which defines principles of description and manipulation for semantic objects representing some «real-world» objects and allowing simulation running. The relation between objects within virtual reality, operator-s activities and VSO-based semantic description is proposed. BCI cycle is described with respect to the semantic description and technologies being used.
The key feature of proposed approach is analysis of emotion component within brain activity of the experts to identify subjective estimation (including nonverbal and unconscious). Analysis of user-s attention focus combined with measurement of brain activity allows to map this emotional estimation onto virtual reality space and semantic description of involved objects. So the «map of emotional estimation» can be defined and used for the purpose of automatic user support during virtual reality experience.
The technology for interactive virtual reality environments building proposed. The technology is based on CLAVIRE (CLoud Application VIRtual Environment) platform which allows to use cloud computing for solving wide range of tasks. The architecture of interactive system for BCI-based virtual reality systems implementation is developed using the CLAVIRE. It uses virtual test bed concept to form the environment for interactive 3d-scenes implementation. Interactive Workflow technology is used for dynamic user-system interaction support. This technology is supported by CLAVIRE. It allows to compose all the services within single composite application with run-time support of theirs interaction.
Pages: 23-29
References
- Hey T., Tansley S., Tolle K. The Fourth Paradigm. Data-Intensive Scientific // Discovery. Microsoft. 2009.
- Foster I., Zhao Y., Raicu I., Lu S. Cloud Computing and Grid Computing 360-Degree Compared // eprint arXiv:0901.0131, 2008. http://arxiv.org/ftp/arxiv/papers/0901/0901.0131.pdf
- БухановскийА.В., ВасильевВ.Н. Современныепрограммныекомплексыкомпьютерногомоделированияe-Science // Известиявысшихучебных заведений // Приборостроение. 2010. № 3. С. 60-64.
- van Gerven M., et. al. The Brain-Computer Interface Cycle // Journal of Neural Engineering. 2009.V. 6. № 4.
- Picard R.W. Affective computing // MIT Media Laboratory, Perceptual Computing. 1995. http://affect.media.mit.edu/pdfs/95.picard.pdf
- Смирнов П.А., Ковальчук С.В., Бухановский А.В. Системологический подход к проектированию и разработке предметно-ориентированных информационно-управляющих систем // Информационно-измерительные и управляющие системы. 2012 (в печати).
- Kovalchuk
S.V., et. al. Virtual Simulation Objects Concept as a Framework for System-Level
Simulation // Proceedings of IEEE
e-Sceince Conference. 2012. - БухановскийА.В. идр. CLAVIRE: перспективнаятехнологияоблачныхвычисленийвторогопоколения // Известиявысшихучебныхзаведений. Сер. Приборостроение. 2011. № 10. С. 7-13.
- Knyazkov K.V., et. al. CLAVIRE: e-Science Infrastructure for Data-driven Computing // Journal of Computational Science. 2012. V. 3. Is. 6. Р. 504-510.
- Emotiv EEG System. Electroencephalography // http://www.emotiv.com
- Безгодов А.А. и др. Виртуальный полигон для исследовательского проектирования морских
объектов и сооружений //
Известия высших учебных заведений. Сер. Приборостроение. 2011. № 10. С. 58-64.