http://www.techepdia.eu
This publication reflects the views only of the author, and the Commission cannot be held responsible for any use which may be made of the information contained therein.
Juraj Kačur, Gregor Rozinaj, Renata Rybárová
Multimodal interface (MMI) consists of several topics and modules which serve for natural and user-friendly communication with the system. Altogether, these modules represent the functionality of MMI. The list of modules which can be part of the multi-modal interface is following: speaker recognition, speech and command recognition, multi face recognition, gesture navigation, eye navigation and speech synthesis. This module will introduce some of them, to help understand basic principles and algorithm which meet us in our daily lives.
The main goal of the module is to introduce a student to the fundamental of multimodal interface and application. The student is clearly acquainted with the base principles of face recognition, speaker identification, voice commands navigation and gesture navigation. In the end all of mentioned modalities are described in possible multimodal applications.
Multimodal interface, multimodal application, user identification, 2D/3D face recognition, gesture navigation, speech recognition, speaker identification.
- [1] Probst, Michael; Schumann, Sebastian; Rozinaj, Gregor; Minarik, Ivan; Rybárová, Renata; Oravec, Miloš. EVALUATION: Final Multimodal Interface for User/Group-Aware Personalisation, Deliverable 5.5.1, available at http://www.hbb-next.eu/index.php/documents, Decmber 2013.
- [2] Vančo, Marek; Minárik, Ivan; Rybárová, Renata. Evolution of static gesture recognition. In: Redžúr 2014 proceedings; 8th International Workshop on Multimedia and Signal Processing; 13 May 2014, Dubrovnik, Croatia. Bratislava: Nakladateľstvo STU, 2014, p. 41-44. ISBN 978-80-227-4162-0.
- [3] Rautaray, Siddhart S., Agrawal, Anupam. Vision based hand gesture recognition for human computer interaction: a survey, Springer, 2012, pp 106-113. ISBN 978-3-642-27386-5
- [4] Kristensson, Per Ola; Denby, L.C. Continuous recognition and visualization of pen strokes and touch-screen gestures. In Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling, 2011, pp. 95-102.
- [5] Gülbahar, Mark; Probst, Michael; Schumann, Sebastian; Rozinaj, Gregor; Minarik, Ivan; Rybárová, Renata; Oravec, Miloš. Design and Protocol: Intermediate Multimodal Interface and Context Aware Recommendation Engine, Deliverable 5.3.1, available at http://www.hbb-next.eu/index.php/documents, October 2012.
- [6] T. Kinnunen, H. Li, An overview of text-independent speaker recognition: from features to supervectors, Speech communication, Vol. 52, pp. 12-40, Elsevier, 2010
- [7] Benesty J., Sondhi M. M., Huang Y., Springer Handbook of Speech Processing, Springer-Verlag, ISBN 978-3-540-49125-5, 2008