Abstract
This paper presents a smart input device based on multimodal analysis methods using human bio-signals. The core of the smart input device is software modules, which consist of an intelligent driving function and an analysis processing function for bio-signals. The smart input device utilizes a multimodal interface that analyzes and recognizes human bio-signal patterns. The multimodal analysis system can recognize a user’s emotional and stress status by analyzing an electrocardiogram (ECG), and it can determine the user’s level of concentration from electroencephalogram (EEG) patterns. To analyze the concentration, stress, and emotional status of the user, the EEG rendering system and ECG analysis system use five signal values, i.e., MID_BETA, THETA, ALPHA, DELTA, GAMMA, and the P, Q, R, S and T waves. A reformation of SVM and a clustering algorithm were applied to the user’s EEG and ECG signal patterns for body context recognition. In our experiment, the on/ off status of the user’s stress status controls the difficulties of the game, such as the selecting the type of race course or the number of obstacles. In addition, the speed of the car can be controlled depending on the concentration or non-concentration status of the user. The stress status of the user was predicted with an accuracy of 83.2% by the K-means algorithm, and the concentration status was predicted with an accuracy of 71.85% by the SVM algorithm. We showed that a bio-signal interface is quite useful and feasible for new games.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Picard, R., Vyzaz, E., Healey, J.: Toward Machine Emotional Intelligence/ Analysis of Affective Physiological State. IEEE Transl. Pattern Analysis and Machine Intelligence 23(10), 1175–1191 (2001)
Kramer, M.A.: Auto associative Neural Networks. Computers and Chemical Engineering 16(4), 313–328 (1992)
Vaughan, T., et al.: Brain-computer interface technology: a review of the second international meeting. IEEE Transactions on Neural Systems and Rehabilitation Engineering 2, 94–109 (2003)
Haynes, J.D., Rees, G.: Decoding mental states from brain activity in humans. Nature Neuroscience 7(7) (2006)
Poli, R., Cinel, C., Citi, L., Sepulveda, F.: Evolutionary Brain Computer Interfaces. In: Giacobini, M. (ed.) EvoWorkshops 2007. LNCS, vol. 4448, pp. 301–310. Springer, Heidelberg (2007)
Platt, J.C.: Fast training of support vector machines using sequential minimal optimization. In: Scholkopf, B., Burges, C., Smola, A. (eds.), Advances in Kernel Methods—Support Vector Learning, pp. 185–208. MIT Press, Cambridge (1998)
Platt, J.C.: Using analytic QP and sparseness to speed training of support vector machines. In: Kearns, M.S., Solla, S.A., Cohn, D.A. (eds.) Advances in Neural Information Processing Systems, vol. 11, MIT Press, Cambridge (1999)
Platt, J.C., Nello Cristianini, N., Shawe-Taylor, J.: Large margin DAG’s for multiclass classification. In: Solla, S.A., Leen, T.K., Müller, K.-R. (eds.) Advances in Neural Information Processing Systems, vol. 12, pp. 547–553. MIT Press, Cambridge (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 IFIP International Federation for Information Processing
About this paper
Cite this paper
Lee, H., Kim, T., Shin, D., Park, H., Kim, S., Shin, D. (2012). Research on a Smart Input Device Using Multimodal Bio-signal Interface. In: Park, J.J., Zomaya, A., Yeo, SS., Sahni, S. (eds) Network and Parallel Computing. NPC 2012. Lecture Notes in Computer Science, vol 7513. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35606-3_67
Download citation
DOI: https://doi.org/10.1007/978-3-642-35606-3_67
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35605-6
Online ISBN: 978-3-642-35606-3
eBook Packages: Computer ScienceComputer Science (R0)