Abstract
The eXperience Induction Machine (XIM) is one of the most advanced mixed-reality spaces available today. XIM is an immersive space that consists of physical sensors and effectors and which is conceptualized as a general-purpose infrastructure for research in the field of psychology and human–artifact interaction. In this chapter, we set out the epistemological rational behind XIM by putting the installation in the context of psychological research. The design and implementation of XIM are based on principles and technologies of neuromorphic control. We give a detailed description of the hardware infrastructure and software architecture, including the logic of the overall behavioral control. To illustrate the approach toward psychological experimentation, we discuss a number of practical applications of XIM. These include the so-called, persistent virtual community, the application in the research of the relationship between human experience and multi-modal stimulation, and an investigation of a mixed-reality social interaction paradigm.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
U. Bernardet, M. Blanchard, and P.F.M.J. Verschure, “IQR: A Distributed System for Real-Time Real-World Neuronal Simulation,” Neurocomputing, vol. 44–46, Jun. 2002, pp. 1043–1048.
P. Milgram and F. Kishino, “A Taxonomy of Mixed Reality Visual Displays,” IEICE Transactions on Information Systems, vol. E77–D, Dec. 1994, pp. 1321–1329.
C. Coutrix and L. Nigay, “Mixed reality: a model of mixed interaction,” Proceedings of the Working Conference on Advanced Visual Interfaces, Venezia, Italy: ACM, 2006, pp. 43–50.
Y. Okuno, H. Kakuta, T. Takayama, and K. Asai, “Jellyfish party: blowing soap bubbles in mixed reality space,” Proceedings. The 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003, pp. 358–359.
T. Narumi, A. Hiyama, T. Tanikawa, and M. Hirose, “Inter-glow,” ACM SIGGRAPH 2007 Emerging Technologies, San Diego, California: ACM, 2007, p. 14.
D. Tavares, A. Burlamaqui, A. Dias, M. Monteiro, V. Antunes, G. Thó, T. Tavares, C. Lima, L. Gonçalves, G. Lemos, P. Alsina, and A. Medeiros, “Hyperpresence – An application environment for control of multi-user agents in mixed reality spaces,” Proceedings of the 36th Annual Symposium on Simulation, IEEE Computer Society, 2003, p. 351.
A.D. Cheok, X. Yang, Z.Z. Ying, M. Billinghurst, and H. Kato, “Touch-Space: Mixed Reality Game Space Based on Ubiquitous, Tangible, and Social Computing,” Personal and Ubiquitous Computing, vol. 6, Dec. 2002, pp. 430–442.
H. Ishii and B. Ullmer, “Tangible bits: towards seamless interfaces between people, bits and atoms,” Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Atlanta, Georgia, United States: ACM, 1997, pp. 234–241.
D. Birchfield, B. Mechtley, S. Hatton, and H. Thornburg, “Mixed-reality learning in the art museum context,” Proceeding of the 16th ACM International Conference on Multimedia, Vancouver, British Columbia, Canada: ACM, 2008, pp. 965–968.
V.B.D. Stanton and T. Pridmore, “Classroom collaboration in the design of tangible interfaces for storytelling,” CHI ’01: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, New York, USA: ACM, 2001, pp. 482 489.
W. Strauss, M. Fleischmann, M. Thomsen, J. Novak, U. Zlender, T. Kulessa, and F. Pragasky, “Staging the space of mixed reality – Reconsidering the concept of a multi user environment,” Proceedings of the Fourth Symposium on Virtual Reality Modeling Language, Paderborn, Germany: ACM, 1999, pp. 93–98.
A.D. Cheok, W. Weihua, X. Yang, S. Prince, F.S. Wan, M. Billinghurst, and H. Kato, “Interactive theatre experience in embodied + wearable mixed reality space,” Proceedings of the 1st International Symposium on Mixed and Augmented Reality, IEEE Computer Society, 2002, p. 59.
B. Brumitt, B. Meyers, J. Krumm, A. Kern, and S. Shafer, “EasyLiving: Technologies for Intelligent Environments,” Null, 2000, pp. 12–29.
R.A. Brooks, “The intelligent room project,” Proceedings of the 2nd International Conference on Cognitive Technology (CT ’97), IEEE Computer Society, 1997, p. 271.
T. Höllerer, J. Kuchera-Morin, and X. Amatriain, “The allosphere: a large-scale immersive surround-view instrument,” Proceedings of the 2007 Workshop on Emerging Displays Technologies: Images and Beyond: The Future of Displays and Interacton, San Diego, California: ACM, 2007, p. 3.
M. Mine, “Towards virtual reality for the masses: 10 years of research at Disney’s VR studio,” Proceedings of the Workshop on Virtual Environments 2003, Zurich, Switzerland: ACM, 2003, pp. 11–17.
A.F. Bobick, S.S. Intille, J.W. Davis, F. Baird, C.S. Pinhanez, L.W. Campbell, Y.A. Ivanov, A. Schutte, and A. Wilson, The KidsRoom: A Perceptually-Based Interactive and Immersive Story Environment,” Presence: Teleoperators & Virtual Environments, vol. 8, 1999, pp. 369–393.
K. Eng, A. Baebler, U. Bernardet, M. Blanchard, M. Costa, T. Delbruck, R.J. Douglas, K. Hepp, D. Klein, J. Manzolli, M. Mintz, F. Roth, U. Rutishauser, K. Wassermann, A.M. Whatley, A. Wittmann, R. Wyss, and P.F.M.J. Verschure, “Ada – intelligent space: An articial creature for the Swiss Expo.02,” Proceedings of the 2003 IEEE International Conference on Robotics and Automation (ICRA 2003), Sept. 14–19, 2003.
K. Eng, R. Douglas, and P.F.M.J. Verschure, “An Interactive Space that Learns to Influence Human Behavior,” Systems, Man and Cybernetics, Part A, IEEE Transactions on, vol. 35, 2005, pp. 66–77.
R.L. Atkinson, R.C. Atkinson, and E.E. Smith, Hilgards Einführung in die Psychologie, Spektrum Akademischer, Verlag, 2001.
M. Eysenck, Perspectives On Psychology, Psychology Press, Routledge, London, 1994.
H. Coolican, Research Methods and Statistics in Psychology, A Hodder Arnold Publication, London, 2004.
S. Freud, Das Ich und das Es: Metapsychologische Schriften., Fischer (Tb.), Frankfurt, 1992.
A. Gaggioli, “Using Virtual Reality in Experimental Psychology,” Towards Cyberpsychology, Amsterdam: IOS Press, 2001, pp. 157–174.
M. Slater, A. Antley, A. Davison, D. Swapp, C. Guger, C. Barker, N. Pistrang, and M.V. Sanchez-Vives, “A Virtual Reprise of the Stanley Milgram Obedience Experiments,” PLoS ONE, vol. 1, 2006, p. e39.
P.F.M.J. Verschure, T. Voegtlin, and R. Douglas, “Environmentally Mediated Synergy Between Perception and Behaviour in Mobile Robots,” Nature, vol. 425, 2003, pp. 620–624.
H. Gubler, M. Parath, and N. Bischof, “Eine Ästimationsstudie zur Sicherheits- und Erregungsregulation während der Adoleszenz,” Untersuchungen zur Systemanalyse der sozialen Motivation (III), vol. 202, 1994, pp. 95–132.
W. Barfield, D. Zeltzer, T. Sheridan, and M. Slater, “Presence and Performance Within Virtual Environments,” Virtual Environments and Advanced Interface Design, Oxford University Press, Inc., Oxford, 1995, pp. 473–513.
T. Nagel, “What Is It Like to be a Bat?,” Philosophical Review, vol. 83, 1974, pp. 435–450.
W.A. IJsselsteijn, H. de Ridder, J. Freeman, and S.E. Avons, “Presence: Concept, Determinants, and Measurement,” Human Vision and Electronic Imaging V, San Jose, CA, USA: 2000, pp. 520–529.
M. Slater, “RAVE Manifesto,” Barcelona, 2008.
J. Lessiter, J. Freeman, E. Keogh, and J. Davidoff, “A Cross-Media Presence Questionnaire: The ITC-Sense of Presence Inventory,” Presence: Teleoperators & Virtual Environments, vol. 10, 2001, pp. 282–297.
G. Riva, C. Botella, P. Legeron, and G. Optale, Cybertherapy: Internet and Virtual Reality As Assessment and Rehabilitation Tools for Clinical Psychology and Neuroscience, IOS Press, 2004.
A. Frisoli, F. Simoncini, M. Bergamasco, and F. Salsedo, “Kinematic Design of a Two Contact Points Haptic Interface for the Thumb and Index Fingers of the Hand,” Journal of Mechanical Design, vol. 129, May. 2007, pp. 520–529.
Z. Mathews, S. Bermúdez i Badia, and P.F.M.J. Verschure, “A novel brain-based approach for multi-modal multi-target tracking in a mixed reality space,” Proceedings of 4th INTUITION International Conference and Workshop on Virtual Reality 2007, Athens: 2007.
J. Manzolli and P.F.M.J. Verschure, “Roboser: A Real-World Composition System,” Computer Music Journal, vol. 29, 2005, pp. 55–74.
K. Wassermann, J. Manzolli, K. Eng, and P.F.M.J. Verschure, “Live Soundscape Composition Based on Synthetic Emotions,” IEEE Multimedia, vol. 10, 2003, pp. 82–90.
M. Slater, A. Frisoli, F. Tecchia, C. Guger, B. Lotto, A. Steed, G. Pfurtscheller, R. Leeb, M. Reiner, M.V. Sanchez-Vives, P. Verschure, and U. Bernardet, “Understanding and Realizing Presence in the Presenccia Project,” Computer Graphics and Applications, IEEE, vol. 27, 2007, pp. 90–93.
T.W. Schubert, “The sense of presence in virtual environments: A three-component scale measuring spatial presence, involvement, and realness,” Zeitschrift für Medienpsychologie, vol. 15, 2003, pp. 69–71.
B.G. Witmer and M.J. Singer, “Measuring Presence in Virtual Environments: A Presence Questionnaire,” Presence: Teleoperators & Virtual Environments, vol. 7, 1998, pp. 225–240.
A. Brogni, V. Vinayagamoorthy, A. Steed, and M. Slater, “Variations in physiological responses of participants during different stages of an immersive virtual environment experiment,” Proceedings of the ACM Symposium on Virtual Reality Software and Technology, Limassol, Cyprus: ACM, 2006, pp. 376–382.
P.M. Emmelkamp and M. Felten, “The process of exposure in vivo: cognitive and physiological changes during treatment of acrophobia,” Behaviour Research and Therapy, vol. 23, 1985, pp. 219–223.
M. Meehan, B. Insko, M. Whitton, and J. Frederick P. Brooks, “Physiological measures of presence in stressful virtual environments,” Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, San Antonio, Texas: ACM, 2002, pp. 645–652.
M. Slater, “How Colorful Was Your Day? Why Questionnaires Cannot Assess Presence in Virtual Environments,” Presence: Teleoperators & Virtual Environments, vol. 13, 2004, pp. 484–493.
U. Bernardet, M. Inderbitzin, S. Wierenga, A. Väljamäe, A. Mura, and P.F.M.J. Verschure, “Validating presence by relying on recollection: Human experience and performance in the mixed reality system XIM,” The 11th Annual International Workshop on Presence, October 25–27, 2008, pp. 178–182.
H. Dinh, N. Walker, L. Hodges, C. Song, and A. Kobayashi, “Evaluating the importance of multi-sensory input on memory and the sense of presence in virtual environments,” Virtual Reality, 1999. Proceedings, IEEE, 1999, pp. 222–228.
M. Inderbitzin, S. Wierenga, A. Väljamäe, U. Bernardet, and P.F.M.J. Verschure, “Social cooperation and competition in the mixed reality space eXperience Induction Machine.,” The 11th Annual International Workshop on Presence, October 25–27, 2008, pp. 314–318.
Anna Mura, B. Rezazadeh, A. Duff, J. Manzolli, S.L. Groux, Z. Mathews, U. Bernardet, S. Wierenga, S. Bermudez, S., and P. Verschure, “re(PER)curso: an interactive mixed reality chronicle,” ACM SIGGRAPH 2008 talks, Los Angeles, California: ACM, 2008, pp. 1–1.
T. Delbrück, A.M. Whatley, R. Douglas, K. Eng, K. Hepp, and P.F.M.J. Verschure, “A Tactile Luminous Floor for an Interactive Autonomous Space,” Robotics Autonomous System, vol. 55, 2007, pp. 433–443.
Acknowledgments
This work was carried out as part of the PRESENCCIA project, an EU-funded Integrated Project under the IST programme (Project Number 27731). The Original Floor System was developed by Institute of Neuroinformatics of ETH Zurich and of University of Zurich.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag London
About this chapter
Cite this chapter
Bernardet, U. et al. (2010). The eXperience Induction Machine: A New Paradigm for Mixed-Reality Interaction Design and Psychological Experimentation. In: Dubois, E., Gray , P., Nigay, L. (eds) The Engineering of Mixed Reality Systems. Human-Computer Interaction Series. Springer, London. https://doi.org/10.1007/978-1-84882-733-2_18
Download citation
DOI: https://doi.org/10.1007/978-1-84882-733-2_18
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-84882-732-5
Online ISBN: 978-1-84882-733-2
eBook Packages: Computer ScienceComputer Science (R0)