Abstract
3D environments represent a great opportunity for universal access to information, as they offer an intuitive interaction paradigm, similar to what is experienced by humans in their everyday lives. In spite of that, several 3D interfaces are characterized by poor structures and are hard to navigate. This paper presents the multimodal concept of the Interaction Locus (IL) as a means to give structure to 3D scenes, helping the user to interact with and access information inside them. The concept was initially developed with particular reference to desktop virtual reality (2.5 D virtual reality), but it is general enough to be extended to other contexts, such as real 3D scenes. The final part of this work shows how the IL concept addresses the need for a unified authoring methodology, capable of allowing access to different target user groups from a variety of different devices.
Similar content being viewed by others
References
Apple Computer (1992) Macintosh Human Interface Guidelines. Addison-Wesley, Reading
Ardito C, Costabile MF, Lanzilotti R, Minardi G, Pittarello F (2002) Ispezione di Usabilità e Valutazione della Componente Sonora all’interno del Sito Web ‘Espressionismo Tedesco a Palazzo Grassi’. Technical Report DEVISU project BA-R04, Università di Bari, Bari, Italy (in italian)
Baddeley A (1998) Human Memory: Theory and Practice. Allyn & Bacon, New York
Blattner M, Sumikawa D, Greenberg R (1989) Earcons and icons: their structure and common design principles. Hum-Comput Interact 4:11–44
Brewster SA (1994) Providing a structured method for integrating non-speech audio into human-computer interfaces. PhD dissertation, University of York, York, UK
Brewster SA, Wright PC, Edwards ADN (1995) Parallel earcons: reducing the length of audio messages. Int J of Hum-Comput Stud 43(2):153–175
Brusilovsky P (1996) Methods and techniques of adaptive hypermedia. User Modell User-Adapted Interact 6(2–3):87–129
Brusilovsky P, Kobsa A, Vassileva J (eds) (1998) Adaptive Hypertext and Hypermedia Systems. Kluwer Academic Publishers, Dordrecht, Netherlands
Brutzman D (2002) Teaching 3D modeling and simulation: virtual kelp forest case study. In: Proc 7th Int Conf 3D Web Technology, Tempe, Arizona, USA, 24–28 February 2002. ACM Press, New York, pp 93–101
Carrey R, Bell G (1997) The Annotated Vrml 2.0 Reference Manual. Addison-Wesley, Reading
Celentano A, Fogli D, Mussio P, Pittarello F (2002) Agents for distributed context-aware interaction. In: Proc AIMS (Artificial Intelligence in Mobile Systems) 2002 Workshop, Lyon, France, 22 July 2002
Celentano A, Pittarello F (2002) Classes of experiences: a high level approach to support content experts for the authoring of 3D environments. In: Geiger C, Paelke V, Dachselt R, Dörner R, Grimm P (eds) Proc Structured Design of Virtual Environments and 3D-Components Workshop at the Web3D 2001 Conference, Paderborn, Germany, 19 February 2001. Shaker Verlag, Aachen
van Dam A (2001) User interfaces: disappearing, dissolving, and evolving. Commun ACM 44(3):50–52
Darken RP, Silbert JL (1996) Wayfinding strategies and behaviors in large virtual worlds. In: Proc CHI’96. ACM Press, New York, pp 142–149
Feiner S, MacIntyre B, Hollerer T, Webster T (1997) A touring machine: prototyping 3D Mobile augmented reality systems for exploring the urban environment. In: Proc IEEE ISWC’97 (First International Symposium on Wearable Computers), Cambridge MA, 13–14 October 1997. IEEE, Piscataway, pp 74–81
Foley J, van Dam A, Feiner S, Hughes J (1996) Computer Graphics: Principles and Practice. Addison-Wesley, Reading
Fux JJ (1725) Gradus ad Parnassum. J.P. van Ghelen, Vienna (translated in: Mann A (1971) The Study of Counterpoint, Norton, New York)
Gaver WW (1989) Auditory icons: Using sound in computer interfaces. Hum-Comput Interact 2:167–177
Gleicher M, Herdon KP, van Dam A (1994) Workshop on the challenges of 3D interaction. SIGCHI Bull 26(4):1–9
Haik E, Barker T, Sapsford J, Trainis S (2002) Investigation into effective navigation in desktop virtual interfaces. In: Proc 7th Int Conf on 3D Web Technology, Tempe, Arizona, USA, 24–28 February 2002. ACM Press, New York, pp 59–66
Hollerer T, Feiner S, Terauchi T, Rashid G, Hallaway D (1999) Exploring MARS: developing indoor and outdoor user interfaces to a mobile augmented reality system. Comput Graphics 23(6):779–785
Logitech I-Feel Mouse http://www.logitech.com
MacIntyre B, Feiner S (1996) Future multimedia user interfaces. Multimedia Syst 4(5):250–268
Microsoft Corporation (1992) The Windows Interface: An Application Design Guide. Microsoft Press, Redmond
Milgram P, Kishino F (1994) A taxonomy of mixed reality visual displays. IEICE Trans Inf Syst E77-D(12)
Mynatt ED (1994) Auditory presentations of graphical user interfaces. In: Kramer G (ed) Auditory Display: Sonification, Audification, and Auditory Interfaces. Addison-Wesley, Reading, pp 533–556
Nadeau R (1999) Building virtual worlds with VRML. IEEE Comput Graphics Appl 19(2):18–29
Nielsen J (1994) Heuristic evaluation. In: Nielsen J, Mack RL (eds) Usability Inspection Methods. John Wiley and Sons, New York, pp 25–64
Nigay L, Coutaz J (1993) A design space for multimodal interfaces: concurrent processing and data fusion. In: Proc CHI93, Amsterdam, 24–29 April. ACM Press, New York, pp 172–178
Norman DA (1993) Things that Make Us Smart – Defending Human Attributes in the Age of the Machine. Addison-Wesley, Reading
Palazzo Grassi. http://www.palazzograssi.it
Pejtersen AM, Rasmussen J (1997) Ecological information systems and support of learning: coupling work domain information to user characteristics. In: Helander MG, Landauer TK, Prabhu PV (eds) Handbook of Human Computer Interaction. Elsevier, Amsterdam, pp 315–346
Pittarello F (2001) Desktop three-d interfaces for Internet users: efficiency and usability issues. PhD dissertation, Università Ca’ Foscari, Venice, Italy
Pittarello F, Celentano A (2001) Interaction Locus – A multimodal approach for the structuring of virtual spaces. In: Proc HCItaly 2001 Symposium, Florence, Italy, 27 September 2001
Pittarello F (2001) Multi sensory 3d tours for cultural heritage: the Palazzo Grassi experience. In: ICHIM 2001 Cultural Heritage and Technologies in the Third Millennium, Milan, Italy, 3–7 September 2001. Archives & Museum Informatics, Pittsburgh, PA, USA, vol 1, pp 73–90
Pittarello F (1999) Walking on the edge of the well of the Itza: The reconstruction of an ancient Maya metropolis in the centre of the northern Yucatan. Technical Report Computer Science Series CS-99–29, Università Ca’ Foscari, Venice, Italy
Pittarello F, Pittarello M, Italiano GF (1998) Architecture and digital exhibitions – the Einstein Tower world. In: Göbel N, Landauer J, Lang U, Wapler M (eds) Virtual Environments ’98 – Proc Eurographics Workshop in Stuttgart, Germany, 16–18 June 1998. Springer-Verlag, Wien New York, pp 162–171
Schnädelbach H, Koleva B, Flintham M, Fraser M, Chandler P, Foster M, Benford S, Greenhalgh C, Izadi S, Rodden T (2002) The Augurscope: A mixed reality interface for outdoors. In: Proc CHI 2002. ACM Press, New York, pp 1–8
Schneider-Hufschmidt M, Kühme T, Malinowski U (eds) (1993) Adaptive User Interfaces: Principles and Practice. North-Holland, Elsevier Science, Amsterdam
Stephanidis C, Savidis A (2001) Universal access in the information society: methods, tools and interaction technologies. Univ Acces Inf Soc 1:40–55
Web 3D Consortium. http://www.web3d.org/
World Wide Web Consortium (W3C) HTML 4.01 Specification. http://www.w3.org/tr/html4/
XML – Extensible Markup Language Specification. http://www.w3.org/xml/
Yates F (1966) The Art of Memory. University of Chicago Press, Chicago
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Pittarello, F. Accessing information through multimodal 3D environments: towards universal access. UAIS 2, 189–204 (2003). https://doi.org/10.1007/s10209-003-0044-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10209-003-0044-z