article

Domain-specific design of 3d interaction techniques: An approach for designing useful virtual environment applications

Authors:

Doug A. BowmanAuthors Info & Claims

Presence: Teleoperators and Virtual Environments, Volume 18, Issue 5

Pages 370 - 386

https://doi.org/10.1162/pres.18.5.370

Published: 01 October 2009 Publication History

Abstract

Few production virtual environment (VE) applications involve complex three-dimensional (3D) interaction. Our long-term collaboration with architects and engineers in designing 3D user interfaces (3D UIs) has revealed some of the causes: existing interaction tasks and/or techniques are either too generic when isolated from the application context, or too specific to be reusable. We propose a new design approach called domain-specific design (DSD) that sits between the generic and specific design approaches, with an emphasis on using domain knowledge in 3D interaction techniques. We also describe an interaction design framework encompassing generic, domain-specific, and application-specific interaction tasks and techniques. This framework can be used by designers to think of ways to produce domain-specific interaction techniques. We present a particular DSD method, and demonstrate its use for the design of cloning techniques in a structural engineering application. Results from empirical studies demonstrate that interaction techniques produced with domain knowledge in mind outperformed other techniques by improving task efficiency, work flow, and usefulness of the 3D UI.

References

[1]

Allison, D., Wills, B., Bowman, D. A., Wineman, J., & Hodges, L. F. (1997). The virtual reality gorilla exhibit. IEEE Computer Graphics and Applications, 17(6), 30-38.

Digital Library

[2]

Beaudouin-Lafon, M. (2000). Instrumental interaction: An interaction model for designing post-WIMP user interfaces. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), 446-453.

Digital Library

[3]

Bowman, D. A., Gabbard, J. L., & Hix, D. (2002). A survey of usability evaluation in virtual environments: Classification and comparison of methods. Presence: Teleoperators and Virtual Environments, 11(4), 402-424.

Digital Library

[4]

Bowman, D. A., & Hodges, L. F. (1997). An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments. Proceedings of the Symposium on Interactive 3D Graphics, 35-38.

Digital Library

[5]

Bowman, D. A., & Hodges, L. F. (1999). Formalizing the design, evaluation, and application of interaction techniques for immersive virtual environments. The Journal of Visual Languages and Computing, 10(1), 37-53.

[6]

Bowman, D. A., Johnson, D. B., & Hodges, L. F. (1999). Testbed evaluation of virtual environment interaction techniques. Proceedings of the ACM Symposium on Virtual Reality Software and Technology, 26-33.

Digital Library

[7]

Bowman, D. A., Kruijff, E., LaViola, J. J., & Poupyrev, I. (2004). 3D user interfaces: Theory and practice. Boston: Addison-Wesley.

Digital Library

[8]

Bowman, D. A., Setareh, M., Pinho, M. S., Ali, N., Kalita, A., Lee, Y., et al. (2003). Virtual-SAP: An immersive tool for visualizing the response of building structure to environmental conditions. Proceedings of the IEEE Conference on Virtual Reality, 243-250.

Digital Library

[9]

Bukowski, R., & Sequin, C. (1995). Object associations: A simple and practical approach to virtual 3D manipulation. Proceedings of the Symposium on Interactive 3D Graphics, 131-138.

Digital Library

[10]

Chen, J. (2006). Design and evaluation of domain-specific interaction techniques in the AEC domain for immersive virtual environments. Unpublished PhD dissertation, Department of Computer Science, Virginia Tech, Blacksburg.

Digital Library

[11]

Chen, J., & Bowman, D. A. (2006). Evaluation of the effectiveness of cloning techniques for architectural virtual environments. Proceedings of the IEEE Conference on Virtual Reality, 103-110.

Digital Library

[12]

Chen, J., Bowman, D. A., Lucas, J. F., & Wingrave, C. A. (2004). Interfaces for cloning in immersive virtual environments. Proceedings of the Eurographics Symposium on Virtual Environments, 91-98.

Digital Library

[13]

Chen, J., Bowman, D. A., Wingrave, C. A., & Lucas, J. F. (2004). Designing explicit numeric input interfaces for immersive virtual environments (Computer Science Report TR-04-13). Blacksburg, Virginia: Virginia Tech.

[14]

Darken, R., & Cevik, H. (1999). Map usage in virtual environments: Orientation issues. Proceedings of the IEEE Conference on Virtual Reality, 133-140.

Digital Library

[15]

Diaper, D. (1989). Task analysis for human-computer interaction. New York: Wiley.

Digital Library

[16]

Drettakis, G., Roussou, M., Reche, A., & Tsingos, N. (2007). Design and evaluation of a real-world virtual environment for architecture and urban planning. Presence: Teleoperators and Virtual Environments, 16(3), 318-332.

Digital Library

[17]

Feiner, S., & MacIntyre, B. (1993). Knowledge-based augmented reality. Communications of the ACM, 36(7), 53-61.

Digital Library

[18]

Foley, J. D., Wallace, V. L., & Chan, P. (1984). The human factors of computer graphics interaction techniques. IEEE Computer Graphics and Applications, 4(11), 13-48.

Digital Library

[19]

Gabbard, J. L. (1997). A taxonomy of usability characteristics in virtual environments. Unpublished PhD dissertation, Department of Computer Science, Virginia Tech, Blacksburg.

[20]

Gordon, S. E. (1994). Systematic training program design: Maximizing effectiveness and minimizing liability. Englewood Cliffs, NJ: Prentice-Hall.

[21]

Gordon, S. E., Schmierer, K. A., & Gill, R. T. (1993). Conceptual graph analysis: Knowledge acquisition for instructional system design. Human Factors, 35, 459-481.

[22]

Hand, C. (1997). A survey of 3D interaction techniques. Computer Graphics Forum, 16(5), 269-281.

[23]

Hix, D., & Hartson, H. R. (1993). Developing user interfaces: Ensuring usability through product and process. New York: Wiley.

Digital Library

[24]

Hix, D., Swan, J. E., Gabbard, J. L., McGee, M., Durbin, J., & King, T. (1999). User-centered design and evaluation of a real-time battlefield visualization virtual environment. Proceedings of the IEEE Conference on Virtual Reality, 96-103.

Digital Library

[25]

Kalawsky, R. S. (1999). VRUSE--A computerised diagnostic tool: For usability evaluation of virtual/synthetic environment systems. Applied Ergonomics, 30(1), 11-25.

[26]

Kaur, K., Maiden, N., & Sutcliffe, A. G. (1999). Interacting with virtual environments: An evaluation of a model of interaction. Interacting with Computers, 11(4), 403-426.

[27]

Kirwan, B., & Ainsworth, L. K. (1992). A guide to task analysis. London: Taylor and Francis.

[28]

Lin, C.-R., & Loftin, R. B. (2000). VR user interface: Closed world interaction. Proceedings of the Virtual Reality Software and Technology (VRST) Conference, 153-159.

Digital Library

[29]

Lin, J. J.-W., Duh, H. B. L., Parker, D. E., Abi-Rached, H., & Furness, T. A. (2002). Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment. Proceedings of the IEEE Conference on Virtual Reality, 164-171.

Digital Library

[30]

Mills, S., & Noyes, J. (1999). Virtual reality: An overview of user-related design issues. Interacting with Computers, 11(4), 375-386.

[31]

Moran, T. P. (1983). Getting into a system: External-internal task mapping. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), 45-49.

Digital Library

[32]

Myers, B. (1994). Challenges of HCI design and implementation. Interactions, 1(1), 73-83.

Digital Library

[33]

Oh, J.-Y., & Stuerzlinger, W. (2005). Moving objects with 2D input devices in CAD systems and desktop virtual environments. Proceedings of the Graphics Interface Conference, 195-202.

Digital Library

[34]

Plumlee, M. D., & Ware, C. (2006). Zooming versus multiple window interfaces: Cognitive costs of visual comparisons. Transactions on Computer-Human Interaction, 13(2), 179- 209.

Digital Library

[35]

Poupyrev, I., Billinghurst, M., Weghorst, S., & Ichikawa, T. (1996). The Go-Go interaction technique: Non-linear mapping for direct manipulation in VR. Proceedings of the ACM Symposium of User Interface System and Technology (UIST), 79-80.

Digital Library

[36]

Poupyrev, I., Weghorst, S., Billinghurst, M., & Ichikawa, T. (1997). A framework and testbed for studying manipulation techniques for immersive VR. Proceedings of the Virtual Reality System and Technology (VRST) Conference, 21-28.

Digital Library

[37]

Poupyrev, I., Weghorst, S., Billinghurst, M., & Ichikawa, T. (1998). Egocentric object manipulation in virtual environments: Empirical evaluation of interaction techniques. Computer Graphics Forum (EUROGRAPHICS), 17(3), 41-52.

[38]

Schön, D. A. (1983). The reflective practitioner: How professionals think in action. New York: Basic Books.

[39]

Setareh, M., Bowman, D. A., & Kalita, A. (2005). Development of a virtual reality structural analysis system. Journal of Architectural Engineering, 11(4), 156-164.

[40]

Simon, A. (1981). The sciences of the artificial. Cambridge, MA: MIT Press.

Digital Library

[41]

Sutcliffe, A. G. (2003). Multimedia and virtual reality: Designing multisensory user interfaces. Mahwah, NJ: Lawrence Erlbaum Associates, Inc.

Digital Library

[42]

Sutcliffe, A. G., Benyon, D., & van Assche, F. (1996). Domain knowledge for interactive system design. New York: Chapman & Hall.

Digital Library

[43]

Tan, D. S., Robertson, G. G., & Czerwinski, M. (2001). Exploring 3D navigation: Combining speed-coupled flying with orbiting. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), 418- 425.

Digital Library

[44]

Ullmer, B., & Ishii, H. (1997). The metaDESK: Models and prototypes for tangible user interfaces. Proceedings of the ACM Symposium on User Interface Software and Technology (UIST), 223-232.

Digital Library

[45]

van Dam, A., Forsberg, A. S., Laidlaw, D. H., LaViola, J., & Simpson, R. M. (2000). Immersive VR for scientific visualization: A progress report. IEEE Computer Graphics and Applications, 20(6), 26-52.

Digital Library

[46]

Wielinga, B. J., Schreiber, A. T., & Breuker, J. A. (1992). KADS: A modeling approach to knowledge engineering. Knowledge Acquisition, 4(1), 5-53.

Digital Library

[47]

Wolf, T. V., Rode, J. A., Sussman, J., & Kellogg, W. A. (2006). Dispelling design as the "black art" of CHI. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), 521-530.

Digital Library

[48]

Wonka, P., Wimmer, M., Sillion, F., & Ribarsky, W. (2003). Instant architecture. Transactions on Graphics (SIGGRAPH), 22(4), 669-677.

Digital Library

[49]

Zhai, S., Buxton, W., & Milgram, P. (1994). The "silk cursor": Investigating transparency for 3D target acquisition. Proceedings of the ACM Conference on Human Factors in Computing Systems (CHI), 459-464.

Digital Library

Cited By

Medeiros M(2024)Working In Mixed Realities: 3D User Interfaces And Interaction Patterns To Integrate Practices In Different Perceptual SpacesExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651130(1-5)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3651130
Viciana-Abad RReyes-Lecuona ARosa-Pujazón APérez-Lorenzo J(2014)The influence of different sensory cues as selection feedback and co-location in presence and task performanceMultimedia Tools and Applications10.1007/s11042-012-1070-868:3(623-639)Online publication date: 1-Feb-2014
https://dl.acm.org/doi/10.1007/s11042-012-1070-8
Polys NBacim FSetareh MJones BPosada JBrutzman DGraèanin DYoo BOyarzun D(2013)Building novel Web3D user interfacesProceedings of the 18th International Conference on 3D Web Technology10.1145/2466533.2466554(135-138)Online publication date: 20-Jun-2013
https://dl.acm.org/doi/10.1145/2466533.2466554
Show More Cited By

Domain-specific design of 3d interaction techniques: An approach for designing useful virtual environment applications
1. Human-centered computing

Recommendations

Design and evaluation of domain-specific interaction techniques in the aec domain for immersive virtual environments
Evaluating the need for display-specific and device-specific 3D interaction techniques
ICVR'07: Proceedings of the 2nd international conference on Virtual reality

There are many visual display devices and input devices available to designers of immersive virtual environment (VE) applications. Most 3D interaction techniques, however, were designed using a particular combination of devices. The effects of migrating ...
Separating the effects of level of immersion and 3D interaction techniques
VRST '06: Proceedings of the ACM symposium on Virtual reality software and technology

Empirical evidence of the benefits of immersion is an important goal for the virtual environment (VE) community. Direct comparison of immersive systems and non-immersive systems is insufficient because differences between such systems may be due not ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Presence: Teleoperators and Virtual Environments

Presence: Teleoperators and Virtual Environments Volume 18, Issue 5

October 2009

91 pages

ISSN:1054-7460

Issue’s Table of Contents

Publisher

MIT Press

Cambridge, MA, United States

Publication History

Published: 01 October 2009

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 14 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Medeiros M(2024)Working In Mixed Realities: 3D User Interfaces And Interaction Patterns To Integrate Practices In Different Perceptual SpacesExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651130(1-5)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3651130
Viciana-Abad RReyes-Lecuona ARosa-Pujazón APérez-Lorenzo J(2014)The influence of different sensory cues as selection feedback and co-location in presence and task performanceMultimedia Tools and Applications10.1007/s11042-012-1070-868:3(623-639)Online publication date: 1-Feb-2014
https://dl.acm.org/doi/10.1007/s11042-012-1070-8
Polys NBacim FSetareh MJones BPosada JBrutzman DGraèanin DYoo BOyarzun D(2013)Building novel Web3D user interfacesProceedings of the 18th International Conference on 3D Web Technology10.1145/2466533.2466554(135-138)Online publication date: 20-Jun-2013
https://dl.acm.org/doi/10.1145/2466533.2466554
Bacim FPolys NChen JSetareh MLi JMa LKnorich Zuffo MMouton CSlusallek PYoo BPolys N(2010)Cognitive scaffolding in Web3D learning systemsProceedings of the 15th International Conference on Web 3D Technology10.1145/1836049.1836063(93-100)Online publication date: 24-Jul-2010
https://dl.acm.org/doi/10.1145/1836049.1836063

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents