abstract

Maintainable management and access of lexical knowledge for multimodal virtual reality interfaces

Authors:

Chris Zimmerer,

Martin Fischbach,

Marc Erich LatoschikAuthors Info & Claims

VRST '16: Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology

Pages 347 - 348

https://doi.org/10.1145/2993369.2996310

Published: 02 November 2016 Publication History

Get Access

Abstract

This poster presents a maintainable method to manage lexical information required for multimodal interfaces. It is tailored for the application in real-time interactive systems, specifically for Virtual Reality, and solves three problems commonly encountered in this context: (1) The lexical information is defined on and grounded in a common knowledge representation layer (KRL) based on OWL. The KRL describes application objects and possible system functions in one place and avoids error-prone redundant data management. (2) The KRL is tightly integrated into the simulator platform using a semantically enriched object model that is auto-generated from the KRL and thus fosters high performance access. (3) A well-defined interface provides application wide access to semantic application state information in general and the lexical information in specific, which greatly contributes to decoupling, maintainability, and reusability.

References

[1]

Bolt, R. A. 1980. Put-that-there: Voice and gesture at the graphics interface. In Proceedings of the 7th Annual Conference on Computer Graphics and Interactive Techniques, ACM, New York, NY, USA, SIGGRAPH '80, 262--270.

Digital Library

Google Scholar

[2]

Bouchet, J., Nigay, L., and Ganille, T. 2004. Icare software components for rapidly developing multimodal interfaces. In Proceedings of the 6th International Conference on Multimodal Interfaces, ACM, 251--258.

Digital Library

Google Scholar

[3]

Latoschik, M. E., and Fischbach, M. 2014. Engineering variance: Software techniques for scalable, customizable, and reusable multimodal processing. In Proceedings of the HCI International Conference 2014, Springer.

Google Scholar

[4]

Latoschik, M. E., and Tramberend, H. 2010. Engineering realtime interactive systems: Coupling & cohesion of architecture mechanisms. In Proceedings of the 16th Eurographics conference on Virtual Environments & Second Joint Virtual Reality, 25--28.

Digital Library

Google Scholar

[5]

Latoschik, M., and Tramberend, H. 2011. Simulator X: A Scalable and Concurrent Architecture for Intelligent Realtime Interactive Systems. In Virtual Reality Conference (VR), 2011 IEEE, 171--174.

Digital Library

Google Scholar

[6]

Latoschik, M. E. 2005. A User Interface Framework for Multi-modal VR Interactions. In Proceedings of the 7th International Conference on Multimodal Interfaces, ACM, 76--83.

Digital Library

Google Scholar

Cited By

View all

Zimmerer CFischbach MLatoschik M(2018)Semantic Fusion for Natural Multimodal Interfaces using Concurrent Augmented Transition NetworksMultimodal Technologies and Interaction10.3390/mti20400812:4(81)Online publication date: 6-Dec-2018
https://doi.org/10.3390/mti2040081
Fischbach MWiebusch DLatoschik M(2017)Semantic Entity-Component State Management Techniques to Enhance Software Quality for Multimodal VR-SystemsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2017.265709823:4(1342-1351)Online publication date: 1-Apr-2017
https://dl.acm.org/doi/10.1109/TVCG.2017.2657098

Index Terms

Maintainable management and access of lexical knowledge for multimodal virtual reality interfaces
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Software architectures

Recommendations

Multimodal augmented reality: the norm rather than the exception
MVAR '16: Proceedings of the 2016 workshop on Multimodal Virtual and Augmented Reality

Augmented reality (AR) is commonly seen as a technology that overlays virtual imagery onto a participant's view of the world. In line with this, most AR research is focused on what we see. In this paper, we challenge this focus on vision and make a case ...
Multi-sensorial virtual reality and augmented human food interaction
MHFI '16: Proceedings of the 1st Workshop on Multi-sensorial Approaches to Human-Food Interaction

In the field of virtual reality (VR) research, media technologies to create a realistic feeling of being present in a real/virtual world by duplicating multi-sensory information have been studied over a long period. Recently, technologies for multi-...
Extending Virtual Reality Display Wall Environments Using Augmented Reality
SUI '19: Symposium on Spatial User Interaction

Two major form factors for virtual reality are head-mounted displays and large display environments such as CAVE®and the LCD-based successor CAVE2®. Each of these has distinct advantages and limitations based on how they’re used. This work explores ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

VRST '16: Proceedings of the 22nd ACM Conference on Virtual Reality Software and Technology

November 2016

363 pages

ISBN:9781450344913

DOI:10.1145/2993369

Conference Chairs:
Dieter Kranzlmüller
Leibniz Supercomputing Centre (LRZ) and Ludwig-Maximilians-Universität (LMU)
,
Gudrun Klinker
Technical University of Munich (TUM)

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2016

Check for updates

Author Tags

Qualifiers

Abstract

Conference

VRST '16

Sponsor:

VRST '16: 22th ACM Symposium on Virtual Reality Software and Technology

November 2 - 4, 2016

Munich, Germany

Acceptance Rates

Overall Acceptance Rate 66 of 254 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
106
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Reflects downloads up to 28 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zimmerer CFischbach MLatoschik M(2018)Semantic Fusion for Natural Multimodal Interfaces using Concurrent Augmented Transition NetworksMultimodal Technologies and Interaction10.3390/mti20400812:4(81)Online publication date: 6-Dec-2018
https://doi.org/10.3390/mti2040081
Fischbach MWiebusch DLatoschik M(2017)Semantic Entity-Component State Management Techniques to Enhance Software Quality for Multimodal VR-SystemsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2017.265709823:4(1342-1351)Online publication date: 1-Apr-2017
https://dl.acm.org/doi/10.1109/TVCG.2017.2657098

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Multimodal augmented reality: the norm rather than the exception

Multi-sensorial virtual reality and augmented human food interaction

Extending Virtual Reality Display Wall Environments Using Augmented Reality