article

Free access

Tangible multimodal interfaces for safety-critical applications

Authors:

Philip R. Cohen,

David R. McGeeAuthors Info & Claims

Communications of the ACM, Volume 47, Issue 1

Pages 41 - 46

https://doi.org/10.1145/962081.962103

Published: 01 January 2004 Publication History

All formats PDF

Abstract

Designing effective digital systems in safety-critical arenas takes interfaces inspired by, or included in, the physical world.

References

[1]

Cohen, P.R., Johnston, M., McGee, D.R., Oviatt, S.L., Pittman, J.A., Smith, I., et al. QuickSet: Multimodal interaction for distributed applications. In Proceedings of the IEEE International Multimedia Conference (Seattle, WA, Nov. 1997), 31--40.

Digital Library

Google Scholar

[2]

Cohen, P.R., McGee, D.R., and Clow, J. The efficiency of multimodal interaction for a map-based task. In Proceedings of the Applied Natural Language Programming Conference (Seattle, WA, Apr. 2000), 331--338.

Digital Library

Google Scholar

[3]

Gorman, P., Ash, J., Lavelle, M., Lyman, J., Delcambre, L., and. Maier, D. Bundles in the wild: Managing information to solve problems and maintain situation awareness. Library Trends 49, 2 (2000), 266--289.

Google Scholar

[4]

Institute of Medicine. The Computer-based Patient Record: An Essential Technology for Health Care, 2nd edition. National Academy Press, Washington, D.C., 1997.

Google Scholar

[5]

Mackay, W.E. Is paper safer? The role of flight strips in air traffic control. ACM Trans. on Computer-Human Interaction 6, 4 (1999). ACM Press, NY, 311--340.

Digital Library

Google Scholar

[6]

McGee, D.R., Cohen, P.R., Wesson, R.M., and Horman, S. Comparing paper and tangible multimodal tools. In Proceedings of the Conference on Human Factors in Computing Systems, (Minneapolis, MI, Apr. 20--25, 2002). ACM Press, NY, 407--414.

Digital Library

Google Scholar

[7]

McGee, D.R., Cohen, P.R., and Wu, L. Something from nothing: Augmenting a paper-based work practice with multimodal interaction. In Proceedings of the Conference on Designing Augmented Reality Environments, (Helsingor, Denmark, Apr. 12--14, 2000), 71--80.

Digital Library

Google Scholar

[8]

Moore, G.A. Crossing the Chasm: Marketing and Selling High-Tech Goods to Mainstream Customers. Harper Business, NY, 1991.

Google Scholar

[9]

Oviatt, S.L. Mutual disambiguation of recognition errors in a multimodal architecture. In Proceedings of Conference on Human Factors in Computing Systems, (The Hague, The Netherlands, Apr. 1999). ACM Press, New York, NY, 576--583.

Digital Library

Google Scholar

[10]

Oviatt, S.L. and Cohen, P.R. Multimodal interfaces that process what comes naturally. Commun. ACM 43, 3 (Mar. 2000), 45--53.

Digital Library

Google Scholar

[11]

Underkoffler, J. and Ishii, H. Urp: A luminous tangible workbench for urban planning and design. In Proceedings of the ACM Conference on Human Factors in Computing Systems (The Hague, The Netherlands, Apr. 1999). ACM Press, NY, 386--393.

Digital Library

Google Scholar

[12]

Wellner, P. Interacting with paper on the DigitalDesk. Commun. ACM 36, 7 (July 1993), 87--96.

Digital Library

Google Scholar

Cited By

View all

Gong RHua M(2023)Designing Multimodal User Interfaces for Hybrid Collaboration: A User-Centered ApproachHCI International 2023 – Late Breaking Papers10.1007/978-3-031-48038-6_5(67-82)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-48038-6_5
Hou YFeng ZYang XXu TQiu XZhang X(2022)STMMIScientific Programming10.1155/2022/39527582022Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1155/2022/3952758
Ohneiser OAdamala JSalomea I(2021)Integrating Eye- and Mouse-Tracking with Assistant Based Speech Recognition for Interaction at Controller Working PositionsAerospace10.3390/aerospace80902458:9(245)Online publication date: 3-Sep-2021
https://doi.org/10.3390/aerospace8090245
Show More Cited By

Index Terms

Tangible multimodal interfaces for safety-critical applications

Recommendations

Tangible Interfaces: An Analysis of User Experience Using the AR Sandbox Project
IHC '17: Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems

The desire to make the human-computer interaction more natural, and the limitation between real and virtual became practically imperceptible, resulted in the development of Tangible Interfaces (TUI). In TUI physical objects are interpreted by the system ...
Tangible User Interfaces
Tangible User Interfaces: Technology You Can Touch

To make computer and communications technology easier to work with, vendors are beginning to release products utilizing tangible user interfaces, in which users interact with physical objects that both represent and control digital information.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

Communications of the ACM Volume 47, Issue 1

Multimodal interfaces that flex, adapt, and persist

January 2004

104 pages

ISSN:0001-0782

EISSN:1557-7317

DOI:10.1145/962081

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 January 2004

Published in CACM Volume 47, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

79
Total Citations
View Citations
1,864
Total Downloads

Downloads (Last 12 months)218
Downloads (Last 6 weeks)43

Reflects downloads up to 14 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Gong RHua M(2023)Designing Multimodal User Interfaces for Hybrid Collaboration: A User-Centered ApproachHCI International 2023 – Late Breaking Papers10.1007/978-3-031-48038-6_5(67-82)Online publication date: 23-Jul-2023
https://dl.acm.org/doi/10.1007/978-3-031-48038-6_5
Hou YFeng ZYang XXu TQiu XZhang X(2022)STMMIScientific Programming10.1155/2022/39527582022Online publication date: 1-Jan-2022
https://dl.acm.org/doi/10.1155/2022/3952758
Ohneiser OAdamala JSalomea I(2021)Integrating Eye- and Mouse-Tracking with Assistant Based Speech Recognition for Interaction at Controller Working PositionsAerospace10.3390/aerospace80902458:9(245)Online publication date: 3-Sep-2021
https://doi.org/10.3390/aerospace8090245
Wiehr FHirsch ASchmitz LKnieriemen NKrüger AKovtunova ABorgwardt SChang EDemberg VSteinmetz MHoffmann J(2021)Why Do I Have to Take Over Control? Evaluating Safe Handovers with Advance Notice and Explanations in HADProceedings of the 2021 International Conference on Multimodal Interaction10.1145/3462244.3479884(308-317)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3462244.3479884
Cantu AVinot JLetondal CPauchet SCausse M(2021)Does folding improve the usability of interactive surfaces in future airliner cockpits An evaluation under turbulent conditions and varying cognitive loadProceedings of the 32nd Conference on l'Interaction Homme-Machine10.1145/3450522.3451246(1-10)Online publication date: 13-Apr-2021
https://dl.acm.org/doi/10.1145/3450522.3451246
Lu ATong XDong B(2021)Multi-channel Interactive Intelligent Fusion Technology in Shipborne Command and Control SystemMan-Machine-Environment System Engineering: Proceedings of the 21st International Conference on MMESE10.1007/978-981-16-5963-8_82(600-605)Online publication date: 22-Sep-2021
https://doi.org/10.1007/978-981-16-5963-8_82
Ohneiser OBiella MSchmugler AWallace M(2020)Operational Feasibility Analysis of the Multimodal Controller Working Position “TriControl”Aerospace10.3390/aerospace70200157:2(15)Online publication date: 20-Feb-2020
https://doi.org/10.3390/aerospace7020015
Zeng BFeng ZXu TXiao MHan R(2020)Research on Intelligent Experimental Equipment and Key Algorithms Based on Multimodal Fusion PerceptionIEEE Access10.1109/ACCESS.2020.30139038(142507-142520)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3013903
Xiao MFeng ZFan XZeng BLi J(2020)A Structure Design of Virtual and Real Fusion Intelligent Equipment and Multimodal Navigational Interaction AlgorithmIEEE Access10.1109/ACCESS.2020.30059568(125982-125997)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.3005956
YANG MTAO J(2019)Data fusion methods in multimodal human computer dialogVirtual Reality & Intelligent Hardware10.3724/SP.J.2096-5796.2018.00101:1(21-38)Online publication date: Feb-2019
https://doi.org/10.3724/SP.J.2096-5796.2018.0010
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Magazine Site

View this article on the magazine site (external)

Magazine Site

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Abstract

References

Cited By

Index Terms

Recommendations

Tangible Interfaces: An Analysis of User Experience Using the AR Sandbox Project

Tangible User Interfaces

Tangible User Interfaces: Technology You Can Touch

Comments

Information

Published In

Publisher

Publication History

Permissions

Check for updates

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

PDF

eReader

Magazine Site

Login options

Full Access

Share

Share this Publication link

Share on social media

Affiliations