A novel interface system for accessing geospatial data (GeoMIP) has been developed that realizes a user-centered multimodal speech/gesture interface for addressing some of the critical needs in crisis management. In this system we primarily developed vision sensing algorithms, speech integration, multimodality fusion, and rule-based mapping of multimodal user input to GIS database queries. A demo system of this interface has been developed for the Port Authority NJ/NY and is explained here.

References

[1]

MacEachren, A.M., Cai, G., Sharma, R., Rauschert, I., Brewer, I., Bolelli, L., Shaparenko, B., Fuhrmann, S. and Wang, H. Enabling collaborative geoinformation access and decision-making through a natural, multimodal interface. International Journal of Geographical Information Science, in press.

Google Scholar

[2]

Rauschert, I., Agrawal, P., Fuhrmann, S., Brewer, I., Wang, H., Sharma, R., Cai, G. and MacEachren, A.M., Designing a Human-Centered, Multimodal GIS Interface to Support Emergency Management. in 10th ACM International Symposium on Advances in Geographic Information Systems, (McLean, VA, USA, 2002).

Digital Library

Google Scholar

[3]

Sharma, R., Poddar, I. and Kettebekov, S., Recognition of natural gestures for multimodal interactive map (iMAP). in Advanced Display Federated Laboratory Symposium, (Adelphi, MD, 2000), 77--81.

Google Scholar

Cited By

View all

Bayor ASchmidt CDauri FWilson NDrovandi CBrereton MBouhlel MJere N(2018)The talking bookProceedings of the Second African Conference for Human Computer Interaction: Thriving Communities10.1145/3283458.3283462(1-10)Online publication date: 3-Dec-2018
https://dl.acm.org/doi/10.1145/3283458.3283462
Kardaris NRodomagoulakis IPitsikalis VArvanitakis AMaragos PHanjalic ASnoek CWorring MBulterman DHuet BKelliher AKompatsiaris YLi J(2016)A Platform for Building New Human-Computer Interface Systems that Support Online Automatic Recognition of Audio-Gestural CommandsProceedings of the 24th ACM international conference on Multimedia10.1145/2964284.2973794(1169-1173)Online publication date: 1-Oct-2016
https://dl.acm.org/doi/10.1145/2964284.2973794
Prazeres ALopes E(2013)Disaster Recovery – A Project Planning Case Study in PortugalProcedia Technology10.1016/j.protcy.2013.12.0889(795-805)Online publication date: 2013
https://doi.org/10.1016/j.protcy.2013.12.088
Show More Cited By

Index Terms

Multimodal interface platform for geographical information systems (GeoMIP) in crisis management
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Sound-based input / output
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Sound-based input / output
      2. Touch screens
    2. Interaction paradigms
      1. Graphical user interfaces
      2. Natural language interfaces
  2. Interaction design
    1. Interaction design process and methods
      1. User centered design

Recommendations

Designing a human-centered, multimodal GIS interface to support emergency management
GIS '02: Proceedings of the 10th ACM international symposium on Advances in geographic information systems

Geospatial information is critical to effective, collaborative decision-making during emergency management situations; however conventional GIS are not suited for multi-user access and high-level abstract queries. Currently, decision makers do not ...
Exploring Intent-driven Multimodal Interface for Geographical Information System
ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

Geographic Information Systems (GIS) offers a large amount of functions for performing spatial analysis and geospatial information retrieval. However, off-the-shelf GIS remains difficult to use for occasional GIS experts. The major problem lies in that ...
From vocal to multimodal dialogue management
ICMI '06: Proceedings of the 8th international conference on Multimodal interfaces

Multimodal, speech-enabled systems pose different research problems when compared to unimodal, voice-only dialogue systems. One of the important issues is the question of how a multimodal interface should look like in order to make the multimodal ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces

October 2004

368 pages

ISBN:1581139950

DOI:10.1145/1027933

General Chairs:
Rajeev Sharma
Advanced Interfaces
,
Trevor Darrell
Massachusetts Institute of Technology
,
Program Chairs:
Mary Harper
Purdue University, West Lafayette, IN
,
Gianni Lazzari
ITC-IRST
,
Matthew Turk
University of California, Santa Barbara, CA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 October 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ICMI04

Sponsor:

ICMI04: Sixth International Conference on Multimodal Interfaces 2004

October 13 - 15, 2004

PA, State College, USA

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
594
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)0

Reflects downloads up to 28 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Bayor ASchmidt CDauri FWilson NDrovandi CBrereton MBouhlel MJere N(2018)The talking bookProceedings of the Second African Conference for Human Computer Interaction: Thriving Communities10.1145/3283458.3283462(1-10)Online publication date: 3-Dec-2018
https://dl.acm.org/doi/10.1145/3283458.3283462
Kardaris NRodomagoulakis IPitsikalis VArvanitakis AMaragos PHanjalic ASnoek CWorring MBulterman DHuet BKelliher AKompatsiaris YLi J(2016)A Platform for Building New Human-Computer Interface Systems that Support Online Automatic Recognition of Audio-Gestural CommandsProceedings of the 24th ACM international conference on Multimedia10.1145/2964284.2973794(1169-1173)Online publication date: 1-Oct-2016
https://dl.acm.org/doi/10.1145/2964284.2973794
Prazeres ALopes E(2013)Disaster Recovery – A Project Planning Case Study in PortugalProcedia Technology10.1016/j.protcy.2013.12.0889(795-805)Online publication date: 2013
https://doi.org/10.1016/j.protcy.2013.12.088
Visell YSmith SCooperstock J(2013)Interacting with Augmented Floor SurfacesHuman Walking in Virtual Environments10.1007/978-1-4419-8432-6_17(377-399)Online publication date: 16-May-2013
https://doi.org/10.1007/978-1-4419-8432-6_17
Ibarra MMonares AOchoa SPino JSuarez D(2012)A mobile collaborative application to reduce the radio traffic in urban emergenciesProceedings of the 2012 IEEE 16th International Conference on Computer Supported Cooperative Work in Design (CSCWD)10.1109/CSCWD.2012.6221843(358-365)Online publication date: May-2012
https://doi.org/10.1109/CSCWD.2012.6221843
Ibarra MMonares AOchoa SPino J(2012)Visualization of relevant information on mobile devices for emergency situations2012 XXXVIII Conferencia Latinoamericana En Informatica (CLEI)10.1109/CLEI.2012.6427186(1-10)Online publication date: Oct-2012
https://doi.org/10.1109/CLEI.2012.6427186
Lin HChen MLu G(2012)Virtual Geographic Environment: A Workspace for Computer-Aided Geographic ExperimentsAnnals of the Association of American Geographers10.1080/00045608.2012.689234103:3(465-482)Online publication date: 5-Jul-2012
https://doi.org/10.1080/00045608.2012.689234
Monares AHerskovic VSuarez DIbarra MOchoa SPino J(2011)Increasing shared information availability during urban emergency responsesProceedings of the 2011 15th International Conference on Computer Supported Cooperative Work in Design (CSCWD)10.1109/CSCWD.2011.5960191(677-684)Online publication date: Jul-2011
https://doi.org/10.1109/CSCWD.2011.5960191
Saleem KLuis SDeng YChen SHristidis VLi TCharbonneau MDiamond LShulman SChun SJanssen MGil-Garcia J(2008)Towards a business continuity information network for rapid disaster recoveryProceedings of the 2008 international conference on Digital government research10.5555/1367832.1367852(107-116)Online publication date: 18-May-2008
https://dl.acm.org/doi/10.5555/1367832.1367852
Cai GMacEachren ABrewer IMcNeese MSharma RFuhrmann S(2005)Map-Mediated geocollaborative crisis managementProceedings of the 2005 IEEE international conference on Intelligence and Security Informatics10.1007/11427995_39(429-435)Online publication date: 19-May-2005
https://dl.acm.org/doi/10.1007/11427995_39
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Designing a human-centered, multimodal GIS interface to support emergency management

Exploring Intent-driven Multimodal Interface for Geographical Information System

From vocal to multimodal dialogue management

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations