poster

The interactive join: recognizing gestures for database queries

Authors:

Arnab Nandi,

Michael MandelAuthors Info & Claims

CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

Pages 1203 - 1208

https://doi.org/10.1145/2468356.2468571

Published: 27 April 2013 Publication History

Get Access

Abstract

Direct, ad-hoc interaction with databases has typically been performed over console-oriented conversational interfaces using query languages such as SQL. With the rise in popularity of gestural user interfaces and computing devices that use gestures as their exclusive mode of interaction, database query interfaces require a fundamental rethinking to work without keyboards. Unlike domain-specific applications, the scope of possible actions is significantly larger if not infinite. Thus, the recognition of gestures and their consequent queries is a challenge. We present a novel gesture recognition system that uses both the interaction and the state of the database to classify gestural input into relational database queries. Preliminary results show that using this approach allows for fast, efficient and interactive gesture-based querying over relational databases.

Supplementary Material

ZIP File (wip0256-file3.zip)

ijoinchi.mp4 : Video of Gestural Interaction with Database. Multitouch gestures are recognized by our classifier into queries as per methods in the WIP paper submission. The Interactive Join presentation starts at 0m:50s of the video. The video and related documents are alternatively available at http://gesturedb.org

Download
13.45 MB

References

[1]

Abouzied, A., et al. Dataplay: interactive tweaking and example-driven correction of graphical database queries. UIST (2012).

Digital Library

Google Scholar

[2]

Bakke, E., Karger, D., and Miller, R. A spreadsheet-based user interface for managing plural relationships in structured data. CHI (2011).

Digital Library

Google Scholar

[3]

Chatzopoulou, G., et al. Query recommendations for interactive database exploration. SSDBM (2009).

Digital Library

Google Scholar

[4]

Damaraju, S., and Kerne, A. Multitouch gesture learning and recognition system. Tabletops and Interactive Surfaces (2008).

Google Scholar

[5]

Flöring, S., and Hesselmann, T. Tap: Towards visual analytics on interactive surfaces. CoVIS (2010).

Google Scholar

[6]

Jagadish, H., et al. Making database systems usable. SIGMOD (2007).

Digital Library

Google Scholar

[7]

Jayapandian, M., et al. Automating the design and construction of query forms. TKDE (2009).

Digital Library

Google Scholar

[8]

Khoussainova, N., et al. Snipsuggest: context-aware autocompletion for sql. VLDB (2010).

Digital Library

Google Scholar

[9]

Nandi, A., and Jagadish, H. Assisted querying using instant-response interfaces. SIGMOD (2007).

Digital Library

Google Scholar

[10]

Patney, S., et al. Sql server kinection. PASS (2011).

Google Scholar

[11]

Schwarz, J., Manko, J., and Hudson, S. Monte carlo methods for managing interactive state, action and feedback under uncertainty. UIST (2011).

Digital Library

Google Scholar

[12]

Stolte, C. Visual interfaces to data. SIGMOD (2010).

Digital Library

Google Scholar

[13]

Ullmer, B., and Ishii, H. Emerging frameworks for tangible user interfaces. IBM sys. j. 39, 3.4 (2000).

Digital Library

Google Scholar

[14]

Weir, D., Rogers, S., Murray-Smith, R., and Lochtefeld, M. A user-specific machine learning approach for improving touch accuracy on mobile devices. UIST (2012).

Digital Library

Google Scholar

Cited By

View all

In SLin TNorth CPfister HYang Y(2024)This is the Table I Want! Interactive Data Transformation on Desktop and in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.329960230:8(5635-5650)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3299602
Mack KLee JChang KKarahalios KParameswaran AMandryk RHancock MPerry MCox A(2018)Characterizing Scalability Issues in Spreadsheet Software using Online ForumsExtended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3170427.3174359(1-9)Online publication date: 20-Apr-2018
https://dl.acm.org/doi/10.1145/3170427.3174359
Jiang LMandel MNandi A(2013)GestureQueryProceedings of the VLDB Endowment10.14778/2536274.25363116:12(1342-1345)Online publication date: 1-Aug-2013
https://dl.acm.org/doi/10.14778/2536274.2536311

Index Terms

The interactive join: recognizing gestures for database queries
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Multi-way spatial join selectivity for the ring join graph

Efficient spatial query processing is very important since the applications of the spatial DBMS (e.g. GIS, CAD/CAM, LBS) handle massive amount of data and consume much time. Many spatial queries contain the multi-way spatial join due to the fact that ...
Understanding query interfaces by statistical parsing

Users submit queries to an online database via its query interface. Query interface parsing, which is important for many applications, understands the query capabilities of a query interface. Since most query interfaces are organized hierarchically, we ...
Query interfaces understanding by statistical parsing
WWW '14 Companion: Proceedings of the 23rd International Conference on World Wide Web

Users submit queries to an online database via its query interface. Query interface parsing, which is important for many applications, understands the query capabilities of a query interface. Since most query interfaces are organized hierarchically, we ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

April 2013

3360 pages

ISBN:9781450319522

DOI:10.1145/2468356

General Chair:
Wendy E. Mackay
INRIA
,
Program Chairs:
Stephen Brewster
Glasgow University
,
Susanne Bødker
University of Aarhus

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 April 2013

Check for updates

Author Tags

Qualifiers

Poster

Conference

CHI '13

Sponsor:

SIGCHI

CHI '13: CHI Conference on Human Factors in Computing Systems

April 27 - May 2, 2013

Paris, France

Acceptance Rates

CHI EA '13 Paper Acceptance Rate 630 of 1,963 submissions, 32%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
149
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

In SLin TNorth CPfister HYang Y(2024)This is the Table I Want! Interactive Data Transformation on Desktop and in Virtual RealityIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.329960230:8(5635-5650)Online publication date: Aug-2024
https://doi.org/10.1109/TVCG.2023.3299602
Mack KLee JChang KKarahalios KParameswaran AMandryk RHancock MPerry MCox A(2018)Characterizing Scalability Issues in Spreadsheet Software using Online ForumsExtended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3170427.3174359(1-9)Online publication date: 20-Apr-2018
https://dl.acm.org/doi/10.1145/3170427.3174359
Jiang LMandel MNandi A(2013)GestureQueryProceedings of the VLDB Endowment10.14778/2536274.25363116:12(1342-1345)Online publication date: 1-Aug-2013
https://dl.acm.org/doi/10.14778/2536274.2536311

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Multi-way spatial join selectivity for the ring join graph

Understanding query interfaces by statistical parsing

Query interfaces understanding by statistical parsing