abstract

Tableur: Handwritten Spreadsheets

Authors:

Emanuel Zgraggen,

Robert Zeleznik,

Philipp EichmannAuthors Info & Claims

CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Pages 2362 - 2368

https://doi.org/10.1145/2851581.2892326

Published: 07 May 2016 Publication History

Get Access

Abstract

The need for back-of-the-envelope calculations, such as rough projections or simple budget estimations, occurs frequently and oftentimes while being away from desktop computers. While major software vendors have optimized their spreadsheet applications for mobile environments their generality still makes them heavyweight for such tasks. We have built Tableur a spreadsheet-like pen- & touch-based system targeted towards these use cases. Our design revolves around handwriting recognition - all data is represented as digital ink - and gestural commands. Through a rethought cell referencing system and by incorporating standard math notation recognition Tableur allows for simple formula creation and we experiment with techniques that support pattern-based prefilling of cells (Smart Fill) and exploration of what-if scenarios (Reverse Editing).

References

[1]

Andrew Bragdon, Robert Zeleznik, Brian Williamson, Timothy Miller, and Joseph J LaViola Jr. 2009. GestureBar: improving the approachability of gesturebased interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2269-2278.

Digital Library

Google Scholar

[2]

Jeffrey Browne, Bongshin Lee, Sheelagh Carpendale, Nathalie Riche, and Timothy Sherwood. 2011. Data analysis on interactive whiteboards through sketchbased interaction. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces. ACM, 154-157.

Digital Library

Google Scholar

[3]

Steven M Drucker, Danyel Fisher, Ramik Sadana, Jessica Herron, and others. 2013. TouchViz: a case study comparing two interfaces for data analytics on tablets. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2301-2310.

Digital Library

Google Scholar

[4]

Niklas Elmqvist, Andrew Vande Moere, Hans-Christian Jetter, Daniel Cernea, Harald Reiterer, and TJ Jankun-Kelly. 2011. Fluid interaction for information visualization. Information Visualization (2011), 1473871611413180.

Digital Library

Google Scholar

[5]

Joseph J LaViola Jr and Robert C Zeleznik. 2007. MathPad 2: a system for the creation and exploration of mathematical sketches. In ACM SIGGRAPH 2007 courses. ACM, 46.

Digital Library

Google Scholar

[6]

Bongshin Lee, Petra Isenberg, Nathalie Henry Riche, and Sheelagh Carpendale. 2012. Beyond mouse and keyboard: Expanding design considerations for information visualization interactions. Visualization and Computer Graphics, IEEE Transactions on 18, 12 (2012), 2689-2698.

Digital Library

Google Scholar

[7]

Bongshin Lee, Rubaiat Habib Kazi, and Greg Smith. 2013. SketchStory: Telling more engaging stories with data through freeform sketching. Visualization and Computer Graphics, IEEE Transactions on 19, 12 (2013), 2416-2425.

Digital Library

Google Scholar

[8]

Bongshin Lee, Greg Smith, Nathalie Henry Riche, Amy Karlson, and Sheelagh Carpendale. 2015. SketchInsight: Natural data exploration on interactive whiteboards leveraging pen and touch interaction. In Visualization Symposium (PacificVis), 2015 IEEE Pacific. IEEE, 199-206.

Crossref

Google Scholar

[9]

Arnab Nandi, Lilong Jiang, and Michael Mandel. 2013. Gestural query specification. Proceedings of the VLDB Endowment 7, 4 (2013), 289-300.

Digital Library

Google Scholar

[10]

Robert Zeleznik, Andrew Bragdon, Ferdi Adeputra, and Hsu-Sheng Ko. 2010. Hands-on math: a pagebased multi-touch and pen desktop for technical work and problem solving. In Proceedings of the 23nd annual ACM symposium on User interface software and technology. ACM, 17-26.

Digital Library

Google Scholar

[11]

Robert Zeleznik, Timothy Miller, Chuanjun Li, and Joseph J Laviola Jr. 2008b. Mathpaper: Mathematical sketching with fluid support for interactive computation. In Smart Graphics. Springer, 20-32.

Digital Library

Google Scholar

[12]

Robert C Zeleznik, Andrew Bragdon, Chu-Chi Liu, and Andrew Forsberg. 2008a. Lineogrammer: creating diagrams by drawing. In Proceedings of the 21st annual ACM symposium on User interface software and technology. ACM, 161-170.

Digital Library

Google Scholar

[13]

Emanuel Zgraggen, Robert Zeleznik, and Steven M Drucker. 2014. PanoramicData: Data Analysis through Pen & Touch. Visualization and Computer Graphics, IEEE Transactions on 20, 12 (2014), 2112-2121.

Google Scholar

Cited By

View all

Cavez VAppert CPietriga E(2023)Spreadsheets on Interactive Surfaces: Breaking through the Grid with the PenACM Transactions on Computer-Human Interaction10.1145/363009731:2(1-33)Online publication date: 25-Oct-2023
https://dl.acm.org/doi/10.1145/3630097
Romat HMarquardt NHinckley KHenry Riche N(2022)Style Blink: Exploring Digital Inking of Structured Information via Handcrafted Styling as a First-Class ObjectProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501988(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501988
Takayama YIchikawa YShizuki BKawaguchi ITakahashi S(2021)A User-based Mid-air Hand Gesture Set for SpreadsheetsProceedings of the Asian CHI Symposium 202110.1145/3429360.3468193(122-128)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3429360.3468193
Show More Cited By

Index Terms

Tableur: Handwritten Spreadsheets
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Indic script family and its offline handwriting recognition for characters/digits and words: a comprehensive survey
Abstract
Handwriting recognition has become an active area of research in pattern recognition and machine learning in recent years. Handwriting recognition systems have a variety of applications ranging from digital character conversion to signboard ...
Aolah Databases for New Arabic Online Handwriting Recognition Algorithm
Document Analysis and Recognition – ICDAR 2021 Workshops
Abstract
Developing an online handwriting recognition system for Arabic script used in pen-based devices plays an important role in making these devices available and usable for Arabic society. This paper is carried out for Arabic script to overcome the ...
Numeral characters and capital letters segmentation recognition in mixed handwriting context
ICDAR '95: Proceedings of the Third International Conference on Document Analysis and Recognition (Volume 2) - Volume 2

For the analytic on-line recognition of handwriting, the range of pattern recognition problems can be described by the severity of letter segmentation required. More difficult problems require an interaction of letter segmentation and recognition. These ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

May 2016

3954 pages

ISBN:9781450340823

DOI:10.1145/2851581

General Chairs:
Jofish Kaye
Yahoo
,
Allison Druin
University of Maryland / National Park Service
,
Program Chairs:
Cliff Lampe
University of Michigan
,
Dan Morris
Microsoft
,
Juan Pablo Hourcade
University of Iowa

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2016

Check for updates

Author Tags

Qualifiers

Abstract

Conference

CHI'16

Sponsor:

SIGCHI

CHI'16: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2016

California, San Jose, USA

Acceptance Rates

CHI EA '16 Paper Acceptance Rate 1,000 of 5,000 submissions, 20%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
192
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)2

Reflects downloads up to 24 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Cavez VAppert CPietriga E(2023)Spreadsheets on Interactive Surfaces: Breaking through the Grid with the PenACM Transactions on Computer-Human Interaction10.1145/363009731:2(1-33)Online publication date: 25-Oct-2023
https://dl.acm.org/doi/10.1145/3630097
Romat HMarquardt NHinckley KHenry Riche N(2022)Style Blink: Exploring Digital Inking of Structured Information via Handcrafted Styling as a First-Class ObjectProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501988(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501988
Takayama YIchikawa YShizuki BKawaguchi ITakahashi S(2021)A User-based Mid-air Hand Gesture Set for SpreadsheetsProceedings of the Asian CHI Symposium 202110.1145/3429360.3468193(122-128)Online publication date: 8-May-2021
https://dl.acm.org/doi/10.1145/3429360.3468193
Hoffswell JLiu ZBrewster SFitzpatrick GCox AKostakos V(2019)Interactive Repair of Tables Extracted from PDF Documents on Mobile DevicesProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300523(1-13)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300523
Talkad Sukumar PLiu AMetoyer RKoike HRatti CTakeuchi YFukuchi KScott SPlasencia D(2018)Replicating User-defined Gestures for Text EditingProceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces10.1145/3279778.3279793(97-106)Online publication date: 19-Nov-2018
https://dl.acm.org/doi/10.1145/3279778.3279793
Pfeuffer KHinckley KPahud MBuxton BMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)Thumb + Pen Interaction on TabletsProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025567(3254-3266)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025567
Choi JYoon BJung CWoo W(2017)ARClassNote: Augmented Reality Based Remote Education Solution with Tag Recognition and Shared Hand-Written Note2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct)10.1109/ISMAR-Adjunct.2017.94(303-309)Online publication date: Oct-2017
https://doi.org/10.1109/ISMAR-Adjunct.2017.94
Mendez G(2016)Tools for opportunistic information visualization: Visual analysis with non-traditional data sources2016 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC)10.1109/VLHCC.2016.7739701(250-251)Online publication date: Sep-2016
https://doi.org/10.1109/VLHCC.2016.7739701

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Indic script family and its offline handwriting recognition for characters/digits and words: a comprehensive survey

Aolah Databases for New Arabic Online Handwriting Recognition Algorithm

Numeral characters and capital letters segmentation recognition in mixed handwriting context