research-article

PicoTales: collaborative authoring of animated stories using handheld projectors

Authors:

Simon Robinson,

Elina Vartiainen,

Gary MarsdenAuthors Info & Claims

CSCW '12: Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work

Pages 671 - 680

https://doi.org/10.1145/2145204.2145306

Published: 11 February 2012 Publication History

Abstract

In this article we describe a novel approach to collaborative video authoring using handheld projectors. PicoTales are created by sketching story elements on a projector+phone prototype, and then animated by moving the projected image. Movements are captured using motion sensor data, rather than visual or other tracking methods, allowing interaction and story creation anywhere. We describe in detail the design and development of our prototype device, and also address issues in position estimation and element tracking. An experiment was conducted to evaluate the prototype, demonstrating its accuracy and usability for ad-hoc creation of story videos. The potential of the system for story authoring is shown via a further experiment looking at the quality of the animated story videos produced. We conclude by considering possible future developments of the concept, and highlighting the benefits of our design for collaborative story capture.

Supplementary Material

MP4 File (file490.mp4)

Download
1.27 MB

References

[1]

Ah Kun, L. and Marsden, G. Co-present photo sharing on mobile devices. In Proc. MobileHCI '07, ACM (2007), 277--284.

Digital Library

[2]

Balabanović, M., Chu, L. and Wolff, G. Storytelling with digital photographs. In Proc. CHI '00, ACM (2000), 564--571.

Digital Library

[3]

Beardsley, P., Baar, J. van, Raskar, R. and Forlines, C. Interaction using a handheld projector. IEEE Computer Graphics and Applications 25.1 (2005), 39--43.

Digital Library

[4]

Bers, M. and Best, M. Rural connected communities: a project in online collaborative journalism. In Proc. CSCL '99, ISLS (1999), 41--46.

Digital Library

[5]

Bidwell, N., Reitmaier, T., Marsden, G. and Hansen, S. Designing with mobile digital storytelling in rural Africa. In Proc. CHI '10, ACM (2010), 1593--1602.

Digital Library

[6]

Cao, X. Handheld Projector Interaction. PhD thesis. University of Toronto, 2009.

Digital Library

[7]

Cao, X., Forlines, C. and Balakrishnan, R. Multi-user interaction using handheld projectors. In Proc. UIST '07, ACM (2007), 43--52.

Digital Library

[8]

Cao, X., Massimi, M. and Balakrishnan, R. Flashlight jigsaw: an exploratory study of an ad-hoc multi-player game on public displays. In Proc. CSCW '08, ACM (2008), 77--86.

Digital Library

[9]

Cao, X., Lindley, S., Helmes, J. and Sellen, A. Telling the whole story: anticipation, inspiration and reputation in a field deployment of TellTable. In Proc. CSCW '10, ACM (2010), 251--260.

Digital Library

[10]

Chatting, D. and Sutton, J. Visible imagination: projected play. In Proc. HCI '09, BCS (2009), 405--409.

Digital Library

[11]

Cowan, L. and Li, K. ShadowPuppets: supporting collocated interaction with mobile projector phones using hand shadows. In Proc. CHI '11, ACM (2011), 2707--2716.

Digital Library

[12]

Dao, V., Hosoi, K. and Sugimoto, M. A semi-automatic realtime calibration technique for a handheld projector. In Proc. VRST '07, ACM (2007), 43--46.

Digital Library

[13]

Druin, A., Stewart, J., Proft, D., Bederson, B. and Hollan, J. KidPad: a design collaboration between children, technologists, and educators. In Proc. CHI '97, ACM (1997), 463--470.

Digital Library

[14]

Fails, J., Druin, A. and Guha, M. Mobile collaboration: collaboratively reading and creating children's stories on mobile devices. In Proc. IDC '10, ACM (2010), 20--29.

Digital Library

[15]

Frohlich, D., Rachovides, D., Riga, K., Bhat, R., Frank, M., Edirisinghe, E., Wickramanayaka, D., Jones, M. and Harwood, W. StoryBank: mobile digital storytelling in a development context. In Proc. CHI '09, ACM (2009), 1761--1770.

Digital Library

[16]

Ghali, A., Benford, S., Bayoumi, S., Green, J. and Pridmore, T. Visually tracked flashlights as interaction devices. In Proc. Interact '03, IOS (2003), 487--494.

[17]

Lee, G. and Keh, Y. A novel interface and application using synchronized multi projector phones. In MP2 Workshop at CHI '11, 2011.

[18]

Löchtefeld, M., Schöning, J., Rohs, M. and Krüger, A. LittleProjectedPlanet: an augmented reality game for camera projector phones. In MIRW Workshop at MobileHCI '09, 2009.

[19]

Olsen Jr., D. and Nielsen, T. Laser pointer interaction. In Proc. CHI '01, ACM (2001), 17--22.

Digital Library

[20]

Rapp, S., Michelitsch, G., Osen, M., Williams, J., Barbisch, M., Bohan, R., Valsan, Z. and Emele, M. Spotlight navigation: interaction with a handheld projection device. In Pervasive '04 Videos, 2004.

[21]

Reeves, S., Pridmore, T., Crabtree, A., Green, J., Benford, S. and O'Malley, C. The spatial character of sensor technology. In Proc. DIS '06, ACM (2006), 31--40.

Digital Library

[22]

Reitmaier, T., Bidwell, N. and Marsden, G. Field testing mobile digital storytelling software in rural Kenya. In Proc. MobileHCI '10, ACM (2010), 283--286.

Digital Library

[23]

Robinson, S. and Jones, M. HaptiProjection: multimodal mobile information discovery. In Ubiprojection Workshop at Pervasive '10, 2010.

[24]

Sharmin, M., Bailey, B., Coats, C. and Hamilton, K. Understanding knowledge management practices for early design activity and its implications for reuse. In Proc. CHI '09, ACM (2009), 2367--2376.

Digital Library

[25]

Shilkrot, R., Hunter, S. and Maes, P. PoCoMo: projected collaboration using mobile devices. In Proc. MobileHCI '11, ACM (2011), 333--336.

Digital Library

[26]

Stanton, D., Neale, H. and Bayon, V. Interfaces to support children's co-present collaboration: multiple mice and tangible technologies. In Proc. CSCL '02, ISLS (2002), 342--351.

Digital Library

[27]

Strachan, S. and Murray-Smith, R. Bearing-based selection in mobile spatial interaction. Personal and Ubiquitous Computing 13.4 (2009), 265--280.

Digital Library

[28]

Sugimoto, M., Ito, T., Nguyen, T. and Inagaki, S. GENTORO: a system for supporting children's storytelling using handheld projectors and a robot. In Proc. IDC '09, ACM (2009), 214--217.

Digital Library

[29]

Virolainen, A., Åkerman, P. and Häkkilä, J. Burn-to-share: content sharing with mobile projectors. In Proc. MUM '10, ACM (2010), 18:1--18:4.

Digital Library

[30]

Weibel, N., Cowan, L., Pina, L., Griswold, W. and Hollan, J. Enabling social interactions through real-time sketch-based communication. In Proc. UIST '10 Demos, ACM (2010), 405--406.

Digital Library

[31]

Williamson, J., Murray-Smith, R. and Hughes, S. Shoogle: excitatory multimodal interaction on mobile devices. In Proc. CHI '07, ACM (2007), 121--124.

Digital Library

[32]

Willis, K. A pre-history of handheld projector-based interaction. Personal and Ubiquitous Computing (Online First; 21st April 2011), 1--11.

Digital Library

[33]

Willis, K., Poupyrev, I. and Shiratori, T. MotionBeam: a metaphor for character interaction with handheld projectors. In Proc. CHI '11, ACM (2011), 1031--1040.

Digital Library

[34]

Willis, K., Poupyrev, I., Hudson, S. and Mahler, M. SideBySide: ad-hoc multi-user interaction with handheld projectors. In Proc. UIST '11, ACM (2011), 431--440.

Digital Library

[35]

Worthington, P. Shadow Monsters. Interaction Design, Royal College of Art. 2005.

Cited By

Genç HCoşkun A(2024)From Silence to Dialogue: Boosting Collocated Social Interactions with TechnologyProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685391(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685391
Papanikolaou D(2023)Connective Environments: Towards Interdisciplinary Pedagogical Models for Design of Networked, Interactive, Participatory SystemsInteraction Design and Architecture(s)10.55612/s-5002-058-006(132-156)Online publication date: 1-Oct-2023
https://doi.org/10.55612/s-5002-058-006
Genç HErdem DYıldırım ÇCoskun A(2022)Mind the Whisper: Enriching Collocated Social Interactions in Public Places through Audio NarrativesProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533507(1428-1440)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533507
Show More Cited By

Index Terms

PicoTales: collaborative authoring of animated stories using handheld projectors
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Story Version Control and Graphical Visualization for Collaborative Story Authoring
CVMP '17: Proceedings of the 14th European Conference on Visual Media Production (CVMP 2017)

This paper presents a story version control and graphical visualization framework to enhance collaborative story authoring. We propose a media-agnostic story representation based on story beats, events, and participants that describes the flow of events ...
JUNGLE: An Interactive Visual Platform for Collaborative Creation and Consumption of Nonlinear Transmedia Stories
Interactive Storytelling
Abstract
JUNGLE is an interactive, visual platform for the collaborative manipulation and consumption of nonlinear transmedia stories. Intuitive visual interfaces encourage JUNGLE users to explore vast libraries of story worlds, expand existing stories, or ...
A hybrid of plot-based and character-based interactive storytelling
Edutainment'07: Proceedings of the 2nd international conference on Technologies for e-learning and digital entertainment

Interactive storytelling in the virtual environment attracts a lot of research interests in recent years. Story plot and character are two most important elements of a story. Based on these two elements, currently there are two research directions: plot-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CSCW '12: Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work

February 2012

1460 pages

ISBN:9781450310864

DOI:10.1145/2145204

General Chairs:
Steven Poltrock
Boeing Research & Technology
,
Carla Simone
University of Milano-Biccoca
,
Program Chairs:
Jonathan Grudin
Microsoft Research
,
Gloria Mark
University of California, Irvine
,
John Riedl
University of Minnesota

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 February 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CSCW '12

Sponsor:

SIGCHI

CSCW '12: Computer Supported Cooperative Work

February 11 - 15, 2012

Washington, Seattle, USA

Acceptance Rates

CSCW '12 Paper Acceptance Rate 164 of 415 submissions, 40%;

Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

21
Total Citations
View Citations
730
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)1

Reflects downloads up to 01 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Genç HCoşkun A(2024)From Silence to Dialogue: Boosting Collocated Social Interactions with TechnologyProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685391(1-13)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3679318.3685391
Papanikolaou D(2023)Connective Environments: Towards Interdisciplinary Pedagogical Models for Design of Networked, Interactive, Participatory SystemsInteraction Design and Architecture(s)10.55612/s-5002-058-006(132-156)Online publication date: 1-Oct-2023
https://doi.org/10.55612/s-5002-058-006
Genç HErdem DYıldırım ÇCoskun A(2022)Mind the Whisper: Enriching Collocated Social Interactions in Public Places through Audio NarrativesProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533507(1428-1440)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533507
Seunarine KKalarikalayil Raju DThomas GThomas SPockett AReitmaier TSteer COwen TMeena YRobinson SPearson JCarnie MSahoo DJones M(2022)Light-In-Light-Out (Li-Lo) Displays: Harvesting and Manipulating Light to Provide Novel Forms of CommunicationProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517730(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517730
Olsson TJarusriboonchai PWoźniak PPaasovaara SVäänänen KLucero A(2020)Technologies for Enhancing Collocated Social Interaction: Review of Design Solutions and ApproachesComputer Supported Cooperative Work10.1007/s10606-019-09345-029:1-2(29-83)Online publication date: 1-Apr-2020
https://dl.acm.org/doi/10.1007/s10606-019-09345-0
Kim AKang SLee UMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)LetsPicProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025693(4561-4573)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025693
Jones MRobinson SPearson JJoshi MRaju DMbogo CWangari SJoshi ACutrell EHarper R(2017)Beyond "yesterday's tomorrow"Personal and Ubiquitous Computing10.1007/s00779-016-0982-021:1(157-171)Online publication date: 1-Feb-2017
https://dl.acm.org/doi/10.1007/s00779-016-0982-0
Robinson SPearson JJones M(2016)PosterPointingProceedings of the First African Conference on Human Computer Interaction10.1145/2998581.2998594(170-175)Online publication date: 21-Nov-2016
https://dl.acm.org/doi/10.1145/2998581.2998594
Pearson JRobinson SJones M(2016)Exploring Low-Cost, Internet-Free Information Access for Resource-Constrained CommunitiesACM Transactions on Computer-Human Interaction10.1145/299049823:6(1-34)Online publication date: 3-Dec-2016
https://dl.acm.org/doi/10.1145/2990498
Roberto RLima JTeichrieb V(2016)Tracking for mobile devicesComputers and Graphics10.1016/j.cag.2016.02.00256:C(20-30)Online publication date: 1-May-2016
https://dl.acm.org/doi/10.1016/j.cag.2016.02.002
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents