short-paper

MobiToss: a novel gesture based interface for creating and sharing mobile multimedia art on large public displays

Authors:

Jürgen Scheible,

Timo Ojala,

Paul CoultonAuthors Info & Claims

MM '08: Proceedings of the 16th ACM international conference on Multimedia

Pages 957 - 960

https://doi.org/10.1145/1459359.1459532

Published: 26 October 2008 Publication History

Get Access

Abstract

This paper presents MobiToss, a novel application for creating and sharing mobile multimedia art with an off-the-shelf mobile phone equipped with built-in accelerometer sensors allowing gesture control. The user first takes a photo or captures a video with the phone and then using a 'throwing' gesture transfers the clip onto a large public display for instant viewing and manipulation by tilting the phone in different directions. The system augments the user-created clip with other items such as music or brand labels and the encoded clip is automatically sent back to the phone as a personal artefact of the event. The clip is also uploaded to a dedicated community website for sharing the created multimedia art with others. MobiToss could be deployed e.g. in clubs, pubs and concerts as a participatory VJ-tool. In addition to the design the paper presents the results of a preliminary user evaluation, which highlight the novel art experience provided by MobiToss.

References

[1]

Bertelsen, O. W., Petersen, M. G. and Pold S. (Eds.), 2004, Aesthetic Approaches to Human-Computer Interaction Proceedings of the NordiCHI 2004 Workshop.

Google Scholar

[2]

Clay, A., Frey, T., Gutknecht, J. and Majoe, D. 2006, Motion Tracking Music with Mobile-Media Technology in Two Case Studies. In Proceedings of the International Symposium on Pervasive Computing and Applications 2006, 358--363.

Google Scholar

[3]

ffmpeg: http://ffmpeg.mplayerhq.hu/.

Google Scholar

[4]

Generation C. http://en.wikipedia.org/wiki/Generation_C.

Google Scholar

[5]

Jitter: http://www.cycling74.com/products/jitter.

Google Scholar

[6]

Kela, J., Korpipää, P., Mäntyjärvi, J., Kallio, S., Savino, G., Jozzo, L. and Marca, S.D. 2006 Accelerometer-based gesture control for a design environment. Personal and Ubiquitous Computing Journal, Springer, 285--299.

Digital Library

Google Scholar

[7]

Majoe, D., Schubiger, S., Clay, A. and Arisona, S. M. 2007, SQEAK: A Mobile Multi Platform Phone and Networks Gesture Sensor. In Proceedings of the Pervasive Computing and Applications conference ICPCA 2007, 699--704.

Google Scholar

[8]

Nintendo wii remote. http://wii.nintendo.com.

Google Scholar

[9]

Scheible J., Tuulos V. 2007. Mobile Python - Rapid prototyping of applications on the mobile platform, John Wiley & Sons.

Digital Library

Google Scholar

[10]

Vajk, T., Coulton, P., Bamford, W. and Edwards, R., 2008, Using a Mobile Phone as a "Wii-like" Controller for Playing Games on a Large Public Display, International Journal of Computer Games Technology, Volume 2008.

Digital Library

Google Scholar

Cited By

View all

Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Pang MYang XLiu JLi PYan FChen P(2020)Device-Free Activity Recognition: A SurveyWireless Sensor Networks10.1007/978-981-33-4214-9_17(223-243)Online publication date: 20-Nov-2020
https://doi.org/10.1007/978-981-33-4214-9_17
Xi WGong HWang Q(2019)How hand gestures influence the enjoyment in gamified mobile marketingInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2018.09.010127:C(169-180)Online publication date: 1-Jul-2019
https://dl.acm.org/doi/10.1016/j.ijhcs.2018.09.010
Show More Cited By

Index Terms

MobiToss: a novel gesture based interface for creating and sharing mobile multimedia art on large public displays
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Enabling fast and effortless customisation in accelerometer based gesture interaction
MUM '04: Proceedings of the 3rd international conference on Mobile and ubiquitous multimedia

Accelerometer based gesture control is proposed as a complementary interaction modality for handheld devices. Predetermined gesture commands or freely trainable by the user can be used for controlling functions also in other devices. To support ...
GRASSP: gesturally-realized audio, speech and song performance
NIME '06: Proceedings of the 2006 conference on New interfaces for musical expression

We describe the implementation of an environment for Gesturally-Realized Audio, Speech and Song Performance (GRASSP), which includes a glove-based interface, a mapping/training interface, and a collection of Max/MSP/Jitter bpatchers that allow the user ...
Gesture interaction for small handheld devices to support multimedia applications

Accelerometer-based gesture control is proposed as a complementary interaction modality for small handheld devices to enable a variety of multimedia applications. The motivation for experimenting with gesture interaction is justified by the personal and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

MM '08: Proceedings of the 16th ACM international conference on Multimedia

October 2008

1206 pages

ISBN:9781605583037

DOI:10.1145/1459359

General Chairs:
Abdulmotaleb EL Saddik
University of Ottawa
,
Son Vuong
University of British Colombia
,
Program Chairs:
Carsten Griwodz
University of Oslo
,
Alberto Del Bimbo
University degli Studi di Firenze
,
K. Selcuk Candan
Arizona State University
,
Alejandro Jaimes
Telefonica R&D, Madrid, Spain

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

MM08

Sponsor:

MM08: ACM Multimedia Conference 2008

October 26 - 31, 2008

British Columbia, Vancouver, Canada

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

36
Total Citations
View Citations
673
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 21 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Babic TReiterer HHaller M(2022)Understanding and Creating Spatial Interactions with Distant Displays Enabled by Unmodified Off-The-Shelf SmartphonesMultimodal Technologies and Interaction10.3390/mti61000946:10(94)Online publication date: 19-Oct-2022
https://doi.org/10.3390/mti6100094
Pang MYang XLiu JLi PYan FChen P(2020)Device-Free Activity Recognition: A SurveyWireless Sensor Networks10.1007/978-981-33-4214-9_17(223-243)Online publication date: 20-Nov-2020
https://doi.org/10.1007/978-981-33-4214-9_17
Xi WGong HWang Q(2019)How hand gestures influence the enjoyment in gamified mobile marketingInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2018.09.010127:C(169-180)Online publication date: 1-Jul-2019
https://dl.acm.org/doi/10.1016/j.ijhcs.2018.09.010
Paay JRaptis DKjeldskov JLauridsen BPenchev IRinghauge ERuder E(2017)A comparison of techniques for cross-device interaction from mobile devices to large displaysJournal of Mobile Multimedia10.5555/3177188.317719312:3-4(243-264)Online publication date: 1-Apr-2017
https://dl.acm.org/doi/10.5555/3177188.3177193
Kukka HYlipulli JGoncalves JOjala TKukka MSyrjälä MHenze NWoźniak PVäänänen KWilliamson JSchneegass S(2017)Creator-centric study of digital art exhibitions on interactive public displaysProceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia10.1145/3152832.3152835(37-48)Online publication date: 26-Nov-2017
https://dl.acm.org/doi/10.1145/3152832.3152835
Robinson SPearson JJones MJoshi AAhire SJones MTscheligi MRogers YMurray-Smith R(2017)Better togetherProceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/3098279.3098534(1-13)Online publication date: 4-Sep-2017
https://dl.acm.org/doi/10.1145/3098279.3098534
Paay JRaptis DKjeldskov JSkov MRuder ELauridsen BMark GFussell SLampe Cschraefel mHourcade JAppert CWigdor D(2017)Investigating Cross-Device Interaction between a Handheld Device and a Large DisplayProceedings of the 2017 CHI Conference on Human Factors in Computing Systems10.1145/3025453.3025724(6608-6619)Online publication date: 2-May-2017
https://dl.acm.org/doi/10.1145/3025453.3025724
Paay JRaptis DKjeldskov JLauridsen BPenchev IRinghauge ERuder E(2016)A Comparison of Techniques for Cross-Device Interaction from Mobile Devices to Large DisplaysProceedings of the 14th International Conference on Advances in Mobile Computing and Multi Media10.1145/3007120.3007140(137-146)Online publication date: 28-Nov-2016
https://dl.acm.org/doi/10.1145/3007120.3007140
Morrison AManresa-Yee CJensen WEshraghi NFoth MJu WSchroeter RViller S(2016)The Humming WallProceedings of the 2016 ACM Conference on Designing Interactive Systems10.1145/2901790.2901878(818-822)Online publication date: 4-Jun-2016
https://dl.acm.org/doi/10.1145/2901790.2901878
Punt M(2016)Human-computer interaction in an integrated environment combining digital TV, mobile devices and internet2016 24th Telecommunications Forum (TELFOR)10.1109/TELFOR.2016.7818913(1-8)Online publication date: Nov-2016
https://doi.org/10.1109/TELFOR.2016.7818913
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Enabling fast and effortless customisation in accelerometer based gesture interaction

GRASSP: gesturally-realized audio, speech and song performance

Gesture interaction for small handheld devices to support multimedia applications