research-article

Crowdsourcing on the spot: altruistic use of public displays, feasibility, performance, and behaviours

Authors:

Jorge Goncalves,

Denzil Ferreira,

Jakob Rogstadius,

Vassilis KostakosAuthors Info & Claims

UbiComp '13: Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing

Pages 753 - 762

https://doi.org/10.1145/2493432.2493481

Published: 08 September 2013 Publication History

Abstract

This study is the first attempt to investigate altruistic use of interactive public displays in natural usage settings as a crowdsourcing mechanism. We test a non-paid crowdsourcing service on public displays with eight different motivation settings and analyse users' behavioural patterns and crowdsourcing performance (e.g., accuracy, time spent, tasks completed). The results show that altruistic use, such as for crowdsourcing, is feasible on public displays, and through the controlled use of motivational design and validation check mechanisms, performance can be improved. The results shed insights on three research challenges in the field: i) how does crowdsourcing performance on public displays compare to that of online crowdsourcing, ii) how to improve the quality of feedback collected from public displays which tends to be noisy, and iii) identify users' behavioural patterns towards crowdsourcing on public displays in natural usage settings.

References

[1]

Alt, F., Shirazi, A., Schmidt, A., Kramer, U., Nawaz, Z. Location-based crowdsourcing: extending crowdsourcing to the real world. In Proc. NordiCHI '10, ACM (2010), 13--22.

Digital Library

[2]

Ananny, M., Strohecker, C. TexTales: Creating interactive forums with urban publics. In: Foth, M. (Ed.) Handbook of Research on Urban Informatics: The Practice and Promise of the Real-Time City, IGI Global (2009), 68--86.

[3]

Arslan, M., Singh, I., Singh, S., Madhyastha, H., Sundaresan, K., Krishnamurthy, S. Computing while charging: building a distributed computing infrastructure using smartphones. In Proc. CoNEXT '12, ACM (2012), 193--204.

Digital Library

[4]

Brignull, H., Rogers, Y. Enticing People to Interact with Large Public Displays in Public Spaces. In Proc. INTERACT '03 (2003), 17--24.

[5]

Brown, B., Reeves, S., Sherwood, S. Into the wild: challenges and opportunities for field trial methods. In Proc. CHI'11, ACM (2011), 1657--1666.

Digital Library

[6]

Burke, J., Estrin, D., Hansen, M., Parker, A., Ramanathan, N., Reddy, S., Srivanstava, N. Participatory sensing. In Proc. WSW'06, ACM SENSYS (2006).

[7]

Churchill, E., Nelson, L., Denoue, L., Hefman, J., Murphy, P. Sharing Multimedia Content with Public Displays: A Case Study. In Proc. DIS'04, ACM (2004), 7--16.

Digital Library

[8]

Eagle, N. txteagle: Mobile Crowdsourcing. In Proc. IDGD '09, Springer-Verlag (2009), 447--456.

Digital Library

[9]

Goncalves, J., Kostakos, V., Karapanos, E., Barreto, M., Camacho, T., Tomasic, A., Zimmerman, J. Citizen Motivation on the Go: The Role of Psychological Empowerment. Interacting with Computers, online first (2013).

[10]

Google. The bright side of sitting in traffic: Crowdsourcing road congestion data. http://googleblog.blogspot.com/2009/08/bright-side-of-sitting-in-traffic.html (2009).

[11]

Gupta, A., Thies, W., Cutrell, E., Balakrishnan, R. mClerk: enabling mobile crowdsourcing in developing regions. In Proc. CHI '12, ACM (2012), 1843--1852.

Digital Library

[12]

Horton, J., Chilton, L. The labor economics of paid crowdsourcing. In Proc. EC '10, ACM (2010), 209--218.

Digital Library

[13]

Hosio, S., Kostakos, V., Kukka, H., Jurmu, M., Riekki, J., Ojala, T. From School Food to Skate Parks in a few Clicks: Using Public Displays to Bootstrap Civic Engagement of the Young. In Proc. Pervasive 2012, Springer (2012), 425--442 (2012).

Digital Library

[14]

Hosio, S., Goncalves, J., Kostakos, V. Application Discoverability on Multipurpose Public Displays: Popularity Comes at a Price. In Proc. PerDis '13, ACM (2013), 31--36.

Digital Library

[15]

Ipeirotis, N. Demographics of Mechanical Turk (2010), http://archive.nyu.edu/bitstream/2451/29585/2/CeDER-10-0pdf

[16]

Kandel, E., Lazear, E. P. Peer pressure and partnerships. Journal of Political Economy (1992), 801--817.

[17]

Kaufmann, N., Schulze, T., Viet, D. More than fun and money. Worker Motivation in Crowdsourcing -- A Study on Mechanical Turk. In Proc. AMCIS'11 (2011).

[18]

Kittur, A., Chi, E., Suh, B. Crowdsourcing user studies with Mechanical Turk. In Proc. CHI '08. ACM (2008), 453--456.

Digital Library

[19]

Kostakos, V., Kukka, H., Goncalves, J., Tselios, N., Ojala, T. Multipurpose public displays: How shortcut menus affect usage. IEEE Computer Graphics and Applications 33, 2 (2013), 50--57.

Digital Library

[20]

Kukka, H., Kostakos, V., Ojala, T., Ylipulli, J., Suopajarvi, T., Jurmu, M., Hosio, S. This Is Not Classified: Everyday Information Seeking and Encountering in Smart Urban Spaces. Personal and Ubiquitous Computing 17, 1 (2013), 15--27.

Digital Library

[21]

Kukka, H., Oja, H., Kostakos, V., Goncalves, J., Ojala, T. What Makes You Click: Exploring Visual Signals to Entice Interaction on Public Displays. In Proc. CHI'13, ACM (2013), 1699--1708.

Digital Library

[22]

Mashhadi, A., Capra, L. Quality control for real-time ubiquitous crowdsourcing. In Proc. UbiCrowd'11, ACM (2011), 5--8.

Digital Library

[23]

Müller, J., Wilmsmann, D., Exeler, J., Buzeck, M., Schmidt, A., Jay, T., Krüger, A. Display Blindness: The Effect of Expectations on Attention towards Digital Signage. In Proc. Pervasive 2009, Springer (2009), 1--8.

Digital Library

[24]

Narula, P., Gutheim, P., Rolnitzky, D., Kulkarni, A., and Hartmann, B. MobileWorks: A Mobile Crowdsourcing Platform for Workers at the Bottom of the Pyramid. In Proc. HCOMP '11 (2011).

[25]

Paulos, E., Honicky, R. J., Hooker, B. Citizen Science: Enabling participatory urbanism. Handbook of Research on Urban Informatics, IGI Global (2009), 414--436.

[26]

Quinn, A., Bederson, B. Human computation: a survey and taxonomy of a growing field. In Proc. CHI '11, ACM (2011), 1403--1412.

Digital Library

[27]

Rogstadius, J., Kostakos, V., Kittur, A., Smus, B., Laredo, J. Vukovic, M. An Assessment of Intrinsic and Extrinsic Motivation on Task Performance in Crowdsourcing Markets. In Proc. ICWSM'11, AAAI (2011), 321--328.

[28]

Schwarz, O. Subjectual Visibility and the Negotiated Panopticon: on the Visibility-Economy of Online Digital Photography (2011).

[29]

Väätäjä, H., Vainio, T., Sirkkunen, E., Salo, K. Crowdsourced news reporting: supporting news content creation with mobile phones. In Proc. MobileHCI '11, ACM (2011), 435--444.

Digital Library

[30]

von Ahn, L., Maurer, B., McMillen, C. Abraham, D., Blum, M. reCAPTCHA: Human-Based Character Recognition via Web Security Measures. Science 321, 5895 (2008), 1465--1468.

[31]

Vukovic, M., Kumara, S., Greenshpan, O. Ubiquitous crowdsourcing. In Adj. Proc. Ubicomp '10, ACM (2010), 523--526.

Digital Library

Cited By

Oppenlaender JAbbas TGadiraju U(2024)The State of Pilot Study Reporting in Crowdsourcing: A Reflection on Best Practices and GuidelinesProceedings of the ACM on Human-Computer Interaction10.1145/36410238:CSCW1(1-45)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3641023
Ansah DSusha I(2024)Exploring Data Altruism as Data Donation: A Review of Concepts, Actors and ObjectivesElectronic Participation10.1007/978-3-031-70804-6_12(179-193)Online publication date: 3-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-70804-6_12
Haug SBenke IFischer DMaedche A(2023)CrowdSurfer: Seamlessly Integrating Crowd-Feedback Tasks into Everyday Internet SurfingProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580994(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580994
Show More Cited By

Index Terms

Crowdsourcing on the spot: altruistic use of public displays, feasibility, performance, and behaviours
1. Information systems

Recommendations

Older Adults’ Motivation and Engagement with Diverse Crowdsourcing Citizen Science Tasks
Human-Computer Interaction – INTERACT 2021
Abstract
In this exploratory study we evaluated the engagement, performance and preferences of older adults who interacted with different citizen science tasks. Out of 40 projects recently active on the Zooniverse platform we selected top ones to be ...
"Why would anybody do this?": Understanding Older Adults' Motivations and Challenges in Crowd Work
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Diversifying participation in crowd work can benefit the worker and requester. Increasing numbers of older adults are online, but little is known about their awareness of or how they engage in mainstream crowd work. Through an online survey with 505 ...
Crowdsourcing the Disaster Management Cycle

Crowdsourcing is a communication platform that can be used during and after a disastrous event. Previous research in crisis crowdsourcing demonstrates its wide adoption for aiding response efforts by non-government organizations and public citizens. ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

UbiComp '13: Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing

September 2013

846 pages

ISBN:9781450317702

DOI:10.1145/2493432

General Chairs:
Friedemann Mattern
ETH Zurich, CH
,
Silvia Santini
TU Darmstadt, DE
,
Program Chairs:
John F. Canny
UC Berkeley, US
,
Marc Langheinrich
Università della Svizzera italiana, CH
,
Jun Rekimoto
University of Tokyo, JP

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing
University of Florida: University of Florida
SIGCHI: ACM Special Interest Group on Computer-Human Interaction

In-Cooperation

SIGSPATIAL: ACM Special Interest Group on Spatial Information

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 September 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UbiComp '13

Sponsor:

SIGMOBILE
University of Florida
SIGCHI

UbiComp '13: The 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing

September 8 - 12, 2013

Zurich, Switzerland

Acceptance Rates

UbiComp '13 Paper Acceptance Rate 92 of 394 submissions, 23%;

Overall Acceptance Rate 764 of 2,912 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

77
Total Citations
View Citations
872
Total Downloads

Downloads (Last 12 months)24
Downloads (Last 6 weeks)2

Reflects downloads up to 18 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Oppenlaender JAbbas TGadiraju U(2024)The State of Pilot Study Reporting in Crowdsourcing: A Reflection on Best Practices and GuidelinesProceedings of the ACM on Human-Computer Interaction10.1145/36410238:CSCW1(1-45)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3641023
Ansah DSusha I(2024)Exploring Data Altruism as Data Donation: A Review of Concepts, Actors and ObjectivesElectronic Participation10.1007/978-3-031-70804-6_12(179-193)Online publication date: 3-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-70804-6_12
Haug SBenke IFischer DMaedche A(2023)CrowdSurfer: Seamlessly Integrating Crowd-Feedback Tasks into Everyday Internet SurfingProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580994(1-16)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580994
Wijenayake SHettiachchi DGoncalves J(2023)Combining Worker Factors for Heterogeneous Crowd Task AssignmentProceedings of the ACM Web Conference 202310.1145/3543507.3583190(3794-3805)Online publication date: 30-Apr-2023
https://dl.acm.org/doi/10.1145/3543507.3583190
Wang LCheng YYang DXu HWang XGuo BYu Z(2023)Mobile Crowdsourcing Task Offloading on Social Collaboration Networks: An Empirical StudyMobile Crowdsourcing10.1007/978-3-031-32397-3_17(433-457)Online publication date: 21-Apr-2023
https://doi.org/10.1007/978-3-031-32397-3_17
Dove GChen SFries DJohnson VMydlarz CBello JNov O(2022)From Environmental Monitoring to Mitigation Action: Considerations, Challenges, and Opportunities for HCIProceedings of the ACM on Human-Computer Interaction10.1145/35550936:CSCW2(1-31)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555093
Hettiachchi DKostakos VGoncalves J(2022)A Survey on Task Assignment in CrowdsourcingACM Computing Surveys10.1145/349452255:3(1-35)Online publication date: 3-Feb-2022
https://dl.acm.org/doi/10.1145/3494522
Sun CBurgar JFisher JBurton A(2022)A cautionary tale comparing spatial count and partial identity models for estimating densities of threatened and unmarked populationsGlobal Ecology and Conservation10.1016/j.gecco.2022.e0226838(e02268)Online publication date: Oct-2022
https://doi.org/10.1016/j.gecco.2022.e02268
van Berkel NGoncalves JRusso DHosio SSkov MKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Effect of Information Presentation on Fairness Perceptions of Machine Learning PredictorsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445365(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445365
Biele CBiele C(2021)Movement in the EnvironmentHuman Movements in Human-Computer Interaction (HCI)10.1007/978-3-030-90004-5_8(89-102)Online publication date: 2-Dec-2021
https://doi.org/10.1007/978-3-030-90004-5_8
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents