research-article

A crowdsourcing based mobile image translation and knowledge sharing service

Authors:

Vili Lehdonvirta,

Todorka Alexandrova,

Hiroaki Kimura,

Tatsuo NakajimaAuthors Info & Claims

MUM '10: Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia

Article No.: 6, Pages 1 - 9

https://doi.org/10.1145/1899475.1899481

Published: 01 December 2010 Publication History

Abstract

Travelers in countries that use an unfamiliar script cannot use pocket translators or online translation services to understand menus, maps, signs and other important information, because they are unable to write the text they see. Solutions based on optical character recognition provide very limited performance in real-world situations and for complex scripts such as Chinese and Japanese. In this paper, we propose an alternative image translation solution based on crowdsourcing. A large number of human workers on mobile terminals are used to carry out the tasks of image recognition, translation and quality assurance. Compared to purely technical solutions, this human computation approach is also able to account for context and non-textual cues, and provide higher level information to the end-user. In this paper, we describe a preliminary user study to create a model of end-user requirements.

References

[1]

Costolo: Twitter now has 190 million users tweeting 65 million times a day, http://techcrunch.com/2010/06/08/twitter-190-million-users/.

[2]

Gartner says mobile phone sales will exceed one billion in 2009, http://www.gartner.com/press_releases/asset_132473_11.html.

[3]

Adamic, L. A., Zhang, J., Bakshy, E., and Ackerman, M. S. Knowledge sharing and yahoo answers: everyone knows something. In WWW '08: Proceeding of the 17th international conference on World Wide Web (New York, NY, USA, 2008), ACM, pp. 665--674.

Digital Library

[4]

Arase, Y., Xie, X., Duan, M., Hara, T., and Nishio, S. A game based approach to assign geographical relevance to web images. In Proceedings of the 18th international conference on World wide web - WWW '09 (New York, New York, USA, 2009), ACM Press, p. 811.

Digital Library

[5]

Barrington, L., O'Malley, D., Turnbull, D., and Lanckriet, G. User-centered design of a social game to tag music. In HCOMP '09: Proceedings of the ACM SIGKDD Workshop on Human Computation (New York, NY, USA, 2009), ACM, pp. 7--10.

Digital Library

[6]

Benabou, R., and Tirole, J. Intrinsic and extrinsic motivation. Review of Economic Studies 70, 3 (2003), 489--520.

[7]

Brown, T. Change by Design: How Design Thinking Transforms Organizations and Inspires Innovation. HarperBusiness, 2009.

[8]

Callison-Burch, C. Fast, cheap, and creative: evaluating translation quality using amazon's mechanical turk. In EMNLP '09: Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing (2009), pp. 286--295.

Digital Library

[9]

Eagle, N. txteagle: Mobile crowdsourcing. In Internationalization, Design and Global Development, N. Aykin, Ed., vol. 5623 of Lecture Notes in Computer Science. Springer Berlin / Heidelberg, 2009, pp. 447--456.

Digital Library

[10]

Edwards, W. K., Bellotti, V., Dey, A. K., and Newman, M. W. The challenges of user-centered design and evaluation for infrastructure. In CHI '03: Proceedings of the SIGCHI conference on Human factors in computing systems (New York, NY, USA, 2003), ACM, pp. 297--304.

Digital Library

[11]

Fujisawa, H. Forty years of research in character and document recognition-an industrial perspective. Pattern Recogn. 41, 8 (2008), 2435--2446.

Digital Library

[12]

Gyongyi, Z., Koutrika, G., Pedersen, J., and Garcia-Molina, H. Questioning yahoo! answers. Technical Report 2007--35, Stanford InfoLab, 2007.

[13]

Hars, A., and Ou, S. Working for free? - motivations of participating in open source projects. In Proceedings of The Annual Hawaii International Conference on System Science (2001), p. 163.

Digital Library

[14]

Horowitz, D., and Kamvar, S. D. The anatomy of a large-scale social search engine. In WWW '10: Proceedings of the 19th international conference on World wide web (New York, NY, USA, 2010), ACM, pp. 431--440.

Digital Library

[15]

Howe, J. Crowdsourcing: Why the Power of the Crowd Is Driving the Future of Business. Crown Publishing Group, New York, NY, USA, 2008.

Digital Library

[16]

Hsueh, P.-Y., Melville, P., and Sindhwani, V. Data quality from crowdsourcing: a study of annotation selection criteria. In HLT '09: Proceedings of the NAACL HLT 2009 Workshop on Active Learning for Natural Language Processing (Morristown, NJ, USA, 2009), Association for Computational Linguistics, pp. 27--35.

Digital Library

[17]

Ipeirotis, P. G., Provost, F., and Wang, J. Quality management on amazon mechanical turk. In HCOMP '10: Proceedings of the ACM SIGKDD Workshop on Human Computation (New York, NY, USA, 2010), ACM, pp. 64--67.

Digital Library

[18]

Judge, T. K., and Neustaedter, C. Sharing conversation and sharing life: video conferencing in the home. In CHI '10: Proceedings of the 28th international conference on Human factors in computing systems (New York, NY, USA, 2010), ACM, pp. 655--658.

Digital Library

[19]

Koga, M., Mine, R., Kameyama, T., Takahashi, T., Yamazaki, M., and Yamaguchi, T. Camera-based kanji ocr for mobile-phones: Practical issues. In ICDAR '05: Proceedings of the Eighth International Conference on Document Analysis and Recognition (2005), pp. 635--639.

Digital Library

[20]

Leimeister, Jan Marco, H. M. B. U., and Krcmar, H. Leveraging crowdsourcing: Activation-supporting components for it-based ideas competition. Journal of Management Information Systems 26, 1 (Summer 2009), 194--224.

Digital Library

[21]

Morris, M. R., Teevan, J., and Panovich, K. What do people ask their social networks, and why?: a survey study of status message q&a behavior. In CHI '10: Proceedings of the 28th international conference on Human factors in computing systems (New York, NY, USA, 2010), ACM, pp. 1739--1748.

Digital Library

[22]

Quinn, A. J., B. B. B. Y. T. L. J. Crowdflow: Integrating machine learning with mechanical turk for speed-cost-quality flexibility. Tech. rep., Technical Report HCIL-2010-09 (University of Maryland, College Park, 2010.

[23]

Shiraishi, M., Washio, Y., Takayama, C., Lehdonvirta, V., Kimura, H., and Nakajima, T. Using individual, social and economic persuasion techniques to reduce co2 emissions in a family setting. In Persuasive '09: Proceedings of the 4th International Conference on Persuasive Technology (New York, NY, USA, 2009), ACM, pp. 1--8.

Digital Library

[24]

Vamshi Ambati, S. V., and Carbonell, J. Active learning and crowd-sourcing for machine translation. In Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10) (may 2010).

[25]

von Ahn, L. Human computation. In K-CAP '07: Proceedings of the 4th international conference on Knowledge capture (2007), pp. 5--6.

Digital Library

[26]

von Ahn, L., and Dabbish, L. Designing games with a purpose. Commun. ACM 51, 8 (2008), 58--67.

Digital Library

Cited By

Intal GGarcia EBendita J(2022)Terratech: A Crowdsourcing Web Application that Aids Environmental Needs and ConcernsProceedings of the 4th International Conference on Management Science and Industrial Engineering10.1145/3535782.3535832(383-390)Online publication date: 28-Apr-2022
https://dl.acm.org/doi/10.1145/3535782.3535832
Nguyen TZeadally S(2021)Mobile Crowd-sensing Applications: Data Redundancies, Challenges, and SolutionsACM Transactions on Internet Technology10.1145/343150222:2(1-15)Online publication date: 29-Oct-2021
https://dl.acm.org/doi/10.1145/3431502
Chen JYang J(2019)Maximizing Coverage Quality with Budget Constrained in Mobile Crowd-Sensing Network for Environmental Monitoring ApplicationsSensors10.3390/s1910239919:10(2399)Online publication date: 26-May-2019
https://doi.org/10.3390/s19102399
Show More Cited By

Index Terms

A crowdsourcing based mobile image translation and knowledge sharing service
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Collaborative workflow for crowdsourcing translation
CSCW '12: Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work

In this paper we explore the challenges in crowdsourcing the task of translation over the web in which remotely located translators work on providing translations independent of each other. We then propose a collaborative workflow for crowdsourcing ...
Crowdsourced Monolingual Translation

An enormous potential exists for solving certain classes of computational problems through rich collaboration among crowds of humans supported by computers. Solutions to these problems used to involve human professionals, who are expensive to hire or ...
Using targeted paraphrasing and monolingual crowdsourcing to improve translation
Special Sections on Paraphrasing; Intelligent Systems for Socially Aware Computing; Social Computing, Behavioral-Cultural Modeling, and Prediction

Targeted paraphrasing is a new approach to the problem of obtaining cost-effective, reasonable quality translation, which makes use of simple and inexpensive human computations by monolingual speakers in combination with machine translation. The key ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

MUM '10: Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia

December 2010

239 pages

ISBN:9781450304245

DOI:10.1145/1899475

General Chairs:
Marios Angelides,
Lambros Lambrinos,
Program Chairs:
Michael Rohs,
Enrico Rukzio

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

FRED-Cyprus: Frederick University Cyprus
University of Cyprus

In-Cooperation

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MUM '10

Sponsor:

FRED-Cyprus

MUM '10: 9th International Conference on Mobile and Ubiquitous Multimedia

December 1 - 3, 2010

Limassol, Cyprus

Acceptance Rates

Overall Acceptance Rate 190 of 465 submissions, 41%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
633
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Intal GGarcia EBendita J(2022)Terratech: A Crowdsourcing Web Application that Aids Environmental Needs and ConcernsProceedings of the 4th International Conference on Management Science and Industrial Engineering10.1145/3535782.3535832(383-390)Online publication date: 28-Apr-2022
https://dl.acm.org/doi/10.1145/3535782.3535832
Nguyen TZeadally S(2021)Mobile Crowd-sensing Applications: Data Redundancies, Challenges, and SolutionsACM Transactions on Internet Technology10.1145/343150222:2(1-15)Online publication date: 29-Oct-2021
https://dl.acm.org/doi/10.1145/3431502
Chen JYang J(2019)Maximizing Coverage Quality with Budget Constrained in Mobile Crowd-Sensing Network for Environmental Monitoring ApplicationsSensors10.3390/s1910239919:10(2399)Online publication date: 26-May-2019
https://doi.org/10.3390/s19102399
Fernando NLoke SRahayu W(2019)Computing with Nearby Mobile Devices: A Work Sharing Algorithm for Mobile Edge-CloudsIEEE Transactions on Cloud Computing10.1109/TCC.2016.25601637:2(329-343)Online publication date: 1-Apr-2019
https://doi.org/10.1109/TCC.2016.2560163
Guo BLiu YWang LLi VLam JYu Z(2018)Task Allocation in Spatial Crowdsourcing: Current State and Future DirectionsIEEE Internet of Things Journal10.1109/JIOT.2018.28159825:3(1749-1764)Online publication date: Jun-2018
https://doi.org/10.1109/JIOT.2018.2815982
Wood LReiners T(2014)GamificationEncyclopedia of Information Science and Technology, Third Edition10.4018/978-1-4666-5888-2.ch297(3039-3047)Online publication date: 31-Jul-2014
https://doi.org/10.4018/978-1-4666-5888-2.ch297
Vukovic MDas RKumara S(2013)From sensing to controllingInternational Journal of Communication Networks and Distributed Systems10.1504/IJCNDS.2013.05483211:1(11-25)Online publication date: 1-Jun-2013
https://dl.acm.org/doi/10.1504/IJCNDS.2013.054832
Liu YAlexandrova TNakajima TSchwabe DAlmeida VGlaser HBaeza-Yates RMoon S(2013)Using stranger as sensorsProceedings of the 22nd international conference on World Wide Web10.1145/2488388.2488458(803-814)Online publication date: 13-May-2013
https://dl.acm.org/doi/10.1145/2488388.2488458
Flores HMaciuszek D(2013)Human Computation in Mobile Cooperative Learning: A Museum Tour Case StudyTransactions on Edutainment X10.1007/978-3-642-37919-2_13(216-227)Online publication date: 2013
https://doi.org/10.1007/978-3-642-37919-2_13
Billinghurst M(2013)Augmented Reality Interfaces in Human Computation SystemsHandbook of Human Computation10.1007/978-1-4614-8806-4_26(317-331)Online publication date: 20-Nov-2013
https://doi.org/10.1007/978-1-4614-8806-4_26
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents