research-article

Gut Instinct: Creating Scientific Theories with Online Learners

Authors:

Justine Debelius,

Embriette R. Hyde,

Tomasz Kosciolek,

Scott KlemmerAuthors Info & Claims

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Pages 6825 - 6836

https://doi.org/10.1145/3025453.3025769

Published: 02 May 2017 Publication History

Abstract

Learners worldwide collectively spend millions of hours per week testing their skills on assignments with known answers. Might some of this time fruitfully be spent posing and exploring novel questions? This paper investigates an approach for learners to contribute scientific ideas. The Gut Instinct system embodies this approach, hosting online learning materials and invites learners to collaboratively brainstorm potential influences on people's microbiome. A between-subjects experiment compared the performance of participants who engaged in just learning, just contributing, or a combination. Participants in the learning condition scored highest on a summative test. Participants in both the contribution and combined conditions generated novel, useful questions; there was not a significant difference between the two. Though participants in the combined condition both learned and contributed, this setting did not exhibit an additive benefit, such as better learning in the combined condition. These results highlight the promise and difficulty of double-bottom-line learning experiences.

References

[1]

23andMe. 2015. Something to Chew On. Retrieved December 31, 2016 from https://blog.23andme.com/23andmeresearch/somethingto-chew-on

[2]

Luis von Ahn, Ruoran Liu, and Manuel Blum. 2006. Peekaboom. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06), 55--64.

Digital Library

[3]

Luis Von Ahn, Benjamin Maurer, Colin Mcmillen, David Abraham, and Manuel Blum. 2008. reCAPTCHA: Human-Based Character Recognition via Web Security Measures. Science 321, 12 September 2008: 1465--1468.

[4]

Vincent Aleven, Bruce Mclaren, Ido Roll, and Kenneth Koedinger. 2006. Toward meta-cognitive tutoring: A model of help seeking with a cognitive tutor. International Journal of Artificial Intelligence in Education 16, 2: 101--128.

Digital Library

[5]

Amazon. 2016. Mechanical Turk. Retrieved December 31, 2016 from https://www.mturk.com

[6]

Erik Andersen, Eleanor O Rourke, Yun-en Liu, Richard Snider, Jeff Lowdermilk, David Truong, Seth Cooper, and Zoran Popovi. 2012. The Impact of Tutorials on Games of Varying Complexity. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), 59--68.

Digital Library

[7]

Audubon. 2016. Audubon Science. Using data to realize the best conservation outcomes. Retrieved December 31, 2016 from http://www.audubon.org/conservation/science/christmas -bird-count

[8]

Michael S. Bernstein. 2012. Crowd-powered Systems. Retrieved December 31, 2016 from http://hci.stanford.edu/msb/files/job_search/researchstatement.pdf

[9]

Michael S. Bernstein, Greg Little, Robert C. Miller, Björn Hartmann, Mark S. Ackerman, David R. Karger, David Crowell, and Katrina Panovich. 2010. Soylent: a word processor with a crowd inside. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology (UIST '10), 313--322.

Digital Library

[10]

Margaret A. Boden. 2004. "The Story so far". The Creative Mind: Myths and Mechanisms. Routledge.

Digital Library

[11]

Michele K. Bolton. 1999. The Role Of Coaching in Student Teams: A "Just-in-Time" Approach To Learning. Journal of Management Education 23: 233-- 250.

[12]

David Boud. 1995. Enhancing learning through selfassessment. Kogan Page, London.

[13]

Project BudBurst Boulder Colorado. 2016. Project BudBurst: An online database of plant phenological observations. Retrieved December 31, 2016 from http://budburst.org/

[14]

Dana Chandler and Adam Kapelner. 2013. Breaking monotony with meaning: Motivation in crowdsourcing markets. Journal of Economic Behavior and Organization 90: 123--133.

[15]

Guanliang Chen, Dan Davis, Markus Krause, Efthimia Aivaloglou, Claudia Hauff, and Geert-Jan Houben. 2016. Can Learners be Earners' Investigating a Design to Enable MOOC Learners to Apply their Skills and Earn Money in an Online Market Place. IEEE Transactions on Learning Technologies PP, 99: 1.

[16]

I. Cho and M.J. Blaser. 2012. The human microbiome: at the interface of health and disease. Nature Reviews Genetics 13, 4: 260--270.

[17]

The Human Microbiome Project Consortium. 2012. A framework for human microbiome research. Nature 486, 7402: 215--221.

[18]

The Human Microbiome Project Consortium. 2013. Structure, Function and Diversity of the Healthy Human Microbiome. Nature 486, 7402: 207--214.

[19]

Seth Cooper, Firas Khatib, Adrien Treuille, Janos Barbero, Jeehyung Lee, Michael Beenen, Andrew Leaver-Fay, David Baker, Zoran Popović, and Foldit Players. 2010. Predicting protein structures with a multiplayer online game. Nature 466, 7307: 756--760.

[20]

Michael J. Coren and Fast Company. 2011. Foldit Gamers Solve Riddle of HIV Enzyme within 3 Weeks. Retrieved December 31, 2016 from https://www.scientificamerican.com/article/folditgamers-solve-riddle/

[21]

Catherine H. Crouch and Eric Mazur. 2001. Peer Instruction: Ten years of experience and results. American Journal of Physics 69, 9: 970.

[22]

Justine W Debelius, Yoshiki Vázquez-Baeza, Daniel McDonald, Zhenjiang Xu, Elaine Wolfe, and Rob Knight. 2016. Turning Participatory Microbiome Research into Usable Data: Lessons from the American Gut Project. Journal of Microbiology & Biology Education 17, 1: 46--50.

[23]

Steven P. Dow, Anand Kulkarni, Scott R. Klemmer, and Bjorn Hartmann. 2012. Shepherding the crowd yields better work. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work (CSCW '12), 1013--1022.

Digital Library

[24]

Siamak Faridani, Bryce Lee, Selma Glasscock, John Rappole, Dezhen Song, and Ken Goldberg. 2009. A networked telerobotic observatory for collaborative remote observation of avian activity and range change. IFAC Proceedings Volumes (IFAC-PapersOnline): 56-- 61.

[25]

Rosta Farzan and Robert E Kraut. 2013. Wikipedia classroom experiment: bidirectional benefits of students' engagement in online production communities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), 783--792.

Digital Library

[26]

Susan A. Gelman and Cristine H Legare. 2011. Concepts and folk theories. Annu Rev Anthropol: 379-- 398.

[27]

SR Gill, Mihai Pop, RT DeBoy, and PB Eckburg. 2006. Metagenomic analysis of the human distal gut microbiome. Science 312, 5778: 1355--1359.

[28]

Severin Benedict Hans Hacker. 2014. Duolingo: Learning a Language while Translating the Web. Ph.D Dissertation.

[29]

Joseph Henrich, Steven J Heine, and Ara Norenzayan. 2010. Most People are not WEIRD. Nature 466, July 2010.

[30]

Pamela J. Hinds. 1999. The curse of expertise: The effects of expertise and debiasing methods on prediction of novice performance. Journal of Experimental Psychology: Applied 5, 2: 205--221.

[31]

Eric von Hippel. 2005. Democratizing innovation: The evolving phenomenon of user innovation. MIT Press.

[32]

Charlene Jennett and Anna L. Cox. 2014. Eight Guidelines for Designing Virtual Citizen Science Projects. Second AAAI Conference on Human Computation and Crowdsourcing (HCOMP '14): 16-- 17.

[33]

Alexander Kawrykow, Gary Roumanis, Alfred Kam, Daniel Kwak, Clarence Leung, Chu Wu, Eleyine Zarour, Luis Sarmenta, Mathieu Blanchette, and Jérôme Waldispühl. 2012. Phylo: A citizen science approach for improving multiple sequence alignment. PLoS ONE 7, 3.

[34]

Willett Kempton. 1986. Two theories of home heat control. Cognitive Science 10, 1: 75--90.

[35]

Juho Kim. 2015. Learnersourcing?: Improving video learning with collective learner activity. Ph.D Dissertation. Retrieved from https://juhokim.com/files/JuhoKim-Thesis.pdf

[36]

R. Knight, J. Metcalf, and K. Amato. 2016. Gut Check: Exploring Your Microbiome. Coursera. Retrieved December 31, 2016 from https://www.coursera.org/learn/microbiome

[37]

KnightLab. 2016. American Gut Project. Login. Retrieved December 31, 2016 from http://microbio.me/americangut/

[38]

KnightLab. 2016. American Gut - What's in your gut? Retrieved December 31, 2016 from http://americangut.org/

[39]

Yasmine Kotturi, Chinmay E. Kulkarni, Michael S Bernstein, and Scott Klemmer. 2015. Structure and messaging techniques for online peer learning systems that increase stickiness. In Proceedings of the Second (2015) ACM Conference on Learning @ Scale (L@S '15), 31--38.

Digital Library

[40]

Michel Krieger, Emily Margarete Stark, and Scott R Klemmer. 2009. Coordinating tasks on the commons: designing for personal goals, expertise and serendipity. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09), 1485--1494.

Digital Library

[41]

Chinmay Kulkarni, Koh Pang Wei, Huy Le, Daniel Chia, Kathryn Papadopoulos, Justin Cheng, Daphne Koller, and Scott R. Klemmer. 2013. Peer and self assessment in massive online classes. ACM Transactions on Computer-Human Interaction 20, 6: 1-- 31.

Digital Library

[42]

Edith Law, Ming Yin, Joslin Goh, Kevin Chen, Michael Terry, and Krzysztof Z Gajos. 2016. Curiosity Killed the Cat, but Makes Crowdwork Better. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '16).

Digital Library

[43]

Doris Lee, Joanne Lo, Moonhyok Kim, and Eric Paulos. 2016. Crowdclass: Designing classification-based citizen science learning modules. In Proceedings of the Fourth AAAI Conference on Human Computation and Crowdsourcing (HCOMP '16).

[44]

Jeehyung Lee, Wipapat Kladwang, Minjae Lee, Daniel Cantu, Martin Azizyan, Hanjoo Kim, Alex Limpaecher, Snehal Gaikwad, Sungroh Yoon, Adrien Treuille, and Rhiju Das. 2014. RNA design rules from a massive open laboratory. Proceedings of the National Academy of Sciences 111, 6: 2122--2127.

[45]

Yi-Chieh Lee, Wen-Chieh Lin, Fu-Yin Cherng, HaoChuan Wang, Ching-Ying Sung, and Jung-Tai King. 2015. Using Time-Anchored Peer Comments to Enhance Social Interaction in Online Educational Videos. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '15), 689-- 698.

Digital Library

[46]

Lena Mamykina, Bella Manoim, Manas Mittal, George Hripcsak, and Björn Hartmann. 2011. Design Lessons from the Fastest Q&A Site in the West. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11), 2857--2866.

Digital Library

[47]

Richard E Mayer. 2004. Should There Be a ThreeStrikes Rule Against Pure Discovery Learning? The case for guided methods of instruction. American Psychologist 59, 1: 14--19.

[48]

Katharina Reinecke, Ann Arbor, and Krzysztof Z Gajos. 2015. LabintheWild?: Conducting Large-Scale Online Experiments With Uncompensated Samples. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15), 1364--1378.

Digital Library

[49]

R. Resnick, P. and Kraut. 2011. Building Successful Online Communities: Evidence-based social design. MIT Press, Cambridge, MA.

Digital Library

[50]

John R Savery and Thomas M Duffy. 1995. Problem based learning: An instructional model and its constructivist framework. Educational Technology 35, 5: 31--38. https://doi.org/47405--1006

[51]

Dhawal Shah. 2015. By The Numbers: MOOCS in 2015. Class Central. Retrieved from https://www.classcentral.com/report/moocs-2015-stats/

[52]

Rion Snow, Brendan O Connor, Daniel Jurafsky, Andrew Y Ng, Dolores Labs, and Capp St. 2008. Cheap and fast - but is it good? Evaluation non-expert annotiations for natural language tasks. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP '08), 254--263.

Digital Library

[53]

James Surowiecki. 2005. The Wisdom of Crowds. Anchor.

Digital Library

[54]

Ramine Tinati, Max Van Kleek, Elena Simperl, Markus Luczak-Roesch, Robert Simpson, and Nigel Shadbolt. 2015. Designing for Citizen Data Analysis: A CrossSectional Case Study of a Multi-Domain Citizen Science Platform. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '15), April: 4069--4078.

Digital Library

[55]

T Yatsunenko, F E Rey, M J Manary, I Trehan, M G Dominguez-Bello, M Contreras, M Magris, G Hidalgo, R N Baldassano, A P Anokhin, A C Heath, B Warner, J Reeder, J Kuczynski, J G Caporaso, C A Lozupone, C Lauber, J C Clemente, D Knights, R Knight, and J I Gordon. 2012. Human gut microbiome viewed across age and geography. Nature 486, 7402: 222--227.

[56]

Lixiu Yu, Jeffrey V Nickerson, and Yasuaki Sakamoto. 2012. Collective creativity: Where we are and where we might go. Collective Intelligence Conference: 1--8.

[57]

YuanYuan Yu, J.A. Stamberger, A. Manoharan, and A. Paepcke. 2006. EcoPod: a mobile tool for community based biodiversity collection building. In Proceedings of the 6th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL '06), 244--253.

Digital Library

[58]

Xuan Zhang, Dongya Zhang, and Huijue et al. Jia. 2015. The oral and gut microbiomes are perturbed in rheumatoid arthritis and partly normalized after treatment. Nat Med 21, 8: 895--905.

[59]

Zooniverse. 2007. Galaxy Zoo. Retrieved December 31, 2016 from www.galaxyzoo.org

Cited By

He CDeng YHe LGuo QZhang YLu ZLi B(2024)Engage Wider Audience or Facilitate Quality Answers? a Mixed-methods Analysis of Questioning Strategies for Research Sensemaking on a Community Q&A SiteProceedings of the ACM on Human-Computer Interaction10.1145/36373278:CSCW1(1-31)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637327
Zhang YHe CWang HLu Z(2023)Understanding Communication Strategies and Viewer Engagement with Science Knowledge Videos on BilibiliProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581476(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581476
Mutalova RSarrazin-Gendron RCai ERichard GGhasemloo Gheidari PCaisse SKnight RBlanchette MSzantner AWaldispühl J(2023)Playing the System: Can Puzzle Players Teach us How to Solve Hard Problems?Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581375(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581375
Show More Cited By

Index Terms

Gut Instinct: Creating Scientific Theories with Online Learners
1. Applied computing
  1. Education

Recommendations

Creating Scientific Theories with Online Communities using Gut Instinct
CSCW '18 Companion: Companion of the 2018 ACM Conference on Computer Supported Cooperative Work and Social Computing

People's lived experiences provide intuitions about their health. Can they transform these personal intuitions into scientific theories that inform both science and their lives? My research introduces social computing architectures and system principles ...
An investigation of player motivations in Eyewire, a gamified citizen science project

Sustained engagement of participants is essential for the success of a citizen science project. However, the motivations of why people engage with such activities can be idiosyncratic, varied, and evolving. In this article we examine player ...
Older Adults’ Motivation and Engagement with Diverse Crowdsourcing Citizen Science Tasks
Human-Computer Interaction – INTERACT 2021
Abstract
In this exploratory study we evaluated the engagement, performance and preferences of older adults who interacted with different citizen science tasks. Out of 40 projects recently active on the Zooniverse platform we selected top ones to be ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

May 2017

7138 pages

ISBN:9781450346559

DOI:10.1145/3025453

General Chairs:
Gloria Mark
University of California Irvine
,
Susan Fussell
Cornell University
,
Program Chairs:
Cliff Lampe
University of Michigan
,
m.c. schraefel
University of Southampton
,
Juan Pablo Hourcade
University of Iowa
,
Caroline Appert
Université Paris-Sud
,
Daniel Wigdor
University of Toronto

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

SAP
Google

Conference

CHI '17

Sponsor:

SIGCHI

CHI '17: CHI Conference on Human Factors in Computing Systems

May 6 - 11, 2017

Colorado, Denver, USA

Acceptance Rates

CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
423
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)3

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

He CDeng YHe LGuo QZhang YLu ZLi B(2024)Engage Wider Audience or Facilitate Quality Answers? a Mixed-methods Analysis of Questioning Strategies for Research Sensemaking on a Community Q&A SiteProceedings of the ACM on Human-Computer Interaction10.1145/36373278:CSCW1(1-31)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3637327
Zhang YHe CWang HLu Z(2023)Understanding Communication Strategies and Viewer Engagement with Science Knowledge Videos on BilibiliProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581476(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581476
Mutalova RSarrazin-Gendron RCai ERichard GGhasemloo Gheidari PCaisse SKnight RBlanchette MSzantner AWaldispühl J(2023)Playing the System: Can Puzzle Players Teach us How to Solve Hard Problems?Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581375(1-15)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581375
Zambon TBassetti CPrandi C(2023)A Close Look at Citizen Science Through the HCI Lens: A Systematic Literature ReviewHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42283-6_23(414-435)Online publication date: 25-Aug-2023
https://doi.org/10.1007/978-3-031-42283-6_23
Pocol CStanca LDabija DPop IMișcoiu S(2022)Knowledge Co-creation and Sustainable Education in the Labor Market-Driven University–Business EnvironmentFrontiers in Environmental Science10.3389/fenvs.2022.78107510Online publication date: 18-Feb-2022
https://doi.org/10.3389/fenvs.2022.781075
Matias NPennington EChan Z(2022)Testing Concerns about Technology's Behavioral Impacts with N-of-one TrialsProceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency10.1145/3531146.3533227(1722-1732)Online publication date: 21-Jun-2022
https://dl.acm.org/doi/10.1145/3531146.3533227
Tavakoli MFaraji AMolavi MT. Mol SKismihók GWise AMartinez-Maldonado RHilliger I(2022)Hybrid Human-AI Curriculum Development for Personalised Informal Learning EnvironmentsLAK22: 12th International Learning Analytics and Knowledge Conference10.1145/3506860.3506917(563-569)Online publication date: 21-Mar-2022
https://dl.acm.org/doi/10.1145/3506860.3506917
Pang YReinecke KJust R(2022)Apéritif: Scaffolding Preregistrations to Automatically Generate Analysis Code and Methods DescriptionsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517707(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517707
Nebeker C(2021)mHealth Research Applied to Regulated and Unregulated Behavioral Health SciencesJournal of Law, Medicine & Ethics10.1177/107311052091702948:S1(49-59)Online publication date: 1-Jan-2021
https://doi.org/10.1177/1073110520917029
Pandey VKoul TYang CMcDonald DPrice Ball MGreshake Tzovaras BKnight RKlemmer SKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Galileo: Citizen-led Experimentation Using a Social Computing SystemProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445668(1-14)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445668
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents