research-article

Heteroglossia: In-Situ Story Ideation with the Crowd

Authors:

Chieh-Yang Huang,

Shih-Hong Huang,

Ting-Hao Kenneth HuangAuthors Info & Claims

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Pages 1 - 12

https://doi.org/10.1145/3313831.3376715

Published: 23 April 2020 Publication History

Abstract

Ideation is essential for creative writing. Many authors struggle to come up with ideas throughout the writing process, yet modern writing tools fail to provide on-the-spot assistance for writers when they get stuck. This paper introduces Heteroglossia, an add-on for Google Docs that allows writers to elicit story ideas from the online crowd using their text editors. Writers can share snippets of their working drafts and ask the crowd to provide follow-up story ideas based on it. Heteroglossia employs a strategy called "role play", where each worker is assigned a fictional character in a story and asked to brainstorm plot ideas from that character's perspective. Our deployment with two experienced story writers shows that Heteroglossia is easy to use and can generate interesting ideas. Heteroglossia allows us to gain insight into how future technologies can be developed to support ideation in creative writing.

Supplementary Material

SBV File (paper586pvc.sbv)

Preview video captions

Download
.72 KB

MP4 File (paper586pv.mp4)

Preview video

Download
8.50 MB

MP4 File (a586-huang-presentation.mp4)

Download
45.22 MB

References

[1]

Elena Agapie, Jaime Teevan, and Andrés Monroy-Hernández. 2015. Crowdsourcing in the field: A case study using local crowds for event reporting. In Third AAAI Conference on Human Computation and Crowdsourcing.

[2]

Salvatore Andolina, Hendrik Schneider, Joel Chan, Khalil Klouche, Giulio Jacucci, and Steven Dow. 2017. Crowdboard: augmenting in-person idea generation with real-time crowds. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition. ACM, 106--118.

Digital Library

[3]

Michael S Bernstein, Greg Little, Robert C Miller, Björn Hartmann, Mark S Ackerman, David R Karger, David Crowell, and Katrina Panovich. 2010. Soylent: a word processor with a crowd inside. In Proceedings of the 23nd annual ACM symposium on User interface software and technology. ACM, 313--322.

Digital Library

[4]

Joel Chan, Steven Dang, and Steven P Dow. 2016. Improving crowd innovation with expert facilitation. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 1223--1235.

Digital Library

[5]

Joel Chan, Steven P Dow, and Christian D Schunn. 2018. Do the best design ideas (really) come from conceptually distant sources of inspiration? In Engineering a Better Future. Springer, 111--139.

[6]

Joel Chan, Pao Siangliulue, Denisa Qori McDonald, Ruixue Liu, Reza Moradinezhad, Safa Aman, Erin T Solovey, Krzysztof Z Gajos, and Steven P Dow. 2017. Semantically Far Inspirations Considered Harmful?: Accounting for Cognitive States in Collaborative Ideation. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition. ACM, 93--105.

Digital Library

[7]

Yung-Yi Juliet Chou and Barbara Tversky. 2017. Finding Creative New Ideas: Human-Centric Mindset Overshadows Mind-Wandering. In CogSci.

[8]

Elizabeth Clark, Anne Spencer Ross, Chenhao Tan, Yangfeng Ji, and Noah A. Smith. 2018. Creative Writing with a Machine in the Loop: Case Studies on Slogans and Stories. In 23rd International Conference on Intelligent User Interfaces (IUI '18). ACM, NY, NY, USA, 329--340.

Digital Library

[9]

Colette Daiute. 1989. Play as thought: Thinking strategies of young writers. Harvard educational review 59, 1 (1989), 1--24.

[10]

Edward De Bono. 2017. Six thinking hats. Penguin UK.

[11]

Richard P Gabriel, Jilin Chen, and Jeffrey Nichols. 2015. InkWell: A Creative Writer's Creative Assistant. In Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition. ACM, 93--102.

Digital Library

[12]

John L Geiger and Howard Suber. 2019. Creativity and Copyright: Legal Essentials for Screenwriters and Creative Artists. University of California Press.

[13]

Nick Greer, Jaime Teevan, and Shamsi T Iqbal. 2016. An introduction to technological support for writing. Technical Report. Technical Report. Microsoft Research Tech Report MSR-TR-2016-001.

[14]

Nathan Hahn, Joseph Chang, Ji Eun Kim, and Aniket Kittur. 2016. The Knowledge Accelerator: Big picture thinking in small pieces. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2258--2270.

Digital Library

[15]

Yi-Ching Huang, Jiunn-Chia Huang, Hao-Chuan Wang, and Jane Yung-jen Hsu. 2017. Supporting ESL Writing by Prompting Crowdsourced Structural Feedback. In Fifth AAAI Conference on Human Computation and Crowdsourcing.

[16]

Karl K Jeffries. 2017. A CAT with caveats: is the Consensual Assessment Technique a reliable measure of graphic design creativity? International Journal of Design Creativity and Innovation 5, 1--2 (2017), 16--28.

[17]

James C Kaufman, John Baer, Jason C Cole, and Janel D Sexton*. 2008. A comparison of expert and nonexpert raters using the consensual assessment technique. Creativity Research Journal 20, 2 (2008), 171--178.

[18]

Joy Kim, Justin Cheng, and Michael S Bernstein. 2014. Ensemble: exploring complementary strengths of leaders and crowds in creative collaboration. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 745--755.

Digital Library

[19]

Joy Kim, Sarah Sterman, Allegra Argent Beal Cohen, and Michael S Bernstein. 2017. Mechanical novel: Crowdsourcing complex work through reflection and revision. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 233--245.

Digital Library

[20]

Ryan Kiros, Yukun Zhu, Ruslan R Salakhutdinov, Richard Zemel, Raquel Urtasun, Antonio Torralba, and Sanja Fidler. 2015. Skip-thought vectors. In Advances in neural information processing systems. 3294--3302.

[21]

Aniket Kittur, Boris Smus, Susheel Khamkar, and Robert E Kraut. 2011. Crowdforge: Crowdsourcing complex work. In Proceedings of the 24th annual ACM symposium on User interface software and technology. ACM, 43--52.

Digital Library

[22]

Jey Han Lau and Timothy Baldwin. 2016. An empirical evaluation of doc2vec with practical insights into document embedding generation. arXiv preprint arXiv:1607.05368 (2016).

[23]

Quoc Le and Tomas Mikolov. 2014. Distributed representations of sentences and documents. In International conference on machine learning. 1188--1196.

Digital Library

[24]

Boyang Li and Mark Riedl. 2015. Scheherazade: Crowd-powered interactive narrative generation. In Twenty-Ninth AAAI Conference on Artificial Intelligence.

[25]

Kurt Luther, Jari-Lee Tolentino, Wei Wu, Amy Pavel, Brian P Bailey, Maneesh Agrawala, Björn Hartmann, and Steven P Dow. 2015. Structuring, aggregating, and evaluating crowdsourced design critique. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, 473--485.

Digital Library

[26]

James Maxey. 2007. You Never Write Alone. (Nov 2007). http://jamesmaxey.blogspot.com/2007/11/ you-never-write-alone.html

[27]

Merriam-Webster. 2014. Heteroglossia. (2014). https://www.merriam-webster.com/dictionary/heteroglossia

[28]

Nasrin Mostafazadeh, Nathanael Chambers, Xiaodong He, Devi Parikh, Dhruv Batra, Lucy Vanderwende, Pushmeet Kohli, and James Allen. 2016. A corpus and evaluation framework for deeper understanding of commonsense stories. arXiv preprint arXiv:1604.01696 (2016).

[29]

Michael Nebeling, Alexandra To, Anhong Guo, Adrian A de Freitas, Jaime Teevan, Steven P Dow, and Jeffrey P Bigham. 2016. WearWrite: Crowd-assisted writing from smartwatches. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 3834--3846.

Digital Library

[30]

Bernard A Nijstad and Wolfgang Stroebe. 2006. How the group affects the mind: A cognitive model of idea generation in groups. Personality and social psychology review 10, 3 (2006), 186--213.

[31]

Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 1532--1543.

[32]

Eva Novrup Redvall. 2012. European TV Drama Series Lab. Summary of Module 1. (2012).

[33]

Melissa Roemmele. 2018. Neural Networks for Narrative Continuation. Ph.D. Dissertation. University of Southern California.

[34]

Melissa Roemmele and Andrew S Gordon. 2015. Creative help: a story writing assistant. In International Conference on Interactive Digital Storytelling. Springer, 81--92.

[35]

Eva Siegenthaler, Yves Bochud, Per Bergamin, and Pascal Wurtz. 2012. Reading on LCD vs e-Ink displays: effects on fatigue and visual strain. Ophthalmic and Physiological Optics 32, 5 (2012), 367--374.

[36]

Jaime Teevan, Shamsi T Iqbal, and Curtis Von Veh. 2016. Supporting collaborative writing with microtasks. In Proceedings of the 2016 CHI conference on human factors in computing systems. ACM, 2657--2668.

Digital Library

[37]

Jaime Teevan, Daniel J Liebling, and Walter S Lasecki. 2014. Selfsourcing personal tasks. In CHI'14 Extended Abstracts on Human Factors in Computing Systems. ACM, 2527--2532.

Digital Library

[38]

Jaime Teevan and Lisa Yu. 2017. Bringing the Wisdom of the Crowd to an Individual by Having the Individual Assume Different Roles. In Proceedings of the 2017 ACM SIGCHI Conference on Creativity and Cognition. ACM, 131--135.

Digital Library

[39]

Polly W Wiessner. 2014. Embers of society: Firelight talk among the Ju/'hoansi Bushmen. Proceedings of the National Academy of Sciences 111, 39 (2014), 14027--14035.

[40]

Anbang Xu, Shih-Wen Huang, and Brian Bailey. 2014. Voyant: generating structured feedback on visual designs using a crowd of non-experts. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 1433--1444.

Digital Library

[41]

Anbang Xu, Huaming Rao, Steven P Dow, and Brian P Bailey. 2015. A classroom study of using crowd feedback in the iterative design process. In Proceedings of the 18th ACM conference on computer supported cooperative work & social computing. ACM, 1637--1648.

Digital Library

[42]

Lixiu Yu, Aniket Kittur, and Robert E. Kraut. 2016. Encouraging ?Outside- The- Box" Thinking in Crowd Innovation Through Identifying Domains of Expertise. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, NY, NY, USA, 1214--1222.

Digital Library

Cited By

Wise TKenett Y(2024)Sparking creativity: Encouraging creative idea generation through automatically generated word recommendationsBehavior Research Methods10.3758/s13428-024-02463-856:7(7939-7962)Online publication date: 16-Jul-2024
https://doi.org/10.3758/s13428-024-02463-8
Wan RGebreegziabher SLi TBadillo-Urquiola K(2024)CoCo Matrix: Taxonomy of Cognitive Contributions in Co-writing with Intelligent AgentsProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3664260(504-511)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3664260
Lee JYoon SLee KJeong ECho JPark WYim DHwang I(2024)Open Sesame? Open Salami! Personalizing Vocabulary Assessment-Intervention for Children via Pervasive Profiling and Bespoke Storybook GenerationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642580(1-32)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642580
Show More Cited By

Index Terms

Heteroglossia: In-Situ Story Ideation with the Crowd
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies
2. Information systems
  1. World Wide Web
    1. Web applications
      1. Crowdsourcing

Recommendations

The Effect of Peripheral Micro-tasks on Crowd Ideation
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Research has explored different ways of improving crowd ideation, such as presenting examples or employing facilitators. While such support is usually generated through peripheral tasks delegated to crowd workers who are not part of the ideation, it is ...
Directed Diversity: Leveraging Language Embedding Distances for Collective Creativity in Crowd Ideation
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems

Crowdsourcing can collect many diverse ideas by prompting ideators individually, but this can generate redundant ideas. Prior methods reduce redundancy by presenting peers’ ideas or peer-proposed prompts, but these require much human coordination. We ...
Creative Computing for Bespoke Ideation
COMPSAC '15: Proceedings of the 2015 IEEE 39th Annual Computer Software and Applications Conference - Volume 01

Today, idea generation is an extremely important activity for both academic researchers and industrial groups. A considerable number of applications and research studies have been made in the past years in order to increase the effectiveness of idea ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

April 2020

10688 pages

ISBN:9781450367080

DOI:10.1145/3313831

General Chairs:
Regina Bernhaupt
Eindhoven University of Technology, Netherlands
,
Florian 'Floyd' Mueller
Monash University, Australia
,
David Verweij
Newcastle University, UK
,
Josh Andres
RMIT, Australia
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
Andy Cockburn
University of Canterbury, New Zealand
,
Ignacio Avellino
University of Maryland Baltimore County, USA
,
Alix Goguey
Grenoble Alpes University, France
,
Pernille Bjørn
University of Copenhagen, Denmark
,
Shengdong (Shen) Zhao
National University of Singapore, Singapore
,
Briane Paul Samson
Future University Hakodate, Japan & De La Salle University, Philippines
,
Rafal Kocielnik
University of Washington, USA

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 April 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '20

Sponsor:

SIGCHI

CHI '20: CHI Conference on Human Factors in Computing Systems

April 25 - 30, 2020

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI '25

Sponsor:
sigchi

CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
434
Total Downloads

Downloads (Last 12 months)89
Downloads (Last 6 weeks)12

Reflects downloads up to 20 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wise TKenett Y(2024)Sparking creativity: Encouraging creative idea generation through automatically generated word recommendationsBehavior Research Methods10.3758/s13428-024-02463-856:7(7939-7962)Online publication date: 16-Jul-2024
https://doi.org/10.3758/s13428-024-02463-8
Wan RGebreegziabher SLi TBadillo-Urquiola K(2024)CoCo Matrix: Taxonomy of Cognitive Contributions in Co-writing with Intelligent AgentsProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3664260(504-511)Online publication date: 23-Jun-2024
https://dl.acm.org/doi/10.1145/3635636.3664260
Lee JYoon SLee KJeong ECho JPark WYim DHwang I(2024)Open Sesame? Open Salami! Personalizing Vocabulary Assessment-Intervention for Children via Pervasive Profiling and Bespoke Storybook GenerationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642580(1-32)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642580
Kim THan HAdar EKay MChung J(2024)Authors' Values and Attitudes Towards AI-bridged Scalable Personalization of Creative Language ArtsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642529(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642529
Chou JSiu ALipka NRossi RDernoncourt FAgrawala M(2023)TaleStream: Supporting Story Ideation with Trope KnowledgeProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606807(1-12)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606807
Zaidi ATurbeville KIvančić KMoss JGutierrez Villalobos JSagar ALi HMehra CLi SHutchins SKumar R(2023)Learning Custom Experience Ontologies via Embedding-based Feedback LoopsProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606715(1-13)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606715
Montanelli SRuskov M(2023)A Systematic Literature Review of Online Collaborative Story WritingHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42286-7_5(73-93)Online publication date: 28-Aug-2023
https://dl.acm.org/doi/10.1007/978-3-031-42286-7_5
Calacci D(2022)Organizing in the End of Employment: Information Sharing, Data Stewardship, and Digital WorkerismProceedings of the 1st Annual Meeting of the Symposium on Human-Computer Interaction for Work10.1145/3533406.3533424(1-9)Online publication date: 8-Jun-2022
https://dl.acm.org/doi/10.1145/3533406.3533424
Chung JKim WYoo KLee HAdar EChang M(2022)TaleBrush: Sketching Stories with Generative Pretrained Language ModelsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501819(1-19)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501819
Booten KGero KSas CMaiden N(2021)Poetry Machines: Eliciting Designs for Interactive Writing Tools from PoetsProceedings of the 13th Conference on Creativity and Cognition10.1145/3450741.3466813(1-5)Online publication date: 22-Jun-2021
https://dl.acm.org/doi/10.1145/3450741.3466813
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents