research-article

Analyzing the quality of information solicited from targeted strangers on social media

Authors:

Jeffrey Nichols,

Jeon-Hyung Kang,

Xiao Hua SunAuthors Info & Claims

CSCW '13: Proceedings of the 2013 conference on Computer supported cooperative work

Pages 967 - 976

https://doi.org/10.1145/2441776.2441886

Published: 23 February 2013 Publication History

Abstract

The emergence of social media creates a unique opportunity for developing a new class of crowd-powered information collection systems. Such systems actively identify potential users based on their public social media posts and solicit them directly for information. While studies have shown that users will respond to solicitations in a few domains, there is little analysis of the quality of information received. Here we explore the quality of information solicited from Twitter users in the domain of product reviews, specifically reviews for a popular tablet computer and L.A.-based food trucks. Our results show that the majority of responses to our questions (>70%) contained relevant information and often provided additional details (>37%) beyond the topic of the question. We compare the solicited Twitter reviews to other user-generated reviews from Amazon and Yelp, and found that the Twitter answers provided similar information when controlling for the questions asked. Our results also reveal limitations of this new information collection method, including its suitability in certain domains and potential technical barriers to its implementation. Our work provides strong evidence for the potential of this new class of information collection systems and design implications for their future use.

References

[1]

Bulut, M. F., Yilmaz, Y. S., and Demirbas, M. "Crowdsourcing Location-based Queries," in PerCol 2011.

[2]

Cover. T., and Thomas, J., (2006) Elements of Infor-mation Theory. Wiley.

Digital Library

[3]

Gazan, R. Social Q&A. J. of the Amer. Soc. for Info Science & Technology, 62(12): 2301--2312.

Digital Library

[4]

Gilbert, E. and Karahalios, K. "Understanding déjà re-viewers", in CSCW 2010: 225--228.

Digital Library

[5]

Harper, F. M., Raban, D., Rafaeli, S., and Konstan, J. A. "Predictors of answer quality in online Q&A sites," CHI'08: 865--874.

Digital Library

[6]

Hausser, J. and Strimmer, K. (2009) "Entropy inference and the James-Stein estimator, with application to non-linear gene association networks," In J. Mach. Lear. Res. 10: 1469--1484.

Digital Library

[7]

Horowitz, D. and Kamvar, S. D. "The anatomy of a large-scale social search engine," WWW'10: 431--440.

Digital Library

[8]

Hsieh, G., Kraut, R. E., and Hudson, S. E. "Why pay?: exploring how financial incentives are used for question & answer," CHI'10: 305--314.

Digital Library

[9]

Jeon, G. Y., Kim, Y.-M., and Chen, Y. "Re-examining price as a predictor of answer quality in an online q&a site," CHI'10: 325--328.

Digital Library

[10]

Morris, M. R., Teevan, J., and Panovich, K. "What do people ask their social networks, and why?: A survey of status message q&a behavior," CHI '10:1739--1748.

Digital Library

[11]

Nelson, P. Information and Consumer Behavior, 78(2) Journal of Political Economy 311--329 (1970).

[12]

Nichols, J. and Kang, J. H. "Asking Questions of Targeted Strangers on Social Media," CSCW'12: 999--1002.

Digital Library

[13]

Paul, S. A., Hong, L., and Chi, E. H. "Is Twitter a Good Place for Asking Questions? A Characterization Study," ICWSM'11 Posters.

[14]

Panovich, K., Miller, R. C., and Karger, D. "Tie Strength in Question and Answer on Social Network Sites," CSCW'12: 1057--1066.

Digital Library

[15]

Shannon, C. E. "A Mathematical Theory of Communication". Bell Sys.Tech. J. 27 (3): 379--423, 1948.

[16]

Shah, C. and Pomerantz, J. "Eval. and predicting answer quality in community Q&A," SIGIR'10: 411--418.

Digital Library

[17]

Richardson, M. and White, R. W. "Supporting Synchronous Social Q&A Throughout the Question Lifecycle," WWW'11: 755--764.

Digital Library

[18]

Zhu, Z., Bernhard, and D., Gurevych, I. (2009) "A Multi-dimensional Model for Assessing the Quality of Answers in Social Q&A Sites," Tech. Rep. TUD-CS-2009-0158, Technische Universität Darmstadt.

[19]

Zhuang, L., Jing, F., and Zhu, X. "Movie review mining and summarization," CIKM'06: 43--50.

Digital Library

Cited By

Do HKong HTetali PLee JBailey B(2023)To Err is AI: Imperfect Interventions and Repair in a Conversational Agent Facilitating Group Chat DiscussionsProceedings of the ACM on Human-Computer Interaction10.1145/35795327:CSCW1(1-23)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579532
Shibuya YHamm ACerratto Pargman T(2022)Mapping HCI research methods for studying social media interactionComputers in Human Behavior10.1016/j.chb.2021.107131129:COnline publication date: 1-Apr-2022
https://dl.acm.org/doi/10.1016/j.chb.2021.107131
Koivunen SAla-Luopa SOlsson THaapakorpi A(2022)The March of Chatbots into Recruitment: Recruiters’ Experiences, Expectations, and Design OpportunitiesComputer Supported Cooperative Work (CSCW)10.1007/s10606-022-09429-431:3(487-516)Online publication date: 9-Jun-2022
https://doi.org/10.1007/s10606-022-09429-4
Show More Cited By

Index Terms

Analyzing the quality of information solicited from targeted strangers on social media
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

What is Twitter, a social network or a news media?
WWW '10: Proceedings of the 19th international conference on World wide web

Twitter, a microblogging service less than three years old, commands more than 41 million users as of July 2009 and is growing fast. Twitter users tweet about any topic within the 140-character limit and follow others to receive their tweets. The goal ...
Studying Politicians' Information Sharing on Social Media
CHIIR '19: Proceedings of the 2019 Conference on Human Information Interaction and Retrieval

In this study, we pair different perspectives on information sharing held by the information behaviour and computational social science communities. By reflecting on different conceptual models of sharing (two-actor vs three-actor model) and applying ...
Microscopic Description and Prediction of Information Diffusion in Social Media: Quantifying the Impact of Topical Interests
WWW '15 Companion: Proceedings of the 24th International Conference on World Wide Web

A number of recent studies of information diffusion in social media, both empirical and theoretical, have been inspired by viral propagation models derived from epidemiology. These studies model propagation of memes, i.e., pieces of information, between ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CSCW '13: Proceedings of the 2013 conference on Computer supported cooperative work

February 2013

1594 pages

ISBN:9781450313315

DOI:10.1145/2441776

General Chairs:
Amy Bruckman
Georgia Institute of Technology, USA
,
Scott Counts
Microsoft Research, USA
,
Program Chairs:
Cliff Lampe
University of Michigan, USA
,
Loren Terveen
University of Minnesota, USA

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 February 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CSCW '13

Sponsor:

SIGCHI

CSCW '13: Computer Supported Cooperative Work

February 23 - 27, 2013

Texas, San Antonio, USA

Acceptance Rates

Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

Upcoming Conference

CSCW '25

Sponsor:
sigchi

Computer-Supported Cooperative Work and Social Computing

October 18 - 22, 2025

Bergen , Norway

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
529
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Do HKong HTetali PLee JBailey B(2023)To Err is AI: Imperfect Interventions and Repair in a Conversational Agent Facilitating Group Chat DiscussionsProceedings of the ACM on Human-Computer Interaction10.1145/35795327:CSCW1(1-23)Online publication date: 16-Apr-2023
https://dl.acm.org/doi/10.1145/3579532
Shibuya YHamm ACerratto Pargman T(2022)Mapping HCI research methods for studying social media interactionComputers in Human Behavior10.1016/j.chb.2021.107131129:COnline publication date: 1-Apr-2022
https://dl.acm.org/doi/10.1016/j.chb.2021.107131
Koivunen SAla-Luopa SOlsson THaapakorpi A(2022)The March of Chatbots into Recruitment: Recruiters’ Experiences, Expectations, and Design OpportunitiesComputer Supported Cooperative Work (CSCW)10.1007/s10606-022-09429-431:3(487-516)Online publication date: 9-Jun-2022
https://doi.org/10.1007/s10606-022-09429-4
Jan SWang CZhang QWang G(2018)Analyzing Payment-Driven Targeted Q8A SystemsACM Transactions on Social Computing10.1145/32814491:3(1-21)Online publication date: 10-Dec-2018
https://dl.acm.org/doi/10.1145/3281449
Chiang CKasunic ASavage S(2018)Crowd CoachProceedings of the ACM on Human-Computer Interaction10.1145/32743062:CSCW(1-17)Online publication date: 1-Nov-2018
https://dl.acm.org/doi/10.1145/3274306
Jan SWang CZhang QWang GForte APrilla MVivacqua AMüller CRobert L(2018)Pay-per-QuestionProceedings of the 2018 ACM International Conference on Supporting Group Work10.1145/3148330.3148332(1-11)Online publication date: 7-Jan-2018
https://dl.acm.org/doi/10.1145/3148330.3148332
Wang TWang GWang BSambasivan DZhang ZLi XZheng HZhao B(2017)Value and Misinformation in Collaborative Investing PlatformsACM Transactions on the Web10.1145/302748711:2(1-32)Online publication date: 4-May-2017
https://dl.acm.org/doi/10.1145/3027487
Savage SMonroy-Hernandez AHöllerer TGergle DMorris MBjørn PKonstan J(2016)BotivistProceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing10.1145/2818048.2819985(813-822)Online publication date: 27-Feb-2016
https://dl.acm.org/doi/10.1145/2818048.2819985
Wang GWang TWang BSambasivan DZhang ZZheng HZhao BCosley DForte ACiolfi LMcDonald D(2015)Crowds on Wall StreetProceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing10.1145/2675133.2675144(17-30)Online publication date: 28-Feb-2015
https://dl.acm.org/doi/10.1145/2675133.2675144
Gu XKim SCohen MGrunske LWhalen M(2015)"What parts of your apps are loved by users?"Proceedings of the 30th IEEE/ACM International Conference on Automated Software Engineering10.1109/ASE.2015.57(760-770)Online publication date: 9-Nov-2015
https://dl.acm.org/doi/10.1109/ASE.2015.57
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten