Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/2818048.2819979acmconferencesArticle/Chapter ViewAbstractPublication PagescscwConference Proceedingsconference-collections
research-article

Personality Matters: Balancing for Personality Types Leads to Better Outcomes for Crowd Teams

Published: 27 February 2016 Publication History

Abstract

When personalities clash, teams operate less effectively. Personality differences affect face-to-face collaboration and may lower trust in virtual teams. For relatively short-lived assignments, like those of online crowdsourcing, personality matching could provide a simple, scalable strategy for effective team formation. However, it is not clear how (or if) personality differences affect teamwork in this novel context where the workforce is more transient and diverse. This study examines how personality compatibility in crowd teams affects performance and individual perceptions. Using the DISC personality test, we composed 14 five-person teams (N=70) with either a harmonious coverage of personalities (balanced) or a surplus of leader-type personalities (imbalanced). Results show that balancing for personality leads to significantly better performance on a collaborative task. Balanced teams exhibited less conflict and their members reported higher levels of satisfaction and acceptance. This work demonstrates a simple personality matching strategy for forming more effective teams in crowdsourcing contexts.

References

[1]
Paul André, Robert E. Kraut, and Aniket Kittur. 2014. Effects of Simultaneous and Sequential Work Structures on Distributed Collaborative Interdependent Tasks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, 139–148.
[2]
R. Meredith Belbin. 2010. Management Teams: Why They Succeed or Fail. Oxford: Butterworth Heinemann, 3rd ed.
[3]
Michael S. Bernstein, Joel Brandt, Robert C. Miller, and David R. Karger. 2011. Crowds in Two Seconds: Enabling Realtime Crowd-powered Interfaces. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, 33–42.
[4]
Paul D. Bliese. 2000. Within-group agreement, non-independence, and reliability: Implications for data aggregation and analysis. In Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions, Steve W. J. Klein, Katherine J.; Kozlowski (Ed.). US: Jossey-Bass, 349–381.
[5]
Robert Bolton and Dorothy Grover Bolton. 2009. People styles at work: Making bad relationships good and good relationships better (second ed.). New York, NY: AMACOM.
[6]
Kevin Chai, Vidyasagar Potdar, and Tharam Dillon. 2009. Content Quality Assessment Related Frameworks for Social Media. In Proceedings of the International Conference on Computational Science and Its Applications: Part II (ICCSA '09). Springer-Verlag, Berlin, Heidelberg, 791–805.
[7]
R. Dennis Cook. 1977. Detection of Influential Observations in Linear Regression. Technometrics (American Statistical Association) 19, 1 (1977), 15–18.
[8]
Paul T. Jr. Costa and Robert R. McCrae. 1992. Revised NEO Personality (NEO-PI-R) and NEO Five-Factor Inventory (NEO-FFI) professional manual. Psychological Assessment Resources.
[9]
Janina Diekmann and Cornelius J. Knig. (2015). Personality testing in personnel selection: Love it? Leave it? Understand it! In Employee recruitment, selection, and assessment: Contemporary issues for theory and practice, J. Oostrom I. Nikolaou (Ed.). Hove, UK: Psychology Press.
[10]
Steven Dow, Julie Fortuna, Dan Schwartz, Beth Altringer, Daniel Schwartz, and Scott Klemmer. 2011. Prototyping Dynamics: Sharing Multiple Designs Improves Exploration, Group Rapport, and Results. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, 2807–2816.
[11]
Steven Dow, Anand Kulkarni, Scott Klemmer, and Björn Hartmann. 2012. Shepherding the Crowd Yields Better Work. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work (CSCW '12). ACM, New York, 1013–1022.
[12]
Julie S. Downs, Mandy B. Holbrook, Steve Sheng, and Lorrie Faith Cranor. 2010. Are Your Participants Gaming the System?: Screening Mechanical Turk Workers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 2399–2402.
[13]
James E. Driskell, Gerald F. Goodwin, Eduardo Salas, and Patrick Gavan O'Shea. 2006. What makes a good team player? Personality and team effectiveness. Group Dynamics: Theory, Research, and Practice 10, 4 (2006), 249–271.
[14]
Serge Egelman, Ed H. Chi, and Steven Dow. 2014. Crowdsourcing in HCI Research. In Ways of Knowing in HCI, Judith S. Olson and Wendy A. Kellogg (Eds.). Springer New York, 267–289.
[15]
David Engel, Anita Williams Woolley, Lisa X. Jing, Christopher F. Chabris, and Thomas W. Malone. 2014. Reading the Mind in the Eyes or Reading between the Lines? Theory of Mind Predicts Collective Intelligence Equally Well Online and Face-To-Face. PLoS One 16;9, 12 (dec 2014), e115212.
[16]
Enrique Estellés-Arolas and Fernando González-Ladrón-De-Guevara. 2012. Towards an Integrated Crowdsourcing Definition. Journal of Information Science 38, 2 (April 2012), 189–200.
[17]
Hans Jürgen Eysenck. 1975. The inequality of man. EdITS Publishers.
[18]
Adrian Furnham. 1999. The Psychology of Behaviour at Work: the individual in the organization. Psychology Press.
[19]
Kimberly Furumo, Emmeline de Pillis, and David Green. 2009. Personality influences trust differently in virtual and face to face teams. International Journal of Human Resources Development and Management 9, 1 (2009), 36–58.
[20]
James L. Gibson, John M. Ivancevich, James H. Donnelly, and Robert Konopaske. 2009. Organizations: Behavior, structure, process (13th ed.). New York: McGraw-Hill.
[21]
Ann Gilley. 2006. The manager as change leader. Westport: Praeger.
[22]
Jerry W. Gilley and Ann Gilley. 2003. Strategically integrated HRD: Partnering to maximize organizational performance. Cambridge, MA: Perseus Books.
[23]
Jerry W. Gilley, M. Lane Morris, Alina M. Waite, Tabitha Coates, and Abigail Veliquette. 2010. Integrated Theoretical Model for Building Effective Teams. Advances in Developing Human Resources 12, 1 (2010), 7–28.
[24]
Gagan Goel, Afshin Nikzad, and Adish Singla. 2014. Allocating Tasks to Workers with Matching Constraints: Truthful Mechanisms for Crowdsourcing Markets. In Proceedings of the 23rd International Conference on World Wide Web (WWW '14 Companion). International World Wide Web Conferences Steering Committee, Geneva, Switzerland, 279–280.
[25]
Joseph F Hair, William C. Black, Barry J. Babin, and Rolph E. Anderson. 2009. Advanced Diagnostics for Multiple Regression. In Multivariate Data Analysis (7th Edition). Pearson Prentice Hall Publishing.
[26]
Terry Halfhill, Eric Sundstrom, Jessica Lahner, Wilma Calderone, and Tjai M. Nielsen. 2005. Group Personality Composition and Group Effectiveness: An Integrative Review of Empirical Research. Small Group Research 36, 1 (2005), 83–105.
[27]
Bob Hoffman. 2012. The Ad Contrarian. Fowler Digital Services. ebook. (2012).
[28]
John Holland. 1973. Making vocational choices: a theory of careers. Prentice Hall.
[29]
Judith A. Holton. 2001. Building trust and collaboration in a virtual team. Team Performance Management: An International Journal 7, 3/4 (2001), 36–47.
[30]
John Joseph Horton and Lydia B. Chilton. 2010. The Labor Economics of Paid Crowdsourcing. In Proceedings of the 11th ACM Conference on Electronic Commerce (EC '10). ACM, New York, 209–218.
[31]
Mokter Hossain. 2012. Users' motivation to participate in online crowdsourcing platforms. In International Conference on Innovation Management and Technology Research. 310–315.
[32]
David C. Howell. 1992. Statistical Methods for Psychology. Belmont: Duxbury Press.
[33]
Joshua Introne, Robert Laubacher, Gary Olson, and Thomas Malone. 2011. The Climate CoLab: Large scale model-based collaborative planning. In 2011 International Conference on Collaboration Technologies and Systems. 40–47.
[34]
Panagiotis G. Ipeirotis. 2010. Analyzing the Amazon Mechanical Turk Marketplace. XRDS 17, 2 (Dec. 2010), 16–21.
[35]
Panagiotis G. Ipeirotis, Foster Provost, and Jing Wang. 2010. Quality Management on Amazon Mechanical Turk. In Proceedings of the ACM SIGKDD Workshop on Human Computation (HCOMP '10). ACM, New York, 64–67.
[36]
Lilly C. Irani and M. Six Silberman. 2013. Turkopticon: Interrupting Worker Invisibility in Amazon Mechanical Turk. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, 611–620.
[37]
Audun Jøsang, Roslan Ismail, and Colin Boyd. 2007. A survey of trust and reputation systems for online service provision. Decis. Support Syst. 43, 2 (March 2007), 618–644.
[38]
David R. Karger, Sewoong Oh, and Devavrat Shah. 2011. Budget-Optimal Task Allocation for Reliable Crowdsourcing Systems. CoRR abs/1110.3564 (2011).
[39]
Gabriella Kazai, Jaap Kamps, and Natasa Milic-Frayling. 2011. Worker Types and Personality Traits in Crowdsourcing Relevance Labels. In Proceedings of the 20th ACM International Conference on Information and Knowledge Management (CIKM '11). ACM, New York, 1941–1944.
[40]
Gabriella Kazai, Jaap Kamps, and Natasa Milic-Frayling. 2012. The Face of Quality in Crowdsourcing Relevance Labels: Demographics, Personality and Labeling Accuracy. In Proceedings of the 21st ACM International Conference on Information and Knowledge Management (CIKM '12). ACM, New York, 2583–2586.
[41]
Aniket Kittur. 2010. Crowdsourcing, Collaboration and Creativity. XRDS 17, 2 (Dec. 2010), 22–26.
[42]
Aniket Kittur, Jeffrey V. Nickerson, Michael Bernstein, Elizabeth Gerber, Aaron Shaw, John Zimmerman, Matt Lease, and John Horton. 2013. The Future of Crowd Work. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work (CSCW '13). ACM, New York, 1301–1318.
[43]
Aniket Kittur, Bryan Pendleton, and Robert E. Kraut. 2009. Herding the Cats: The Influence of Groups in Coordinating Peer Production. In Proceedings of the 5th International Symposium on Wikis and Open Collaboration (WikiSym '09). ACM, New York, NY, USA, Article 7, 9 pages.
[44]
Aniket Kittur, Boris Smus, Susheel Khamkar, and Robert E. Kraut. 2011. CrowdForge: Crowdsourcing Complex Work. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, 43–52.
[45]
David A. Kravitz and Barbara Martin. 1986. Ringelmann Rediscovered: The Original Article. Journal of Personality and Social Psychology 50, 5 (May 1986), 936–941.
[46]
Chinmay Kulkarni, Julia Cambre, Yasmine Kotturi, Michael S. Bernstein, and Scott R. Klemmer. 2015. Talkabout: Making Distance Matter with Small Groups in Massive Classes. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15). ACM, New York, 1116–1128.
[47]
James M. LeBreton and Jenell L. Senter. 2008. Answers to 20 Questions About Interrater Reliability and Interrater Agreement. Organizational Research Methods 11, 4 (2008), 815–852.
[48]
Rensis Likert. 1969. The human organization. Mcgraw-hill: New york.
[49]
William Moulton Marston. 1979. Emotions of Normal People. Persona Press Inc.
[50]
John Mathieu, M. Travis Maynard, Tamm Rapp, and Lucy Gilson. 2008. Team Effectiveness 1997-2007: A Review of Recent Advancements and a Glimpse Into the Future. Journal of Management 34, 3 (2008), 410–476.
[51]
George A. Miller. 1956. The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review 63, 2 (1956), 8197.
[52]
Eric Molleman. 2005. Diversity in Demographic Characteristics, Abilities and Personality Traits: Do Faultlines Affect Team Functioning? Group Decision and Negotiation 14, 3 (2005), 173–193.
[53]
Richard L. Moreland, John M. Levine, and Melissa L. Wingert. 1996. Creating the ideal group: Composition effects at work. In Understanding group behavior Vol. 2: Small group processes and interpersonal relations. Hillsdale, NJ, England: Lawrence Erlbaum Associates, Inc, 11–35.
[54]
Paul M. Muchinsky and Carlyn J. Monahan. 1987. What is person-environment congruence? Supplementary versus complementary models of fit. Journal of Vocational Behavior 31, 3 (1987), 268 – 277.
[55]
Michael Muller, Kate Ehrlich, Tara Matthews, Adam Perer, Inbal Ronen, and Ido Guy. 2012. Diversity Among Enterprise Online Communities: Collaborating, Teaming, and Innovating Through Social Media. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, 2815–2824.
[56]
George A. Neuman, Stephen H. Wagner, and Neil D. Christiansen. 1999. The Relationship between Work-Team Personality Composition and the Job Performance of Teams. Group & Organization Management 24, 1 (1999), 28–45.
[57]
Gary M. Olson and Judith S. Olson. 2000. Distance Matters. Hum.-Comput. Interact. 15, 2 (Sept. 2000), 139–178.
[58]
Cheong Ha Park, KyoungHee Son, Joon Hyub Lee, and Seok-Hyung Bae. 2013. Crowd vs. Crowd: Large-scale Cooperative Design Through Open Team Competition. In Proceedings of the 2013 Conference on Computer Supported Cooperative Work (CSCW '13). ACM, New York, 1275–1284.
[59]
Reinhard Pekrun, Thomas Goetz, Anne C Frenzel, Petra Barchfeld, and Raymond P. Perry. 2011. Measuring emotions in students learning and performance: The Achievement Emotions Questionnaire (AEQ). Contemporary Educational Psychology 36, 1 (2011), 36 – 48. //dx.doi.org/10.1016/j.cedpsych.2010.10.002
[60]
Lisa Hope Pelled, Kathleen M. Eisenhardt, and Katherine R. Xin. 1999. Exploring the Black Box: An Analysis of Work Group Diversity, Conflict, and Performance. Administrative Science Quarterly 44, 1 (1999), pp. 1–28. http://www.jstor.org/stable/2667029
[61]
Aditya Ramesh, Aditya Parameswaran, Hector Garcia-Molina, and Neoklis Polyzotis. 2012. Identifying Reliable Workers Swiftly. Technical report.
[62]
Daniela Retelny, Sébastien Robaszkiewicz, Alexandra To, Walter S. Lasecki, Jay Patel, Negar Rahmati, Tulsee Doshi, Melissa Valentine, and Michael S. Bernstein. 2014. Expert Crowdsourcing with Flash Teams. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, 75–85.
[63]
James H. Reynierse, Dennis Ackerman, Alexis A. Fink, and John B. Harker. 2000. The Effects of Personality and Management Role on Perceived Values in Business Settings. International Journal of Value-Based Management 13, 1 (2000), 1–13.
[64]
Joel Ross, Lilly Irani, M. Six Silberman, Andrew Zaldivar, and Bill Tomlinson. 2010. Who Are the Crowdworkers?: Shifting Demographics in Mechanical Turk. In CHI '10 Extended Abstracts on Human Factors in Computing Systems (CHI EA '10). ACM, New York, 2863–2872.
[65]
Niloufar Salehi, Lilly C. Irani, Michael S. Bernstein, Ali Alkhatib, Eva Ogbe, Kristy Milland, and Clickhappier. 2015. We Are Dynamo: Overcoming Stalling and Friction in Collective Action for Crowd Workers. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, 1621–1630.
[66]
Kai Sassenberg, Kai J. Jonas, James Y. Shah, and Paige C. Brazy. 2007. Why some groups just feel better: The regulatory fit of group power. Journal of Personality and Social Psychology 2 (2007), 249–267.
[67]
Leonard R. Sayles and George Straus. 1966. Human behaviour in organizations. Englewood Cliffs, New Jersey: Prentice Hall.
[68]
James Surowiecki. 2005. The Wisdom of Crowds. Anchor.
[69]
Christian Terwiesch and Karl Ulrich. 2009. Innovation Tournaments: Creating and Selecting Exceptional Opportunities. Harvard Business Press.
[70]
Bruce W. Tuckman and Mary Ann C. Jenson. 1977. Stages of small-group development revisited. Group & Organization Management 2 (1977), 419–427.
[71]
Judy Whichard and Nathalie L. Kees. 2006. Manager as facilitator. Hartford, CT: Praeger.
[72]
Jacob Whitehil, Ting-fan Wu, Jacob Bergsma, Javier R. Movellan, and Paul L. Ruvolo. 2009. Whose Vote Should Count More: Optimal Integration of Labels from Labelers of Unknown Expertise. In Advances in Neural Information Processing Systems 22, Y. Bengio, D. Schuurmans, J.D. Lafferty, C.K.I. Williams, and A. Culotta (Eds.). Curran Associates, Inc., 2035–2043.
[73]
Anita Williams Woolley, Christopher F. Chabris, Alex Pentland, Nada Hashmi, and Thomas W. Malone. 2010. Evidence for a Collective Intelligence Factor in the Performance of Human Groups. Science 330, 6004 (2010), 686–688.
[74]
Man-Ching Yuen, Irwin King, and Kwong-Sak Leung. 2014. TaskRec: A Task Recommendation Framework in Crowdsourcing Systems. Neural Processing Letters (2014), 1–16.
[75]
Isik Zeytinoglu. 2005. Satisfied Workers, Retained Workers: Effects of Work and Work Environment on Homecare Workers' Job Satisfaction, Stress, Physical Health, and Retention. Technical Report RC1-0965-06. Canadian Health Services Research Foundation.
[76]
Haiyi Zhu, Steven P. Dow, Robert E. Kraut, and Aniket Kittur. 2014. Reviewing Versus Doing: Learning and Performance in Crowd Assessment. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '14). ACM, New York, NY, USA, 1445–1455.

Cited By

View all
  • (2024)Forming Shared Interest Pods: Barriers to Self-Assembly of Interest-Based Small Groups, and Dynamics of Retaining and Giving up Control to Find Collective FitProceedings of the ACM on Human-Computer Interaction10.1145/36869848:CSCW2(1-50)Online publication date: 8-Nov-2024
  • (2024)The State of Pilot Study Reporting in Crowdsourcing: A Reflection on Best Practices and GuidelinesProceedings of the ACM on Human-Computer Interaction10.1145/36410238:CSCW1(1-45)Online publication date: 26-Apr-2024
  • (2024)Meeting Effectiveness and Inclusiveness: Large-scale Measurement, Identification of Key Features, and Prediction in Real-world Remote MeetingsProceedings of the ACM on Human-Computer Interaction10.1145/36373708:CSCW1(1-39)Online publication date: 26-Apr-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
CSCW '16: Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing
February 2016
1866 pages
ISBN:9781450335928
DOI:10.1145/2818048
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 February 2016

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Crowsourcing
  2. personality-based balancing
  3. team formation

Qualifiers

  • Research-article

Funding Sources

  • National Science Foundation (NSF)
  • Luxembourg National Research Fund (FNR)

Conference

CSCW '16
Sponsor:
CSCW '16: Computer Supported Cooperative Work and Social Computing
February 27 - March 2, 2016
California, San Francisco, USA

Acceptance Rates

CSCW '16 Paper Acceptance Rate 142 of 571 submissions, 25%;
Overall Acceptance Rate 2,235 of 8,521 submissions, 26%

Upcoming Conference

CSCW '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)484
  • Downloads (Last 6 weeks)46
Reflects downloads up to 19 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Forming Shared Interest Pods: Barriers to Self-Assembly of Interest-Based Small Groups, and Dynamics of Retaining and Giving up Control to Find Collective FitProceedings of the ACM on Human-Computer Interaction10.1145/36869848:CSCW2(1-50)Online publication date: 8-Nov-2024
  • (2024)The State of Pilot Study Reporting in Crowdsourcing: A Reflection on Best Practices and GuidelinesProceedings of the ACM on Human-Computer Interaction10.1145/36410238:CSCW1(1-45)Online publication date: 26-Apr-2024
  • (2024)Meeting Effectiveness and Inclusiveness: Large-scale Measurement, Identification of Key Features, and Prediction in Real-world Remote MeetingsProceedings of the ACM on Human-Computer Interaction10.1145/36373708:CSCW1(1-39)Online publication date: 26-Apr-2024
  • (2024)Burnout in Cybersecurity Incident Responders: Exploring the Factors that Light the FireProceedings of the ACM on Human-Computer Interaction10.1145/36373048:CSCW1(1-35)Online publication date: 26-Apr-2024
  • (2024)Decision-Making Support in Choosing Online Teacher Assistants for Evaluating Assignments Based on Belbin's Behavioral Roles2024 4th International Conference on Technology Enhanced Learning in Higher Education (TELE)10.1109/TELE62556.2024.10605694(01-04)Online publication date: 20-Jun-2024
  • (2024)The effect of autonomous team role selection in flexible projectsComputers and Industrial Engineering10.1016/j.cie.2024.110079190:COnline publication date: 9-Jul-2024
  • (2024)The Gray Nine and Parallel Personality Patterns: Big Five, Dark Tetrad, and a “Well-Rounded Personality”Integrative Psychological and Behavioral Science10.1007/s12124-024-09842-yOnline publication date: 4-May-2024
  • (2023)Composing Team Compositions: An Examination of Instructors' Current Algorithmic Team Formation PracticesProceedings of the ACM on Human-Computer Interaction10.1145/36100967:CSCW2(1-24)Online publication date: 4-Oct-2023
  • (2023)Knowing Unknown Teammates: Exploring Anonymity and Explanations in a Teammate Information-Sharing Recommender SystemProceedings of the ACM on Human-Computer Interaction10.1145/36100757:CSCW2(1-34)Online publication date: 4-Oct-2023
  • (2023)TONIC: A teamwork simulator and digital twin for organizational innovation challengesProceedings of the 16th International Conference on PErvasive Technologies Related to Assistive Environments10.1145/3594806.3596549(584-588)Online publication date: 5-Jul-2023
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media