Nothing Special   »   [go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/7n4xd.html
   My bibliography  Save this paper

Measuring Norms: Assessing the threat of Social Desirability Bias to the Bicchieri and Xiao elicitation method

Author

Listed:
  • Bogliacino, Francesco

    (Universidad Nacional de Colombia)

  • Aycinena, Diego

    (Universidad del Rosario)

  • Kimbrough, Erik
Abstract
Bicchieri and Xiao (2009) pioneered a method for eliciting normative expectations. Using a two-step procedure, the method first elicits non-incentivized reports of subjects' Personal Normative Beliefs regarding the most appropriate action from a set of possible options. In the second step, subjects are incentivized to predict the distribution of beliefs reported by others in the first step, thus capturing their normative expectations. However, the lack of incentives in the first step of the method introduces the potential for belief falsification. One possible motive for falsification is Social Desirability Bias. We explain how such bias could, in theory, influence measurement of norms under this method and report pre-registered experiments designed to induce biased disclosure of beliefs in the first step. Our experiments vary the threat of sanctioning by third-party monitors: in one treatment, respondents may wish to falsify their reported beliefs about the norm in a variant of the dictator game. Pre-registered results show a relatively small and non-significant effect of SDB. We explore the underlying conditions that make SDB more likely to threaten the identification of normative expectations. Exploratory results suggest an important role of awareness of the incentives to misreport in the first stage -the information asymmetry between respondents and third parties in our design. Researchers who plan to use this method to measure sensitive local norms should be aware of the conditions under which this potential bias is likely to materialize and design their studies to minimize it.

Suggested Citation

  • Bogliacino, Francesco & Aycinena, Diego & Kimbrough, Erik, 2024. "Measuring Norms: Assessing the threat of Social Desirability Bias to the Bicchieri and Xiao elicitation method," SocArXiv 7n4xd, Center for Open Science.
    • Handle: RePEc:osf:socarx:7n4xd
    DOI: 10.31219/osf.io/7n4xd
    as

    Download full text from publisher

    File URL: https://osf.io/download/660ad5b6219e710fcbf6a7cf/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/7n4xd?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hoffman Elizabeth & McCabe Kevin & Shachat Keith & Smith Vernon, 1994. "Preferences, Property Rights, and Anonymity in Bargaining Games," Games and Economic Behavior, Elsevier, vol. 7(3), pages 346-380, November.
    2. Armin Falk & Ernst Fehr & Urs Fischbacher, 2005. "Driving Forces Behind Informal Sanctions," Econometrica, Econometric Society, vol. 73(6), pages 2017-2030, November.
    3. Stefano DellaVigna & John A. List & Ulrike Malmendier, 2012. "Testing for Altruism and Social Pressure in Charitable Giving," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 127(1), pages 1-56.
    4. Erik O. Kimbrough & Alexander Vostroknutov, 2016. "Norms Make Preferences Social," Journal of the European Economic Association, European Economic Association, vol. 14(3), pages 608-638, June.
    5. Hunt Allcott & Dmitry Taubinsky, 2015. "Evaluating Behaviorally Motivated Policy: Experimental Evidence from the Lightbulb Market," American Economic Review, American Economic Association, vol. 105(8), pages 2501-2538, August.
    6. Ben Greiner, 2015. "Subject pool recruitment procedures: organizing experiments with ORSEE," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 1(1), pages 114-125, July.
    7. Andrew Schotter & Isabel Trevino, 2014. "Belief Elicitation in the Laboratory," Annual Review of Economics, Annual Reviews, vol. 6(1), pages 103-128, August.
    8. Judd B. Kessler & Stephen Leider, 2012. "Norms and Contracting," Management Science, INFORMS, vol. 58(1), pages 62-77, January.
    9. Chang, Daphne & Chen, Roy & Krupka, Erin, 2019. "Rhetoric matters: A social norms explanation for the anomaly of framing," Games and Economic Behavior, Elsevier, vol. 116(C), pages 158-178.
    10. D'Adda, Giovanna & Drouvelis, Michalis & Nosenzo, Daniele, 2016. "Norm elicitation in within-subject designs: Testing for order effects," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 62(C), pages 1-7.
    11. Tanjim Hossain & Ryo Okui, 2013. "The Binarized Scoring Rule," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 80(3), pages 984-1001.
    12. Todd L. Cherry & Peter Frykblom & Jason F. Shogren, 2002. "Hardnose the Dictator," American Economic Review, American Economic Association, vol. 92(4), pages 1218-1221, September.
    13. Charness, Gary & Gneezy, Uri & Rasocha, Vlastimil, 2021. "Experimental methods: Eliciting beliefs," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 234-256.
    14. Geoffrey Castillo & Lawrence Choo & Veronika Grimm, 2022. "Do different people report the same social norms?," Working Papers hal-03901206, HAL.
    15. Erkut, Hande & Nosenzo, Daniele & Sefton, Martin, 2015. "Identifying social norms using coordination games: Spectators vs. stakeholders," Economics Letters, Elsevier, vol. 130(C), pages 28-31.
    16. Forsythe Robert & Horowitz Joel L. & Savin N. E. & Sefton Martin, 1994. "Fairness in Simple Bargaining Experiments," Games and Economic Behavior, Elsevier, vol. 6(3), pages 347-369, May.
    17. Cristina Bicchieri, 2010. "Norms, preferences, and conditional behavior," Politics, Philosophy & Economics, , vol. 9(3), pages 297-313, August.
    18. James Andreoni & B. Douglas Bernheim, 2009. "Social Image and the 50-50 Norm: A Theoretical and Experimental Analysis of Audience Effects," Econometrica, Econometric Society, vol. 77(5), pages 1607-1636, September.
    19. Diego Aycinena & Lucas Rentschler & Benjamin Beranek & Jonathan F. Schulz, 2022. "Social norms and dishonesty across societies," Decision Analysis, INFORMS, vol. 119(31), pages 2120138119-, August.
    20. John A. List & Robert P. Berrens & Alok K. Bohara & Joe Kerkvliet, 2004. "Examining the Role of Social Isolation on Stated Preferences," American Economic Review, American Economic Association, vol. 94(3), pages 741-752, June.
    21. Erin L. Krupka & Roberto A. Weber, 2013. "Identifying Social Norms Using Coordination Games: Why Does Dictator Game Sharing Vary?," Journal of the European Economic Association, European Economic Association, vol. 11(3), pages 495-524, June.
    22. Glenn W. Harrison & Richard D. Phillips, 2014. "Subjective Beliefs and Statistical Forecasts of Financial Risks: The Chief Risk Officer Project," Palgrave Macmillan Books, in: Torben Juul Andersen (ed.), Contemporary Challenges in Risk Management, chapter 7, pages 163-202, Palgrave Macmillan.
    23. Bicchieri, Cristina & Dimant, Eugen & Sonderegger, Silvia, 2023. "It's not a lie if you believe the norm does not apply: Conditional norm-following and belief distortion," Games and Economic Behavior, Elsevier, vol. 138(C), pages 321-354.
    24. Jonathan de Quidt & Johannes Haushofer & Christopher Roth, 2018. "Measuring and Bounding Experimenter Demand," American Economic Review, American Economic Association, vol. 108(11), pages 3266-3302, November.
    25. Karl Schlag & James Tremewan & Joël Weele, 2015. "A penny for your thoughts: a survey of methods for eliciting beliefs," Experimental Economics, Springer;Economic Science Association, vol. 18(3), pages 457-490, September.
    26. Steven D. Levitt & John A. List, 2007. "What Do Laboratory Experiments Measuring Social Preferences Reveal About the Real World?," Journal of Economic Perspectives, American Economic Association, vol. 21(2), pages 153-174, Spring.
    27. Guala, Francesco & Mittone, Luigi & Ploner, Matteo, 2013. "Group membership, team preferences, and expectations," Journal of Economic Behavior & Organization, Elsevier, vol. 86(C), pages 183-190.
    28. Schmidt, Robert & Schwieren, Christiane & Sproten, Alec N., 2020. "Norms in the lab: Inexperienced versus experienced participants," Journal of Economic Behavior & Organization, Elsevier, vol. 173(C), pages 239-255.
    29. Mariana Blanco & Dirk Engelmann & Alexander Koch & Hans-Theo Normann, 2010. "Belief elicitation in experiments: is there a hedging problem?," Experimental Economics, Springer;Economic Science Association, vol. 13(4), pages 412-438, December.
    30. John A. List, 2007. "On the Interpretation of Giving in Dictator Games," Journal of Political Economy, University of Chicago Press, vol. 115(3), pages 482-493.
    31. Ivar Krumpal, 2013. "Determinants of social desirability bias in sensitive surveys: a literature review," Quality & Quantity: International Journal of Methodology, Springer, vol. 47(4), pages 2025-2047, June.
    32. John A. List, 2006. "The Behavioralist Meets the Market: Measuring Social Preferences and Reputation Effects in Actual Transactions," Journal of Political Economy, University of Chicago Press, vol. 114(1), pages 1-37, February.
    33. Gächter, Simon & Gerhards, Leonie & Nosenzo, Daniele, 2017. "The importance of peers for compliance with norms of fair sharing," European Economic Review, Elsevier, vol. 97(C), pages 72-86.
    34. Oxoby, Robert J. & Spraggon, John, 2008. "Mine and yours: Property rights in dictator games," Journal of Economic Behavior & Organization, Elsevier, vol. 65(3-4), pages 703-713, March.
    35. Alexander W. Cappelen & Astri Drange Hole & Erik Ø Sørensen & Bertil Tungodden, 2007. "The Pluralism of Fairness Ideals: An Experimental Approach," American Economic Review, American Economic Association, vol. 97(3), pages 818-827, June.
    36. Leonardo Bursztyn & Alessandra L. González & David Yanagizawa-Drott, 2020. "Misperceived Social Norms: Women Working Outside the Home in Saudi Arabia," American Economic Review, American Economic Association, vol. 110(10), pages 2997-3029, October.
    37. Diego Aycinena & Lucas Rentschler & Benjamin Beranek & Jonathan F. Schulz, 2022. "Social norms and dishonesty across societies," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 119(31), pages 2120138119-, August.
    38. Kimbrough, Erik O. & Vostroknutov, Alexander, 2018. "A portable method of eliciting respect for social norms," Economics Letters, Elsevier, vol. 168(C), pages 147-150.
    39. Cristina Bicchieri & Alessandro Sontuoso, 2017. "Game-Theoretic Accounts of Social Norms. The Role of Normative Expectations," PPE Working Papers 0011, Philosophy, Politics and Economics, University of Pennsylvania.
    40. Daniel Zizzo, 2010. "Experimenter demand effects in economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 13(1), pages 75-98, March.
    41. Cloward, Karisa, 2014. "False Commitments: Local Misrepresentation and the International Norms Against Female Genital Mutilation and Early Marriage," International Organization, Cambridge University Press, vol. 68(3), pages 495-526, July.
    42. Bogliacino, Francesco & Charris, Rafael & Gómez, Camilo & Montealegre, Felipe, 2024. "Negative economic shocks and the compliance to social norms," Judgment and Decision Making, Cambridge University Press, vol. 19, pages 1-1, January.
    43. López-Pérez, Raúl, 2008. "Aversion to norm-breaking: A model," Games and Economic Behavior, Elsevier, vol. 64(1), pages 237-267, September.
    44. Romano, Joseph P. & Wolf, Michael, 2016. "Efficient computation of adjusted p-values for resampling-based stepdown multiple testing," Statistics & Probability Letters, Elsevier, vol. 113(C), pages 38-40.
    45. David Danz & Lise Vesterlund & Alistair J. Wilson, 2022. "Belief Elicitation and Behavioral Incentive Compatibility," American Economic Review, American Economic Association, vol. 112(9), pages 2851-2883, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Catherine C. Eckel & Hanna G. Hoover & Erin L. Krupka & Nishita Sinha & Rick K. Wilson, 2023. "Using social norms to explain giving behavior," Experimental Economics, Springer;Economic Science Association, vol. 26(5), pages 1115-1141, November.
    2. Bogliacino, Francesco & Aycinena, Diego & Kimbrough, Erik, 2024. "Eliciting normative expectations with coordination games allowing for neutral report," SocArXiv y3fha, Center for Open Science.
    3. Howe, E. Lance & Murphy, James J. & Gerkey, Drew & Stoddard, Olga B. & West, Colin Thor, 2023. "Sharing, social norms, and social distance: Experimental evidence from Russia and Western Alaska," Journal of Economic Behavior & Organization, Elsevier, vol. 213(C), pages 345-358.
    4. Erik O. Kimbrough & Erin L. Krupka & Rajnish Kumar & Jennifer M. Murray & Abhijit Ramalingam & Sharon Sánchez-Franco & Olga L. Sarmiento & Frank Kee & Ruth F. Hunter, 2024. "On the stability of norms and norm-following propensity: a cross-cultural panel study with adolescents," Experimental Economics, Springer;Economic Science Association, vol. 27(2), pages 351-378, April.
    5. Emin Karagözoğlu & Elif Tosun, 2022. "Endogenous Game Choice and Giving Behavior in Distribution Games," Games, MDPI, vol. 13(6), pages 1-32, November.
    6. McBride, Michael & Ridinger, Garret, 2021. "Beliefs also make social-norm preferences social," Journal of Economic Behavior & Organization, Elsevier, vol. 191(C), pages 765-784.
    7. Traub, Stefan & Schwaninger, Manuel & Paetzel, Fabian & Neuhofer, Sabine, 2023. "Evidence on need-sensitive giving behavior: An experimental approach to the acknowledgment of needs," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 105(C).
    8. Bicchieri, Cristina & Dimant, Eugen & Gächter, Simon & Nosenzo, Daniele, 2022. "Social proximity and the erosion of norm compliance," Games and Economic Behavior, Elsevier, vol. 132(C), pages 59-72.
    9. Ahrens, Steffen & Bosch-Rosa, Ciril, 2023. "Motivated beliefs, social preferences, and limited liability in financial decision-Making," Journal of Banking & Finance, Elsevier, vol. 154(C).
    10. Gächter, Simon & Gerhards, Leonie & Nosenzo, Daniele, 2017. "The importance of peers for compliance with norms of fair sharing," European Economic Review, Elsevier, vol. 97(C), pages 72-86.
    11. Anna Dreber & Tore Ellingsen & Magnus Johannesson & David Rand, 2013. "Do people care about social context? Framing effects in dictator games," Experimental Economics, Springer;Economic Science Association, vol. 16(3), pages 349-371, September.
    12. Kimbrough, Erik O. & Vostroknutov, Alexander, 2018. "A portable method of eliciting respect for social norms," Economics Letters, Elsevier, vol. 168(C), pages 147-150.
    13. Breitmoser, Yves & Vorjohann, Pauline, 2018. "Welfare-Based Altruism," Rationality and Competition Discussion Paper Series 89, CRC TRR 190 Rationality and Competition.
    14. Ennio Bilancini & Leonardo Boncinelli & Valerio Capraro & Tatiana Celadin & Roberto Di Paolo, 2020. ""Do the right thing" for whom? An experiment on ingroup favouritism, group assorting and moral suasion," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 15(2), pages 182-192, March.
    15. repec:cup:judgdm:v:15:y:2020:i:2:p:182-192 is not listed on IDEAS
    16. Jan Stoop, 2014. "From the lab to the field: envelopes, dictators and manners," Experimental Economics, Springer;Economic Science Association, vol. 17(2), pages 304-313, June.
    17. Breitmoser, Yves & Vorjohann, Pauline, 2022. "Fairness-based Altruism," Center for Mathematical Economics Working Papers 666, Center for Mathematical Economics, Bielefeld University.
    18. Luca Zarri, 2013. "Altruism," Chapters, in: Luigino Bruni & Stefano Zamagni (ed.), Handbook on the Economics of Reciprocity and Social Enterprise, chapter 1, pages 9-19, Edward Elgar Publishing.
    19. Francesco Fallucchi & Daniele Nosenzo, 2022. "The coordinating power of social norms," Experimental Economics, Springer;Economic Science Association, vol. 25(1), pages 1-25, February.
    20. Guerra, Alice & Zhuravleva, Tatyana, 2021. "Do bystanders react to bribery?," Journal of Economic Behavior & Organization, Elsevier, vol. 185(C), pages 442-462.
    21. Erik O. Kimbrough & Alexander Vostroknutov, 2016. "Norms Make Preferences Social," Journal of the European Economic Association, European Economic Association, vol. 14(3), pages 608-638, June.

    More about this item

    JEL classification:

    • A13 - General Economics and Teaching - - General Economics - - - Relation of Economics to Social Values
    • C91 - Mathematical and Quantitative Methods - - Design of Experiments - - - Laboratory, Individual Behavior
    • D01 - Microeconomics - - General - - - Microeconomic Behavior: Underlying Principles
    • D63 - Microeconomics - - Welfare Economics - - - Equity, Justice, Inequality, and Other Normative Criteria and Measurement
    • D83 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
    • D91 - Microeconomics - - Micro-Based Behavioral Economics - - - Role and Effects of Psychological, Emotional, Social, and Cognitive Factors on Decision Making

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:7n4xd. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.