Nothing Special   »   [go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/a/bla/obuest/v83y2021i3p590-618.html
   My bibliography  Save this article

Gender Gaps in the Evaluation of Research: Evidence from Submissions to Economics Conferences

Author

Listed:
  • Laura Hospido
  • Carlos Sanz
Abstract
We study gender differences in the evaluation of submissions to economics conferences. Using data on more than 9,000 submissions from the Annual Congress of the European Economic Association (2015–17), the Annual Meeting of the Spanish Economic Association (2012–17) and the Spring Meeting of Young Economists (2018), we find that all‐female‐authored papers are 3.3% points (p.p.), or 6.8%, less likely to be accepted than all‐male‐authored papers. The estimated gap ranges from 5.4 p.p. (95% CI: 2.5 p.p., 8.3 p.p.) to 2.9 p.p. (0 p.p., 5.8 p.p.). This gap is present after controlling for number of authors of the paper; field; referee fixed effects; cites of the paper; authors’ previous publication record, affiliations, and experience; and connections between the authors of a given paper and the referees that evaluate it. We provide evidence suggesting that the gap is driven by stereotypes against female authors: it is entirely driven by male referees, only exists for lesser‐known authors, and seems larger in more masculine fields, especially in finance.

Suggested Citation

  • Laura Hospido & Carlos Sanz, 2021. "Gender Gaps in the Evaluation of Research: Evidence from Submissions to Economics Conferences," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(3), pages 590-618, June.
    • Handle: RePEc:bla:obuest:v:83:y:2021:i:3:p:590-618
    DOI: 10.1111/obes.12409
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/obes.12409
    Download Restriction: no
    File URL: https://libkey.io/10.1111/obes.12409?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Raquel Campos & Fernanda Leon & Ben McQuillin, 2018. "Lost in the Storm: The Academic Collaborations That Went Missing in Hurricane ISSAC," Economic Journal, Royal Economic Society, vol. 128(610), pages 995-1018, May.
    2. Bagues, Manuel & Campa, Pamela, 2021. "Can gender quotas in candidate lists empower women? Evidence from a regression discontinuity design," Journal of Public Economics, Elsevier, vol. 194(C).
    3. Goldin, Claudia D. & Rouse, Cecilia, 2000. "Orchestrating Impartiality: The Impact of “Blind†Auditions on Female Musicians," Scholarly Articles 30703974, Harvard University Department of Economics.
    4. Ruben Durante & Giovanna Labartino & Roberto Perotti, 2011. "Academic Dynasties: Decentralization and Familism in the Italian Academia," NBER Working Papers 17572, National Bureau of Economic Research, Inc.
    5. David Card & Stefano DellaVigna & Patricia Funk & Nagore Iriberri, 2020. "Are Referees and Editors in Economics Gender Neutral?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(1), pages 269-327.
    6. Manuel Bagues & Mauro Sylos-Labini & Natalia Zinovyeva, 2017. "Does the Gender Composition of Scientific Committees Matter?," American Economic Review, American Economic Association, vol. 107(4), pages 1207-1238, April.
    7. Joseph G. Altonji & Todd E. Elder & Christopher R. Taber, 2005. "Selection on Observed and Unobserved Variables: Assessing the Effectiveness of Catholic Schools," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 151-184, February.
    8. Lorenzo Ductor & Sanjeev Goyal & Anja Prummer, 2023. "Gender and Collaboration," The Review of Economics and Statistics, MIT Press, vol. 105(6), pages 1366-1378, November.
    9. Christine Wennerås & Agnes Wold, 1997. "Nepotism and sexism in peer-review," Nature, Nature, vol. 387(6631), pages 341-343, May.
    10. Valentina A. Paredes & M. Daniele Paserman & Francisco Pino, 2020. "Does Economics Make You Sexist?," NBER Working Papers 27070, National Bureau of Economic Research, Inc.
    11. Heather Sarsons & Klarita Gërxhani & Ernesto Reuben & Arthur Schram, 2021. "Gender Differences in Recognition for Group Work," Journal of Political Economy, University of Chicago Press, vol. 129(1), pages 101-147.
    12. Joseph Price & Justin Wolfers, 2010. "Racial Discrimination Among NBA Referees," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(4), pages 1859-1887.
    13. Shelly Lundberg & Jenna Stearns, 2019. "Women in Economics: Stalled Progress," Journal of Economic Perspectives, American Economic Association, vol. 33(1), pages 3-22, Winter.
    14. Pierre Deschamps, 2018. "Gender Quotas in Hiring Committees: a Boon or a Bane for Women?," SciencePo Working papers Main hal-03393117, HAL.
    15. Krawczyk, Michał & Smyk, Magdalena, 2016. "Author׳s gender affects rating of academic articles: Evidence from an incentivized, deception-free laboratory experiment," European Economic Review, Elsevier, vol. 90(C), pages 326-335.
    16. Emily Oster, 2019. "Unobservable Selection and Coefficient Stability: Theory and Evidence," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(2), pages 187-204, April.
    17. Maria De Paola & Vincenzo Scoppa, 2015. "Gender Discrimination and Evaluators’ Gender: Evidence from Italian Academia," Economica, London School of Economics and Political Science, vol. 82(325), pages 162-188, January.
    18. David Blackaby & Alison L Booth & Jeff Frank, 2005. "Outside Offers And The Gender Pay Gap: Empirical Evidence From the UK Academic Labour Market," Economic Journal, Royal Economic Society, vol. 115(501), pages 81-107, February.
    19. Natalia Zinovyeva & Manuel Bagues, 2015. "The Role of Connections in Academic Promotions," American Economic Journal: Applied Economics, American Economic Association, vol. 7(2), pages 264-292, April.
    20. Carole J. Lee & Cassidy R. Sugimoto & Guo Zhang & Blaise Cronin, 2013. "Bias in peer review," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(1), pages 2-17, January.
    21. Anusha Chari & Paul Goldsmith-Pinkham, 2017. "Gender Representation in Economics Across Topics and Time: Evidence from the NBER Summer Institute," Working Papers 2017-081, Human Capital and Economic Opportunity Working Group.
    22. Hengel, E., 2017. "Publishing while Female. Are women held to higher standards? Evidence from peer review," Cambridge Working Papers in Economics 1753, Faculty of Economics, University of Cambridge.
    23. Marc F. Bellemare & Casey J. Wichman, 2020. "Elasticities and the Inverse Hyperbolic Sine Transformation," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 82(1), pages 50-61, February.
    24. David Blackaby & Alison L Booth & Jeff Frank, 2005. "Outside Offers And The Gender Pay Gap: Empirical Evidence From the UK Academic Labour Market," Economic Journal, Royal Economic Society, vol. 115(501), pages 81-107, February.
    25. Combes, Pierre-Philippe & Linnemer, Laurent & Visser, Michael, 2008. "Publish or peer-rich? The role of skills and networks in hiring economics professors," Labour Economics, Elsevier, vol. 15(3), pages 423-441, June.
    26. Pierre-Philippe Combes & Laurent Linnemer & Michael Visser, 2008. "Publish or Peer-rich," Post-Print hal-00558189, HAL.
    27. Muriel Niederle & Lise Vesterlund, 2007. "Do Women Shy Away From Competition? Do Men Compete Too Much?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1067-1101.
    28. Manuel F. Bagues & Berta Esteve-Volart, 2010. "Can Gender Parity Break the Glass Ceiling? Evidence from a Repeated Randomized Experiment," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 77(4), pages 1301-1328.
    29. Broder, Ivy E, 1993. "Review of NSF Economics Proposals: Gender and Institutional Patterns," American Economic Review, American Economic Association, vol. 83(4), pages 964-970, September.
    30. Friederike Mengel & Jan Sauermann & Ulf Zölitz, 2019. "Gender Bias in Teaching Evaluations," Journal of the European Economic Association, European Economic Association, vol. 17(2), pages 535-566.
    31. Pierre Deschamps, 2018. "Gender Quotas in Hiring Committees: a Boon or a Bane for Women?," Post-Print hal-03393117, HAL.
    32. Amanda Bayer & Cecilia Elena Rouse, 2016. "Diversity in the Economics Profession: A New Attack on an Old Problem," Journal of Economic Perspectives, American Economic Association, vol. 30(4), pages 221-242, Fall.
    33. Blank, Rebecca M, 1991. "The Effects of Double-Blind versus Single-Blind Reviewing: Experimental Evidence from The American Economic Review," American Economic Review, American Economic Association, vol. 81(5), pages 1041-1067, December.
    34. Cecilia Rouse & Claudia Goldin, 2000. "Orchestrating Impartiality: The Impact of "Blind" Auditions on Female Musicians," American Economic Review, American Economic Association, vol. 90(4), pages 715-741, September.
    35. Juan Dolado & Florentino Felgueroso & Miguel Almunia, 2012. "Are men and women-economists evenly distributed across research fields? Some new empirical evidence," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 3(3), pages 367-393, September.
    36. Thomas Buser & Muriel Niederle & Hessel Oosterbeek, 2014. "Gender, Competitiveness, and Career Choices," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 129(3), pages 1409-1447.
    37. Boring, Anne, 2017. "Gender biases in student evaluations of teaching," Journal of Public Economics, Elsevier, vol. 145(C), pages 27-41.
    38. Anne Boschini & Anna Sjögren, 2007. "Is Team Formation Gender Neutral? Evidence from Coauthorship Patterns," Journal of Labor Economics, University of Chicago Press, vol. 25(2), pages 325-365.
    39. Heather Sarsons, 2017. "Recognition for Group Work: Gender Differences in Academia," American Economic Review, American Economic Association, vol. 107(5), pages 141-145, May.
    40. Jason Abrevaya & Daniel S. Hamermesh, 2012. "Charity and Favoritism in the Field: Are Female Economists Nicer (To Each Other)?," The Review of Economics and Statistics, MIT Press, vol. 94(1), pages 202-207, February.
    41. repec:hal:spmain:info:hdl:2441/7bucmgmilh9ul9ogmiku5legh5 is not listed on IDEAS
    42. Lorenzo Ductor & Sanjeev Goyal & Anja Prummer, 2018. "Gender & Collaboration," Working Papers 856, Queen Mary University of London, School of Economics and Finance.
    43. Christiana Hilmer & Michael Hilmer, 2007. "Women Helping Women, Men Helping Women? Same-Gender Mentoring, Initial Job Placements, and Early Career Publishing Success for Economics PhDs," American Economic Review, American Economic Association, vol. 97(2), pages 422-426, May.
    44. Marianne Bertrand, 2013. "Career, Family, and the Well-Being of College-Educated Women," American Economic Review, American Economic Association, vol. 103(3), pages 244-250, May.
    45. Carole J. Lee & Cassidy R. Sugimoto & Guo Zhang & Blaise Cronin, 2013. "Bias in peer review," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(1), pages 2-17, January.
    46. Moses Shayo & Asaf Zussman, 2011. "Judicial Ingroup Bias in the Shadow of Terrorism," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(3), pages 1447-1484.
    Full references (including those not matched with items on IDEAS)

    Citations

    RePEc Biblio mentions

    As found on the RePEc Biblio, the curated bibliography for Economics:
    1. > Economics Profession > Publishing in Economics > Teams
    2. > Economics Profession > Publishing in Economics > Discrimination

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. David Card & Stefano DellaVigna & Patricia Funk & Nagore Iriberri, 2022. "Gender Differences in Peer Recognition by Economists," Econometrica, Econometric Society, vol. 90(5), pages 1937-1971, September.
    2. Moritz Drechsel-Grau & Felix Holub, 2020. "Gender Gaps and the Role of Bosses," CRC TR 224 Discussion Paper Series crctr224_2020_237, University of Bonn and University of Mannheim, Germany.
    3. Auriol, Emmanuelle & Friebel, Guido & Weinberger, Alisa & ,, 2021. "Women in Economics: Europe and the World," CEPR Discussion Papers 16686, C.E.P.R. Discussion Papers.
    4. Gamage, Danula K. & Sevilla, Almudena & Smith, Sarah, 2020. "Women in Economics: A UK Perspective," IZA Discussion Papers 13477, Institute of Labor Economics (IZA).
    5. Lena Janys, 2022. "Testing the Presence of Implicit Hiring Quotas with Application to German Universities," ECONtribute Discussion Papers Series 165, University of Bonn and University of Cologne, Germany.
    6. Kathleen Segerson & Catherine L. Kling & Nancy E. Bockstael, 2022. "Contributions of women at the intersection of agricultural economics and environmental and natural resource economics," Applied Economic Perspectives and Policy, John Wiley & Sons, vol. 44(1), pages 38-53, March.
    7. Lena Janys, 2021. "Testing the Presence of Implicit Hiring Quotas with Application to German Universities," Papers 2109.14343, arXiv.org, revised Nov 2021.
    8. Paredes, Valentina & Paserman, M. Daniele & Pino, Francisco J., 2020. "Does Economics Make You Sexist?," IZA Discussion Papers 13223, Institute of Labor Economics (IZA).
    9. Farré, Lídia & Ortega, Francesc, 2021. "Family Ties, Geographic Mobility and the Gender Gap in Academic Aspirations," IZA Discussion Papers 14561, Institute of Labor Economics (IZA).
    10. Asier Minondo, 2020. "Who presents and where? An analysis of research seminars in US economics departments," Papers 2001.10561, arXiv.org, revised May 2020.
    11. Markus Eberhardt & Giovanni Facchini & Valeria Rueda, 2023. "Gender Differences in Reference Letters: Evidence from the Economics Job Market," The Economic Journal, Royal Economic Society, vol. 133(655), pages 2676-2708.
    12. Biermann, Marcus, 2021. "Remote talks: changes to economics seminars during Covid-19," LSE Research Online Documents on Economics 114429, London School of Economics and Political Science, LSE Library.
    13. Feld, Jan & Lines, Corinna & Ross, Libby, 2024. "Writing matters," Journal of Economic Behavior & Organization, Elsevier, vol. 217(C), pages 378-397.
    14. De, Anusha & Miehe, Caroline & Van Campenhout, Bjorn, 2024. "Gender bias in customer perceptions: The case of agro-input dealers in Uganda," Agricultural Systems, Elsevier, vol. 217(C).
    15. Marcus Biermann, 2021. "Remote talks: changes to economics seminars during Covid-19," CEP Discussion Papers dp1759, Centre for Economic Performance, LSE.
    16. Arceo-Gomez, Eva O. & Campos-Vazquez, Raymundo M., 2022. "Gender Bias in Evaluation Processes," Economics of Education Review, Elsevier, vol. 89(C).
    17. Jenny Bourne & Nathan D. Grawe & Michael Hemesath & Prathi Seneviratne & Maya Jensen, 2024. "The Disappearing Gender Gap in Scholarly Publication of Economists at Liberal Arts Colleges," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 50(1), pages 117-134, January.
    18. Fabiana Rocha, Paula Pereda, & Liz Matsunaga & Maria Dolores Montoya Diaz & Renata Narita, & Bruna Borges, 2021. "Gender differences in the academic career of economics in Brazil," Revista Cuadernos de Economia, Universidad Nacional de Colombia, FCE, CID, vol. 40(84), pages 815-892, October.
    19. Koffi, Marlene, 2021. "Innovative ideas and gender inequality," CLEF Working Paper Series 35, Canadian Labour Economics Forum (CLEF), University of Waterloo.
    20. Andrew Hussey & Sheena Murray & Wendy Stock, 2022. "Gender, coauthorship, and academic outcomes in economics," Economic Inquiry, Western Economic Association International, vol. 60(2), pages 465-484, April.
    21. Gauri Kartini Shastry & Olga Shurchkov, 2024. "Reject or revise: Gender differences in persistence and publishing in economics," Economic Inquiry, Western Economic Association International, vol. 62(3), pages 933-956, July.
    22. Nikolaos Theodoropoulos & John Forth & Alex Bryson, 2022. "Are Women Doing It for Themselves? Female Managers and the Gender Wage Gap," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 84(6), pages 1329-1355, December.
    23. Roberto Asmat & Karol J. Borowiecki & Marc T. Law, 2024. "Competing for Equality: Gender Bias Among Juries in International Piano Competitions, 1890-2023," ACEI Working Paper Series AWP-03-2024, Association for Cultural Economics International.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laura Hospido & Carlos Sanz, 2019. "Gender gaps in the evaluation of research: evidence from submissions to economics conferences (Updated March 2020)," Working Papers 1918, Banco de España, revised Mar 2020.
    2. Friederike Mengel & Jan Sauermann & Ulf Zölitz, 2019. "Gender Bias in Teaching Evaluations," Journal of the European Economic Association, European Economic Association, vol. 17(2), pages 535-566.
    3. Pierre Deschamps, 2018. "Gender Quotas in Hiring Committees: a Boon or a Bane for Women?," Working Papers hal-03393117, HAL.
    4. Pierre Deschamps, 2018. "Gender Quotas in Hiring Committees: a Boon or a Bane for Women?," Post-Print hal-03393117, HAL.
    5. Bosquet, Clément & Combes, Pierre-Philippe & Garcia-Penalosa, Cecilia, 2013. "Gender and competition: evidence from academic promotions in France," LSE Research Online Documents on Economics 58350, London School of Economics and Political Science, LSE Library.
    6. Verónica Amarante & Marisa Bucheli & María Inés Moraes & Tatiana Pérez, 2021. "Women in Research in Economics in Uruguay," Revista Cuadernos de Economia, Universidad Nacional de Colombia, FCE, CID, vol. 40(84), pages 763-790, October.
    7. Manuel Bagues & Mauro Sylos-Labini & Natalia Zinovyeva, 2014. "Do gender quotas pass the test ? Evidence from academic evaluations in Italy," LEM Papers Series 2014/14, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    8. Clément Bosquet & Pierre‐Philippe Combes & Cecilia García‐Peñalosa, 2019. "Gender and Promotions: Evidence from Academic Economists in France," Scandinavian Journal of Economics, Wiley Blackwell, vol. 121(3), pages 1020-1053, July.
    9. Manuel Bagues & Mauro Sylos-Labini & Natalia Zinovyeva, 2017. "Does the Gender Composition of Scientific Committees Matter?," American Economic Review, American Economic Association, vol. 107(4), pages 1207-1238, April.
    10. Auriol, Emmanuelle & Friebel, Guido & Weinberger, Alisa & ,, 2021. "Women in Economics: Europe and the World," CEPR Discussion Papers 16686, C.E.P.R. Discussion Papers.
    11. Pierre Deschamps, 2018. "Gender Quotas in Hiring Committees: a Boon or a Bane for Women?," SciencePo Working papers hal-03393117, HAL.
    12. Natalia Zinovyeva & Manuel F. Bagues, 2010. "Does gender matter for academic promotion? Evidence from a randomized natural experiment," Working Papers 2010-15, FEDEA.
    13. Bao, Zhengyang & Huang, Difang, 2024. "Gender-specific favoritism in science," Journal of Economic Behavior & Organization, Elsevier, vol. 221(C), pages 94-109.
    14. Bukstein, Daniel & Gandelman, Néstor, 2019. "Glass ceilings in research: Evidence from a national program in Uruguay," Research Policy, Elsevier, vol. 48(6), pages 1550-1563.
    15. Fabiana Rocha, Paula Pereda, & Liz Matsunaga & Maria Dolores Montoya Diaz & Renata Narita, & Bruna Borges, 2021. "Gender differences in the academic career of economics in Brazil," Revista Cuadernos de Economia, Universidad Nacional de Colombia, FCE, CID, vol. 40(84), pages 815-892, October.
    16. repec:spo:wpmain:info:hdl:2441/7bucmgmilh9ul9ogmiku5legh5 is not listed on IDEAS
    17. Bransch, Felix & Kvasnicka, Michael, 2022. "Male Gatekeepers: Gender Bias in the Publishing Process?," Journal of Economic Behavior & Organization, Elsevier, vol. 202(C), pages 714-732.
    18. repec:hal:spmain:info:hdl:2441/7bucmgmilh9ul9ogmiku5legh5 is not listed on IDEAS
    19. Emre Özel, 2024. "What is Gender Bias in Grant Peer review?," Working Papers halshs-03862027, HAL.
    20. David Card & Stefano DellaVigna & Patricia Funk & Nagore Iriberri, 2020. "Are Referees and Editors in Economics Gender Neutral?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 135(1), pages 269-327.
    21. Laura Hospido & Luc Laeven & Ana Lamo, 2022. "The Gender Promotion Gap: Evidence from Central Banking," The Review of Economics and Statistics, MIT Press, vol. 104(5), pages 981-996, December.
    22. Jenny Bourne & Nathan D. Grawe & Michael Hemesath & Prathi Seneviratne & Maya Jensen, 2024. "The Disappearing Gender Gap in Scholarly Publication of Economists at Liberal Arts Colleges," Eastern Economic Journal, Palgrave Macmillan;Eastern Economic Association, vol. 50(1), pages 117-134, January.

    More about this item

    JEL classification:

    • A1 - General Economics and Teaching - - General Economics
    • J16 - Labor and Demographic Economics - - Demographic Economics - - - Economics of Gender; Non-labor Discrimination

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:obuest:v:83:y:2021:i:3:p:590-618. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://edirc.repec.org/data/sfeixuk.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.