Nothing Special   »   [go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/a/eee/pubeco/v190y2020ics0047272720300888.html
   My bibliography  Save this article

Entry through the narrow door: The costs of just failing high stakes exams

Author

Listed:
  • Machin, Stephen
  • McNally, Sandra
  • Ruiz-Valenzuela, Jenifer
Abstract
In many countries, important thresholds in examinations act as a gateway to higher levels of education and/or improved employment prospects. This paper examines the consequences of just failing a particularly important high stakes national examination taken at the end of compulsory schooling in England. It uses unique administrative data, including full information on both initial and regraded exam marks, to show that students of the same ability have significantly different educational trajectories depending on whether they just pass or fail this exam. Three years later, students who just fail to achieve the required threshold have a lower probability of entering an upper-secondary high-level academic or vocational track and of starting tertiary education. Those who fail to pass the threshold are also more likely to drop out of education by age 18, without some form of employment. The moderately high effects of just passing or failing to pass the threshold in this high-stakes exam has high potential long-term consequences for those affected.

Suggested Citation

  • Machin, Stephen & McNally, Sandra & Ruiz-Valenzuela, Jenifer, 2020. "Entry through the narrow door: The costs of just failing high stakes exams," Journal of Public Economics, Elsevier, vol. 190(C).
    • Handle: RePEc:eee:pubeco:v:190:y:2020:i:c:s0047272720300888
    DOI: 10.1016/j.jpubeco.2020.104224
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047272720300888
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jpubeco.2020.104224?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Terrier, Camille, 2020. "Boys lag behind: How teachers’ gender biases affect student achievement," Economics of Education Review, Elsevier, vol. 77(C).
    2. Brian Bell & Anna Bindler & Stephen Machin, 2018. "Crime Scars: Recessions and the Making of Career Criminals," The Review of Economics and Statistics, MIT Press, vol. 100(3), pages 392-404, July.
    3. Gerard, Francois & Rokkanen, Miikka & Rothe, Christoph, 2015. "Identification and Inference in Regression Discontinuity Designs with a Manipulated Running Variable," IZA Discussion Papers 9604, Institute of Labor Economics (IZA).
    4. Anelli, Massimo, 2016. "The Returns to Elite College Education: A Quasi-Experimental Analysis," IZA Discussion Papers 10192, Institute of Labor Economics (IZA).
    5. Christopher Avery & Oded Gurantz & Michael Hurwitz & Jonathan Smith, 2018. "Shifting College Majors in Response to Advanced Placement Exam Scores," Journal of Human Resources, University of Wisconsin Press, vol. 53(4), pages 918-956.
    6. Thomas S. Dee & Will Dobbie & Brian A. Jacob & Jonah Rockoff, 2019. "The Causes and Consequences of Test Score Manipulation: Evidence from the New York Regents Examinations," American Economic Journal: Applied Economics, American Economic Association, vol. 11(3), pages 382-423, July.
    7. Steven Mcintosh, 2006. "Further Analysis of the Returns to Academic and Vocational Qualifications," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 68(2), pages 225-251, April.
    8. Katja Maria Kaufmann & Matthias Messner & Alex Solis, 2013. "Returns to Elite Higher Education in the Marriage Market: Evidence from Chile," Working Papers 489, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    9. David S. Lee & Thomas Lemieux, 2010. "Regression Discontinuity Designs in Economics," Journal of Economic Literature, American Economic Association, vol. 48(2), pages 281-355, June.
    10. Imbens, Guido W. & Lemieux, Thomas, 2008. "Regression discontinuity designs: A guide to practice," Journal of Econometrics, Elsevier, vol. 142(2), pages 615-635, February.
    11. Oana Borcan & Mikael Lindahl & Andreea Mitrut, 2017. "Fighting Corruption in Education: What Works and Who Benefits?," American Economic Journal: Economic Policy, American Economic Association, vol. 9(1), pages 180-209, February.
    12. Feng, Andy & Graetz, Georg, 2017. "A question of degree: The effects of degree class on labor market outcomes," Economics of Education Review, Elsevier, vol. 61(C), pages 140-161.
    13. Alan I. Barreca & Melanie Guldi & Jason M. Lindo & Glen R. Waddell, 2011. "Saving Babies? Revisiting the effect of very low birth weight classification," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(4), pages 2117-2123.
    14. Gregg, Paul & Tominey, Emma, 2005. "The wage scar from male youth unemployment," Labour Economics, Elsevier, vol. 12(4), pages 487-509, August.
    15. Jonathan Smith & Michael Hurwitz & Christopher Avery, 2017. "Giving College Credit Where It Is Due: Advanced Placement Exam Scores and College Outcomes," Journal of Labor Economics, University of Chicago Press, vol. 35(1), pages 67-147.
    16. Rebecca Diamond & Petra Persson, 2016. "The Long-term Consequences of Teacher Discretion in Grading of High-stakes Tests," NBER Working Papers 22207, National Bureau of Economic Research, Inc.
    17. Sebastian Calonico & Matias D. Cattaneo & Rocio Titiunik, 2014. "Robust Nonparametric Confidence Intervals for Regression‐Discontinuity Designs," Econometrica, Econometric Society, vol. 82, pages 2295-2326, November.
    18. Betts, Julian R, 1998. "The Impact of Educational Standards on the Level and Distribution of Earnings," American Economic Review, American Economic Association, vol. 88(1), pages 266-275, March.
    19. Avraham Ebenstein & Victor Lavy & Sefi Roth, 2016. "The Long-Run Economic Consequences of High-Stakes Examinations: Evidence from Transitory Variation in Pollution," American Economic Journal: Applied Economics, American Economic Association, vol. 8(4), pages 36-65, October.
    20. W. Bentley MacLeod & Evan Riehl & Juan E. Saavedra & Miguel Urquiola, 2017. "The Big Sort: College Reputation and Labor Market Outcomes," American Economic Journal: Applied Economics, American Economic Association, vol. 9(3), pages 223-261, July.
    21. Joshua D. Angrist & Erich Battistin & Daniela Vuri, 2017. "In a Small Moment: Class Size and Moral Hazard in the Italian Mezzogiorno," American Economic Journal: Applied Economics, American Economic Association, vol. 9(4), pages 216-249, October.
    22. Lavy, Victor & Sand, Edith, 2018. "On the origins of gender gaps in human capital: Short- and long-term consequences of teachers' biases," Journal of Public Economics, Elsevier, vol. 167(C), pages 263-279.
    23. Joseph G. Altonji & Erica Blom & Costas Meghir, 2012. "Heterogeneity in Human Capital Investments: High School Curriculum, College Major, and Careers," Annual Review of Economics, Annual Reviews, vol. 4(1), pages 185-223, July.
    24. Freier, Ronny & Schumann, Mathias & Siedler, Thomas, 2015. "The earnings returns to graduating with honors — Evidence from law graduates," Labour Economics, Elsevier, vol. 34(C), pages 39-50.
    25. Lavy, Victor & Sand, Edith, 2015. "On The Origins of Gender Human Capital Gaps: Short and Long Term Consequences of Teachers’ Stereotypical Biases," The Warwick Economics Research Paper Series (TWERPS) 1085, University of Warwick, Department of Economics.
    26. Michal Kolesár & Christoph Rothe, 2018. "Inference in Regression Discontinuity Designs with a Discrete Running Variable," American Economic Review, American Economic Association, vol. 108(8), pages 2277-2304, August.
    27. Joshua Goodman & Michael Hurwitz & Jonathan Smith, 2017. "Access to 4-Year Public Colleges and Degree Completion," Journal of Labor Economics, University of Chicago Press, vol. 35(3), pages 829-867.
    28. Dearden, Lorraine, et al, 2002. "The Returns to Academic and Vocational Qualifications in Britain," Bulletin of Economic Research, Wiley Blackwell, vol. 54(3), pages 249-274, July.
    29. Hahn, Jinyong & Todd, Petra & Van der Klaauw, Wilbert, 2001. "Identification and Estimation of Treatment Effects with a Regression-Discontinuity Design," Econometrica, Econometric Society, vol. 69(1), pages 201-209, January.
    30. Claudia Hupkau & Sandra McNally & Jenifer Ruiz-Valenzuela & Guglielmo Ventura, 2017. "Post-Compulsory Education in England: Choices and Implications," National Institute Economic Review, National Institute of Economic and Social Research, vol. 240(1), pages 42-57, May.
    31. Battistin, Erich & Rettore, Enrico, 2008. "Ineligibles and eligible non-participants as a double comparison group in regression-discontinuity designs," Journal of Econometrics, Elsevier, vol. 142(2), pages 715-730, February.
    32. Brigham R. Frandsen, 2017. "Party Bias in Union Representation Elections: Testing for Manipulation in the Regression Discontinuity Design when the Running Variable is Discrete," Advances in Econometrics, in: Regression Discontinuity Designs, volume 38, pages 281-315, Emerald Group Publishing Limited.
    33. Seth D. Zimmerman, 2014. "The Returns to College Admission for Academically Marginal Students," Journal of Labor Economics, University of Chicago Press, vol. 32(4), pages 711-754.
    34. Geraint Johnes & Jill Johnes (ed.), 2004. "International Handbook on the Economics of Education," Books, Edward Elgar Publishing, number 2847.
    35. Costrell, Robert M, 1994. "A Simple Model of Educational Standards," American Economic Review, American Economic Association, vol. 84(4), pages 956-971, September.
    36. Damon Clark & Paco Martorell, 2014. "The Signaling Value of a High School Diploma," Journal of Political Economy, University of Chicago Press, vol. 122(2), pages 282-318.
    37. Joshua D. Angrist & Victor Lavy, 1999. "Using Maimonides' Rule to Estimate the Effect of Class Size on Scholastic Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 114(2), pages 533-575.
    38. Serena Canaan & Pierre Mouganie, 2018. "Returns to Education Quality for Low-Skilled Students: Evidence from a Discontinuity," Journal of Labor Economics, University of Chicago Press, vol. 36(2), pages 395-436.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aspasia Bizopoulou & Rigissa Megalokonomou & Stefania Simion, 2022. "Do Second Chances Pay Off?," Bristol Economics Discussion Papers 22/762, School of Economics, University of Bristol, UK.
    2. Aspasia Bizopoulou & Rigissa Megalokonomou & Stefania Simion, 2022. "Do Second Chances Pay Off? Evidence from a Natural Experiment with Low-Achieving Students," CESifo Working Paper Series 9620, CESifo.
    3. Jin-young Choi & Myoung-jae Lee, 2017. "Regression discontinuity: review with extensions," Statistical Papers, Springer, vol. 58(4), pages 1217-1246, December.
    4. Adam C. Sales & Ben B. Hansen, 2020. "Limitless Regression Discontinuity," Journal of Educational and Behavioral Statistics, , vol. 45(2), pages 143-174, April.
    5. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    6. Montoya, Ana Maria & Noton, Carlos & Solis, Alex, 2018. "The Returns to College Choice: Loans, Scholarships and Labor Outcomes," Working Paper Series 2018:12, Uppsala University, Department of Economics.
    7. Blaise Melly & Rafael Lalive, 2020. "Estimation, Inference, and Interpretation in the Regression Discontinuity Design," Diskussionsschriften dp2016, Universitaet Bern, Departement Volkswirtschaft.
    8. Heinesen, Eskil, 2018. "Admission to higher education programmes and student educational outcomes and earnings–Evidence from Denmark," Economics of Education Review, Elsevier, vol. 63(C), pages 1-19.
    9. Aspasia Bizopoulou & Rigissa Megalokonomou & Stefania Simion, 2023. "Do Second Chances Pay Off? Evidence from a Natural Experiment with Low-Achieving Students," Monash Economics Working Papers 2023-05, Monash University, Department of Economics.
    10. Salim Atay & Gunes A. Asik & Semih Tumen, 2024. "Impact of Graduating with Honours on Entry Wages of Economics Majors," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 86(3), pages 606-640, June.
    11. Guido Imbens & Stefan Wager, 2019. "Optimized Regression Discontinuity Designs," The Review of Economics and Statistics, MIT Press, vol. 101(2), pages 264-278, May.
    12. Ivan A Canay & Vishal Kamat, 2018. "Approximate Permutation Tests and Induced Order Statistics in the Regression Discontinuity Design," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(3), pages 1577-1608.
    13. Georg Graetz, 2021. "On the interpretation of diploma wage effects estimated by regression discontinuity designs," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 54(1), pages 228-258, February.
    14. Feng, Andy & Graetz, Georg, 2017. "A question of degree: The effects of degree class on labor market outcomes," Economics of Education Review, Elsevier, vol. 61(C), pages 140-161.
    15. Naven, Matthew & Whalen, Daniel, 2022. "The signaling value of university rankings: Evidence from top 14 law schools," Economics of Education Review, Elsevier, vol. 89(C).
    16. Davezies, Laurent & Le Barbanchon, Thomas, 2017. "Regression discontinuity design with continuous measurement error in the running variable," Journal of Econometrics, Elsevier, vol. 200(2), pages 260-281.
    17. Yoichi Arai & Yu‐Chin Hsu & Toru Kitagawa & Ismael Mourifié & Yuanyuan Wan, 2022. "Testing identifying assumptions in fuzzy regression discontinuity designs," Quantitative Economics, Econometric Society, vol. 13(1), pages 1-28, January.
    18. Yang He & Otávio Bartalotti, 2020. "Wild bootstrap for fuzzy regression discontinuity designs: obtaining robust bias-corrected confidence intervals," The Econometrics Journal, Royal Economic Society, vol. 23(2), pages 211-231.
    19. Ribas, Rafael P. & Sampaio, Breno & Trevisan, Giuseppe, 2020. "Short- and long-term effects of class assignment: Evidence from a flagship university in Brazil," Labour Economics, Elsevier, vol. 64(C).
    20. Di Giacomo, Marina & Piacenza, Massimiliano & Siciliani, Luigi & Turati, Gilberto, 2022. "The effect of co-payments on the take-up of prenatal tests," Journal of Health Economics, Elsevier, vol. 81(C).

    More about this item

    Keywords

    High stakes examinations; Manipulation; English;
    All these keywords.

    JEL classification:

    • I20 - Health, Education, and Welfare - - Education - - - General
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I24 - Health, Education, and Welfare - - Education - - - Education and Inequality

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:pubeco:v:190:y:2020:i:c:s0047272720300888. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/505578 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.