(This abstract was borrowed from another version of this item.)"> (This abstract was borrowed from another version of this item.)">
Nothing Special   »   [go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/cdl/econwp/qt24r2j30b.html
   My bibliography  Save this paper

The Measurement of Student Ability in Modern Assessment Systems

Author

Listed:
  • Jacob, Brian
  • Rothstein, Jesse
Abstract
Economists often use test scores to measure a student’s performance or an adult’s human capital. These scores reflect nontrivial decisions about how to measure and scale student achievement, with important implications for secondary analyses. For example, the scores computed in several major testing regimes, including the National Assessment of Educational Progress (NAEP), depend not only on the examinees’ responses to test items, but also on their background characteristics, including race and gender. As a consequence, if a black and white student respond identically to questions on the NAEP assessment, the reported ability for the black student will be lower than for the white student—reflecting the lower average performance of black students. This can bias many secondary analyses. Other assessments use different measurement models. This paper aims to familiarize applied economists with the construction and properties of common cognitive score measures and the implications for research using these measures.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Jacob, Brian & Rothstein, Jesse, 2016. "The Measurement of Student Ability in Modern Assessment Systems," Department of Economics, Working Paper Series qt24r2j30b, Department of Economics, Institute for Business and Economic Research, UC Berkeley.
    • Handle: RePEc:cdl:econwp:qt24r2j30b
    as

    Download full text from publisher

    File URL: https://www.escholarship.org/uc/item/24r2j30b.pdf;origin=repeccitec
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. James Heckman & Seong Hyeok Moon & Rodrigo Pinto & Peter Savelyev & Adam Yavitz, 2010. "Analyzing social experiments as implemented: A reexamination of the evidence from the HighScope Perry Preschool Program," Quantitative Economics, Econometric Society, vol. 1(1), pages 1-46, July.
    2. Jesse Rothstein, 2010. "Teacher Quality in Educational Production: Tracking, Decay, and Student Achievement," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(1), pages 175-214.
    3. James Heckman & Seong Hyeok Moon & Rodrigo Pinto & Peter Savelyev & Adam Yavitz, 2010. "Analyzing social experiments as implemented: evidence from the HighScope Perry Preschool Program," CeMMAP working papers CWP22/10, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    4. Gadi Barlevy & Derek Neal, 2012. "Pay for Percentile," American Economic Review, American Economic Association, vol. 102(5), pages 1805-1831, August.
    5. Flavio Cunha & James J. Heckman & Susanne M. Schennach, 2010. "Estimating the Technology of Cognitive and Noncognitive Skill Formation," Econometrica, Econometric Society, vol. 78(3), pages 883-931, May.
    6. Robert Mislevy, 1991. "Randomization-based inference about latent variables from complex samples," Psychometrika, Springer;The Psychometric Society, vol. 56(2), pages 177-196, June.
    7. Elizabeth U. Cascio & Douglas O. Staiger, 2012. "Knowledge, Tests, and Fadeout in Educational Interventions," NBER Working Papers 18038, National Bureau of Economic Research, Inc.
    8. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    9. Elizabeth U. Cascio & Ethan G. Lewis, 2006. "Schooling and the Armed Forces Qualifying Test: Evidence from School-Entry Laws," Journal of Human Resources, University of Wisconsin Press, vol. 41(2).
    10. Timothy N. Bond & Kevin Lang, 2013. "The Evolution of the Black-White Test Score Gap in Grades K–3: The Fragility of Results," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1468-1479, December.
    11. Thomas S. Dee & Brian Jacob, 2011. "The impact of no Child Left Behind on student achievement," Journal of Policy Analysis and Management, John Wiley & Sons, Ltd., vol. 30(3), pages 418-446, June.
    12. Jesse Rothstein & Nathan Wozny, 2013. "Permanent Income and the Black-White Test Score Gap," Journal of Human Resources, University of Wisconsin Press, vol. 48(3), pages 510-544.
    13. Julien Lafortune & Jesse Rothstein & Diane Whitmore Schanzenbach, 2018. "School Finance Reform and the Distribution of Student Achievement," American Economic Journal: Applied Economics, American Economic Association, vol. 10(2), pages 1-26, April.
    14. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers I: Evaluating Bias in Teacher Value-Added Estimates," American Economic Review, American Economic Association, vol. 104(9), pages 2593-2632, September.
    15. Andrew Dean Ho, 2009. "A Nonparametric Framework for Comparing Trends and Gaps Across Tests," Journal of Educational and Behavioral Statistics, , vol. 34(2), pages 201-228, June.
    16. Roland G. Fryer & Steven D. Levitt, 2004. "Understanding the Black-White Test Score Gap in the First Two Years of School," The Review of Economics and Statistics, MIT Press, vol. 86(2), pages 447-464, May.
    17. Lynne Schofield & Brian Junker & Lowell Taylor & Dan Black, 2015. "Predictive Inference Using Latent Variables with Covariates," Psychometrika, Springer;The Psychometric Society, vol. 80(3), pages 727-747, September.
    18. Roland G. Fryer & Steven D. Levitt, 2013. "Testing for Racial Differences in the Mental Ability of Young Children," American Economic Review, American Economic Association, vol. 103(2), pages 981-1005, April.
    19. Neal, Derek A & Johnson, William R, 1996. "The Role of Premarket Factors in Black-White Wage Differences," Journal of Political Economy, University of Chicago Press, vol. 104(5), pages 869-895, October.
    20. Eric R. Nielsen, 2015. "Achievement Gap Estimates and Deviations from Cardinal Comparability," Finance and Economics Discussion Series 2015-40, Board of Governors of the Federal Reserve System (U.S.).
    21. Timothy N. Bond & Kevin Lang, 2018. "The Black–White Education Scaled Test-Score Gap in Grades K-7," Journal of Human Resources, University of Wisconsin Press, vol. 53(4), pages 891-917.
    22. Eric R. Nielsen, 2015. "The Income-Achievement Gap and Adult Outcome Inequality," Finance and Economics Discussion Series 2015-41, Board of Governors of the Federal Reserve System (U.S.).
    23. Brian Junker & Lynne Schofield & Lowell Taylor, 2012. "The use of cognitive ability measures as explanatory variables in regression analysis," IZA Journal of Labor Economics, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 1(1), pages 1-19, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Eric R. Nielsen, 2019. "Test Questions, Economic Outcomes, and Inequality," Finance and Economics Discussion Series 2019-013, Board of Governors of the Federal Reserve System (U.S.).
    2. Jeffrey Penney, 2017. "Racial Interaction Effects and Student Achievement," Education Finance and Policy, MIT Press, vol. 12(4), pages 447-467, Fall.
    3. Raj Chetty & John N. Friedman & Jonah E. Rockoff, 2014. "Measuring the Impacts of Teachers II: Teacher Value-Added and Student Outcomes in Adulthood," American Economic Review, American Economic Association, vol. 104(9), pages 2633-2679, September.
    4. Orazio Attanasio & Sarah Cattan & Emla Fitzsimons & Costas Meghir & Marta Rubio-Codina, 2020. "Estimating the Production Function for Human Capital: Results from a Randomized Controlled Trial in Colombia," American Economic Review, American Economic Association, vol. 110(1), pages 48-85, January.
    5. Eric A. Hanushek & Jacob D. Light & Paul E. Peterson & Laura M. Talpey & Ludger Woessmann, 2022. "Long-run Trends in the U.S. SES-Achievement Gap," Education Finance and Policy, MIT Press, vol. 17(4), pages 608-640, Fall.
    6. Attanasio, Orazio & Cattan, Sarah & Fitzsimons, Emla & Meghir, Costas & Rubio-Codina, Marta, 2015. "Estimating the Production Function for Human Capital: Results from a Randomized Control Trial in Colombia," IZA Discussion Papers 8856, Institute of Labor Economics (IZA).
    7. Pedro Carneiro & Oswald Koussihouèdé & Nathalie Lahire & Costas Meghir & Corina Mommaerts, 2020. "School Grants and Education Quality: Experimental Evidence from Senegal," Economica, London School of Economics and Political Science, vol. 87(345), pages 28-51, January.
    8. Jesse Rothstein, 2019. "Inequality of Educational Opportunity? Schools as Mediators of the Intergenerational Transmission of Income," Journal of Labor Economics, University of Chicago Press, vol. 37(S1), pages 85-123.
    9. Koedel, Cory & Mihaly, Kata & Rockoff, Jonah E., 2015. "Value-added modeling: A review," Economics of Education Review, Elsevier, vol. 47(C), pages 180-195.
    10. Roland G. Fryer, Jr, 2016. "The Production of Human Capital in Developed Countries: Evidence from 196 Randomized Field Experiments," NBER Working Papers 22130, National Bureau of Economic Research, Inc.
    11. M. Caridad Araujo & Pedro Carneiro & Yyannú Cruz-Aguayo & Norbert Schady, 2016. "Teacher Quality and Learning Outcomes in Kindergarten," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1415-1453.
    12. Richard J. Murnane, 2013. "U.S. High School Graduation Rates: Patterns and Explanations," Journal of Economic Literature, American Economic Association, vol. 51(2), pages 370-422, June.
    13. Gershenson, Seth & Holt, Stephen B. & Papageorge, Nicholas W., 2015. "Who Believes in Me? The Effect of Student-Teacher Demographic Match on Teacher Expectations," IZA Discussion Papers 9202, Institute of Labor Economics (IZA).
    14. Naven, Matthew, 2019. "Human-Capital Formation During Childhood and Adolescence: Evidence from School Quality and Postsecondary Success in California," MPRA Paper 97716, University Library of Munich, Germany.
    15. Bau, Natalie & Das, Jishnu & Yi Chang, Andres, 2021. "New evidence on learning trajectories in a low-income setting," International Journal of Educational Development, Elsevier, vol. 84(C).
    16. Dionissi Aliprantis, 2014. "When Should Children Start School?," Journal of Human Capital, University of Chicago Press, vol. 8(4), pages 481-536.
    17. Domicolo, Carly & Nielsen, Eric, 2022. "Male–female achievement variance comparisons are not robust," Economics Letters, Elsevier, vol. 220(C).
    18. Sloczynski, Tymon, 2018. "Average Gaps and Oaxaca's Blinder Decompositions: A Cautionary Tale about Regression Estimates of Racial Differences in Labor Market Outcomes," IZA Discussion Papers 12041, Institute of Labor Economics (IZA).
    19. Timothy N. Bond & Kevin Lang, 2018. "The Black–White Education Scaled Test-Score Gap in Grades K-7," Journal of Human Resources, University of Wisconsin Press, vol. 53(4), pages 891-917.
    20. Lisa Grazzini, 2016. "The Importance of the Quality of Education: Some Determinants and its Effects on Earning Returns and Economic Growth," ECONOMIA PUBBLICA, FrancoAngeli Editore, vol. 2016(2), pages 43-82.

    More about this item

    Keywords

    Economics;

    JEL classification:

    • H75 - Public Economics - - State and Local Government; Intergovernmental Relations - - - State and Local Government: Health, Education, and Welfare
    • I21 - Health, Education, and Welfare - - Education - - - Analysis of Education
    • I28 - Health, Education, and Welfare - - Education - - - Government Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cdl:econwp:qt24r2j30b. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Lisa Schiff (email available below). General contact details of provider: https://edirc.repec.org/data/ibbrkus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.