Evaluating the Impact of STEM Academic Interventions on College Readiness for Rural Students
Abstract
:1. Introduction
1.1. College Readiness for Middle School Students in Rural School Settings
1.2. College Readiness Academic Intervention Strategies
1.3. GEAR UP
1.4. Purpose and Context of Study
2. Materials and Methods
3. Results
3.1. Scaled Scores Comparisons
3.2. College Readiness Benchmark Comparisons
3.3. Percentile Ranks Comparisons
3.4. College Readiness Outcome Differences
4. Discussion
4.1. Broader Comparison
4.2. Methodological Considerations and Limitations
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Data Availability Statement
Conflicts of Interest
References
- Balfanz, R. Putting Middle Grades Students on the Graduation Path; Everyone Graduates Center and Talent Development Middle Grades: Program Policy and Practice Brief; National Middle School Association: Westerville, OH, USA, 2009. [Google Scholar]
- Glaser, E.; Warick, C. What Does the Research Say About Early Awareness Strategies for College Access and Success? National College Access Network: Washington, DC, USA, 2016. Available online: https://eric.ed.gov/?id=ED604082 (accessed on 5 August 2024).
- National Council for Community and Education Partnerships. About GEAR UP. Available online: https://www.edpartnerships.org/about-gear-up (accessed on 21 October 2024).
- Gaertner, M.N.; McClarty, K.L. Performance, perseverance, and the full picture of college readiness. Educ. Meas. Issues Pract. 2015, 34, 20–33. [Google Scholar] [CrossRef]
- Saw, G.K.; Agger, C.A. STEM pathways of rural and small-town students: Opportunities to learn, aspirations, preparation, and college enrollment. Educ. Res. 2021, 50, 595–606. [Google Scholar] [CrossRef]
- US Department of Education. Applications for New Awards; Gaining Early Awareness and Readiness for Undergraduate Programs (State Grants). Fed. Regist. 2023, 88, 35858–35863. [Google Scholar]
- Johnson, A.; Kuhfeld, M.; Soland, J. The Forgotten 20 Percent: Achievement and Growth in Rural Schools Across the Nation. NWEA Center for School and Student Progress. 2022. Available online: https://www.nwea.org/content/uploads/2022/03/The-forgotten-20-percent-achievement-and-growth-in-rural-schools-across-the-nation_NWEA_research-brief.pdf (accessed on 5 August 2024).
- Wells, R.S.; Chen, L.; Bettencourt, G.M.; Haas, S. Reconsidering rural-nonrural college enrollment gaps: The role of socioeconomic status in geographies of opportunity. Res. High Educ. 2023, 64, 1089–1112. [Google Scholar] [CrossRef]
- Tieken, M.C. College talk and the rural economy: Shaping the educational aspirations of rural, first-generation students. Peabody J. Educ. 2016, 91, 203–223. [Google Scholar] [CrossRef]
- Besas, M.; COVID Forces Number of Rural Students Attending College to Plummet. The College Post, 5 January 2021. Available online: https://thecollegepost.com/covid-rural-student-enrollment/ (accessed on 21 July 2024).
- Green, S.; Sanczyk, A.; Chambers, C.; Mraz, M.; Polly, D. College and Career Readiness: A Literature Synthesis. J. Educ. 2023, 203, 222–229. [Google Scholar] [CrossRef]
- Gee, K.A.; Beno, C.; Lindstrom, L.; Lind, J.; Post, C.; Hirano, K. Enhancing college and career readiness programs for underserved adolescents. J. Youth Dev. 2020, 15, 222–251. [Google Scholar] [CrossRef]
- Camara, W.; O’Connor, R.; Mattern, K.; Hanson, M.A. Beyond Academics: A holistic Framework for Enhancing Education and Workplace Success; ACT Research Report Series; ACT Inc.: Iowa City, IA, USA, 2015. [Google Scholar]
- ACT. The Forgotten Middle: Ensuring that All Students Are on Target for College and Career Readiness Before High School. 2008. Available online: https://www.act.org/content/dam/act/unsecured/documents/ForgottenMiddle.pdf (accessed on 5 August 2024).
- Johnson, A.; Kuhfeld, M.; King, G. Measuring middle school achievement trajectories for college readiness. Educ. Policy 2022, 36, 1702–1730. [Google Scholar] [CrossRef]
- Kurlaender, M.; Reed, S.; Hurtt, A. Improving College Readiness: A Research Summary and Implications for Practice. In Policy Analysis for California Education; PACE: Stanford, CA, USA, 2019. [Google Scholar]
- Chen, X.; Soldner, M. STEM Attrition: College Students’ Paths into and Out of STEM Fields; U.S. Department of Education Institute of Education Sciences, NCES: Washington, DC, USA, 2013; p. 2014-001. Available online: https://nces.ed.gov/pubs2014/2014001rev.pdf (accessed on 18 July 2024).
- Peterson, B.; Bornemann, G.; Lydon, C.; West, K. Rural students in Washington State: STEM as a strategy for building rigor, postsecondary aspirations, and relevant career opportunities. Peabody J. Educ. 2015, 90, 280–293. [Google Scholar] [CrossRef]
- Reardon, S.F. The widening academic achievement gap between the rich and the poor: New evidence and possible explanations. In Whither Opportunity? Rising Inequality, Schools, and Children’s Life Chances; Duncan, G.J., Murnane, R.J., Eds.; Russell Sage Foundation: New York, NY, USA, 2011; pp. 91–116. [Google Scholar]
- National Academies of Sciences, Engineering, and Medicine. Barriers and Opportunities for 2-Year and 4-Year STEM Degrees: Systemic Change to Support Students’ Diverse pathways; National Academies Press: Washington, DC, USA, 2016. [Google Scholar]
- Ehlert, M.; Finger, C.; Rusconi, A.; Solga, H. Applying to college: Do information deficits lower the likelihood of college-eligible students from less-privileged families to pursue their college intentions?: Evidence from a field experiment. Soc. Sci. Res. 2017, 67, 193–212. [Google Scholar] [CrossRef]
- Gibbons, M.M.; Hardin, E.E.; Taylor, A.L.; Brown, E.; Graham, D. Evaluation of an SCCT-based intervention to increase postsecondary awareness in rural Appalachian youth. J. Career Dev. 2020, 47, 424–439. [Google Scholar] [CrossRef] [PubMed]
- Grigal, M.; Cooney, L.; Hart, D. Promoting college and career readiness with middle school youth with disabilities: Lessons learned from a curriculum development project. Career Dev. Transit. Except. Individ. 2019, 42, 64–71. [Google Scholar] [CrossRef]
- Albritton, K.; Cureton, J.L.; Byrd, J.A.; Storlie, C.A. Exploring perceptions of the path to work/life success among middle school students of color. J. Career Dev. 2020, 47, 440–453. [Google Scholar] [CrossRef]
- Babarović, T.; Dević, I.; Blažev, M. The effects of middle-school career intervention on students’ career readiness. Int. J. Educ. Vocat. Guid. 2020, 20, 429–450. [Google Scholar] [CrossRef]
- Radcliffe, R.A.; Bos, B. Strategies to prepare middle school and high school students for college and career readiness. Clear. House: A J. Educ. Strateg. Issues Ideas 2013, 86, 136–141. [Google Scholar] [CrossRef]
- Cohen, M.D.; Therriault, S.; Scala, J.; Lavinson, R.; Brand, B. Afterschool Programming as a Lever to Enhance and Provide Career Readiness Opportunities; College and Career Readiness and Success Center, American Institute for Research: Arlington, TX, USA, 2019. [Google Scholar]
- Cates, J.T.; Schaefle, S.E. The relationship between a college preparation program and at-risk students’ college readiness. J. Lat. Educ. 2011, 10, 320–334. [Google Scholar] [CrossRef]
- Kennedy, R.F. Exploring the Relationship Between Student Involvement in GEAR UP and Academic Achievement. Ph.D. Thesis, Northern Arizona University, Flagstaff, AZ, USA, 2016. [Google Scholar]
- Kim, S.; Bowman, N.A.; Ingleby, L.; Ford, D.C.; Sibaouih, C. Promoting educational success: Which GEAR UP services lead to postsecondary enrollment and persistence? Educ. Policy 2021, 35, 101–130. [Google Scholar] [CrossRef]
- Alegre, F.; Moliner, L.; Maroto, A.; Lorenzo-Valentin, G. Peer tutoring in algebra: A study in Middle school. J. Educ. Res. 2019, 112, 693–699. [Google Scholar] [CrossRef]
- Chappell, S.; Arnold, P.; Nunnery, J.; Grant, M. An examination of an online tutoring program’s impact on low-achieving middle school students’ mathematics achievement. Online Learn. 2015, 19, 37–53. [Google Scholar] [CrossRef]
- Falco, L.D.; Steen, S. Using school-based career development to support college and career readiness: An integrative review. J. Sch. Based Couns. Policy Eval. 2018, 1, 51–67. [Google Scholar] [CrossRef]
- Pak, K.; Desimone, L.M.; Parsons, A. An integrative approach to professional development to support college-and career-readiness standards. Educ. Policy Anal. Arch. 2020, 28, n111. [Google Scholar] [CrossRef]
- Klein, A.; How are States Measuring College-and-Career Readiness? It’s a Hodge-Podge. Education Week, 22 January 2019. Available online: https://www.edweek.org/policy-politics/how-are-states-measuring-college-and-career-readiness-its-a-hodge-podge/2019/01 (accessed on 5 August 2024).
- Walters, J.A. College and Career Readiness in Rural Idaho: A Mixed-Methods Study of the Current Culture, Struggles, and Successes in Middle Schools. Ph.D. Thesis, Northwest Nazarene University, Nampa, ID, USA, 2022. [Google Scholar]
- Weiher, G.R.; Hughes, C.; Kaplan, N.; Howard, J.Y. Hispanic college attendance and the state of Texas GEAR UP program. Rev. Policy Res. 2016, 23, 1035–1051. [Google Scholar] [CrossRef]
- Gutierrez, K.S.; Blanchard, M.R.; Busch, K.C. What effective design strategies do rural, underserved students in STEM clubs value while learning about climate change? Environ. Educ. Res. 2022, 28, 1043–1069. [Google Scholar] [CrossRef]
- Hooker, S.; Brand, B. College knowledge: A critical component of college and career readiness. New Dir. Youth Dev. 2010, 127, 75–85. [Google Scholar] [CrossRef] [PubMed]
- Schaefle, S. The relationship between GEAR UP program involvement and Latina/o students’ performance on high-stakes tests. J. Lat. Educ. 2018, 17, 201–214. [Google Scholar] [CrossRef]
- National Research Council. Identifying and Supporting Productive STEM Programs in Out-of-School Settings; The National Academies Press: Washington, DC, USA, 2015. [Google Scholar] [CrossRef]
- Sanchez, J.E.; Lowman, J.L.; Hill, K.A. Performance and persistence outcomes of GEAR UP students: Leveling the playing field in higher education. J. Coll. Stud. Retent. Res. Theory Pract. 2018, 20, 328–349. [Google Scholar] [CrossRef]
- National Council for Community and Education Partnerships. College and Career Readiness Evaluation Consortium: Data, Research, Evaluation. Available online: https://www.edpartnerships.org/ccrecup (accessed on 26 August 2023).
- Lunceford, C.J.; Sondergeld, T.A.; Stretavski, E.L. A comparative case study of student preparation for postsecondary education: How GEAR UP, socioeconomic status, and race influence academic and non-academic factors. J. Educ. Stud. Placed Risk (JESPAR) 2017, 22, 185–199. [Google Scholar] [CrossRef]
- Sondergeld, T.A.; Fischer, J.M.; Samel, A.N.; Knaggs, C.M. Evaluating the influence of an urban high school reform effort on college readiness and access outcomes: A quasiexperimental cohort study. J. Educ. Stud. Placed Risk (JESPAR) 2013, 18, 212–232. [Google Scholar] [CrossRef]
- Samel, A.N.; Sondergeld, T.A.; Fischer, J.M.; Patterson, N.C. The secondary school pipeline: Longitudinal indicators of resilience and resistance in urban schools under reform. High Sch. J. 2011, 94, 95–118. [Google Scholar] [CrossRef]
- Bausmith, J.M.; France, M. The impact of GEAR UP on college readiness for students in low income schools. J. Educ. Stud. Placed Risk (JESPAR) 2012, 17, 234–246. [Google Scholar] [CrossRef]
- Fogg, N.P.; Harrington, P.E. Evidence-Based Research: The Impact of the College Crusade GEAR UP Program in RI. New England Board of Higher Education, Boston, MA, USA. 2015. Available online: https://nebhe.org/journal/evidence-based-research-the-impact-of-the-college-crusade-gear-up-program-in-rhode-island/ (accessed on 18 July 2024).
- Standing, K.; Judkins, D.; Keller, B.; Shimshak, A. Early Outcomes of the GEAR UP Program: Final Report; US Department of Education: Washington, DC, USA, 2008. Available online: https://www2.ed.gov/rschstat/eval/highered/gearup/early-outcomes.pdf (accessed on 12 July 2024).
- Morgan, Y.; Sinatra, R.; Eschenauer, R. A comprehensive partnership approach increasing high school graduation rates and college enrollment of urban economically disadvantaged youth. Educ. Urban Soc. 2014, 47, 596–620. [Google Scholar] [CrossRef]
- Yampolskaya, S.; Massey, O.T.; Greenbaum, P.E. At-risk high school students in the “Gaining Early Awareness and Readiness” Program (GEAR UP): Academic and behavioral outcomes. J. Prim. Prev. 2006, 27, 457–475. [Google Scholar] [CrossRef]
- Leuwerke, W.C.; Ingleby, L.D.; Tillery, C.Y.; Cech, T.G.; Sibaouih, C.M. Narrowing the college readiness gap: Assessing GEAR UP Iowa’s intermediate impact on underserved students. J. Educ. Stud. Placed Risk (JESPAR) 2021, 26, 352–370. [Google Scholar] [CrossRef]
- US Department of Education. Scientifically Based Research and the Comprehensive School Reform (CSR) Program. Comprehensive School Reform Program Office. 2002. Available online: https://www2.ed.gov/programs/compreform/guidance/appendc.pdf (accessed on 12 August 2024).
- Borman, G.D.; Hewes, G.M.; Overman, L.T.; Brown, S. (Comprehensive school reform and achievement: A meta-analysis. Rev. Educ. Res. 2002, 73, 125–230. [Google Scholar] [CrossRef]
- Creswell, J.W. Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research, 3rd ed.; Pearson Education, Inc.: Upper Saddle River, NJ, USA, 2008. [Google Scholar]
- Crowley, J.; Hauser, A. Evaluating whole school improvement models: Creating meaningful and reasonable standards for review. J. Educ. Stud. Placed Risk 2007, 12, 37–60. [Google Scholar] [CrossRef]
- Cook, T.; Campbell, D. Quasi-Experimental Design and Analysis Issues for Field Settings; Rand McNally College Publishing Company: Chicago, IL, USA, 1979. [Google Scholar]
- Knaggs, C.M.; Sondergeld, T.A.; Schardt, B. Overcoming barriers to college enrollment, persistence, and perceptions for urban high school students in a college preparatory program. J. Mix. Methods Res. 2015, 9, 7–30. [Google Scholar] [CrossRef]
- Sondergeld, T.A.; Stone, G.E.; Kruse, L.M. Objective standard setting in educational assessment and decision making. Educ. Policy 2020, 34, 735–759. [Google Scholar] [CrossRef]
- Datnow, A.; Stringfield, S. Working together for reliable school reform. J. Educ. Stud. Placed Risk (JESPAR) 2000, 5, 183–204. [Google Scholar] [CrossRef]
- Taylor, J.E. The struggle to survive: Examining the sustainability of schools’ comprehensive school reform efforts. J. Educ. Stud. Placed Risk 2006, 11, 331–352. [Google Scholar] [CrossRef]
- Aladjem, D.K.; LeFloch, K.C.; Zhang, Y.; Kurki, A.; Boyle, A.; Taylor, J.E.; Herrmann, S.; Uekawa, K.; Thomsen, K.; Fashola, O. Models Matter: The Final Report of the National Longitudinal Evaluation of Comprehensive School Reform; American Institutes for Research: Arlington, TX, USA, 2006. Available online: https://files.eric.ed.gov/fulltext/ED499198.pdf (accessed on 18 July 2024).
- ACT. ACT Aspire Summative Technical Manual; ACT: Tokyo, Japan, 2020; Available online: https://actinc.my.salesforce.com/sfc/p/#300000000Wu5/a/4v0000005fHp/SLZ26Xzhfml8ibKP_Ca5G94_T3HuveFbNgFmfcRaHoY (accessed on 18 July 2024).
- Kretovics, J.; Farber, K.; Armaline, W. Reform from the bottom up: Empowering teachers to transform schools. Phi Delta Kappan 1991, 73, 295–299. [Google Scholar]
- National Center for Education Statistics. Digest of Education Statistics: 2021 Tables and Figures. Institute of Educational Sciences. 2021. Available online: https://nces.ed.gov/programs/digest/d21/tables/dt21_204.10.asp (accessed on 12 August 2024).
- Provinzano, K.; Sondergeld, T. Community schools: A comprehensive and human-centric approach to school reform. In The Personal, Place, and Context in Pedagogy: An Activist Stance for Our Uncertain Educational Future; Springer International Publishing: Cham, Switzerland, 2021; pp. 103–132. [Google Scholar]
- Tillery, C.; Duckor, B. Early intervention in college and career readiness: The GEAR UP model and its implications for 21st-century education policy. In Preparing Students for College and Careers; McClarty, K.L., Mattern, K.D., Gaertner, M.N., Eds.; Routledge: London, UK, 2017; pp. 119–129. [Google Scholar]
Student Demographic | Johnsonville Middle School 8th-Grade Students | |
---|---|---|
Values | Pre-SGU Cohort | SGU Cohort |
Gender | ||
Female | 47.7% | 53.0% |
Male | 52.3% | 47.0% |
Race/Ethnicity | ||
American Indian/Alaska Native | 0.0% | 1.0% |
Black or African American | 3.5% | 1.0% |
Hispanic | 0.0% | 1.0% |
White | 96.5% | 97.0% |
Free and Reduced-Price Lunch Eligible | ||
Eligible | 52.3% | 55.0% |
Not Eligible | 47.7% | 45.0% |
English as a Second Language | ||
Yes | 14.0% | 19.0% |
No | 86.0% | 81.0% |
JMS 8th-Grade Cohort Average Scaled Score | ||||
---|---|---|---|---|
Pre-SGU | SGU | |||
PSAT Scale | M (SD) | M (SD) | t-Statistic | Cohen’s d |
English | 420.63 (10.69) | 426.64 (8.88) | 4.18 *** | 0.616 |
Mathematics | 423.59 (7.41) | 426.45 (8.00) | 2.50 ** | 0.368 |
Reading | 419.31 (9.42) | 422.99 (7.87) | 2.90 ** | 0.717 |
Science | 417.79 (7.69) | 421.87 (8.83) | 3.33 *** | 0.490 |
Composite | 420.42 (8.06) | 424.79 (7.44) | 3.84 *** | 0.565 |
JMS 8th-Grade Cohort Average Percentile Rank | ||||
---|---|---|---|---|
Pre-SGU | SGU | |||
PSAT Scale | M (SD) | M (SD) | t-Statistic | Cohen’s d |
English | 32.14 (30.57) | 49.55 (27.38) | 4.09 *** | 0.602 |
Mathematics | 55.40 (26.86) | 62.78 (27.34) | 1.85 * | 0.272 |
Reading | 39.90 (34.12) | 53.48 (30.79) | 2.85 ** | 0.420 |
Science | 29.70 (27.42) | 44.05 (30.40) | 3.35 *** | 0.494 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Walton, J.B.; May, T.A.; Johnson, C.C. Evaluating the Impact of STEM Academic Interventions on College Readiness for Rural Students. Trends High. Educ. 2024, 3, 1017-1030. https://doi.org/10.3390/higheredu3040059
Walton JB, May TA, Johnson CC. Evaluating the Impact of STEM Academic Interventions on College Readiness for Rural Students. Trends in Higher Education. 2024; 3(4):1017-1030. https://doi.org/10.3390/higheredu3040059
Chicago/Turabian StyleWalton, Janet B., Toni A. May, and Carla C. Johnson. 2024. "Evaluating the Impact of STEM Academic Interventions on College Readiness for Rural Students" Trends in Higher Education 3, no. 4: 1017-1030. https://doi.org/10.3390/higheredu3040059
APA StyleWalton, J. B., May, T. A., & Johnson, C. C. (2024). Evaluating the Impact of STEM Academic Interventions on College Readiness for Rural Students. Trends in Higher Education, 3(4), 1017-1030. https://doi.org/10.3390/higheredu3040059