1 s2.0 S1747938X18302744 Main
1 s2.0 S1747938X18302744 Main
1 s2.0 S1747938X18302744 Main
A R T IC LE I N F O ABS TRA CT
Keywords: Previous educational research has extensively investigated the relationship between socio-eco-
Socio-economic status nomic status (SES) and academic performance. In higher education, however, this relationship
Academic performance still deserves a comprehensive examination given both practical and conceptual reasons. To at-
Higher education tend to this need, a mixed-methods systematic literature review of 42 studies has been carried
Meta-analysis
out. In the first part, a summative content analysis examines how SES and academic performance
are measured. In the second part, a meta-analysis estimates the effect size of the relationship
between SES and academic performance in higher education. Findings suggest that SES is
measured through education, occupation, income, household resources, and neighborhood re-
sources, while academic performance in higher education is measured through achievement,
competencies, and persistence. Furthermore, the meta-analysis reveals a positive yet weak re-
lationship between SES and academic performance in higher education. Prior academic
achievement, university experience, and working status are more strongly related to academic
performance than SES.
1. Introduction
Over the past years, the student population applying to and entering university has become more diverse in terms of social,
cultural and economic capital, age, nationality (Morlaix & Suchaut, 2014), prior education, and academic achievement (Anderton,
Evans, & Chivers, 2016). Moreover, in many countries, social changes have also contributed to changes in higher education systems;
thus, although there is still a long way to go, participation from students from low social and economic backgrounds in higher
education is increasing (Hansen & Mastekaasa, 2006). In order to achieve a better understanding of these changes in higher education
systems, several researchers have explored the relationship between socio-economic status (SES) and academic performance, finding
a weak to moderate relationship (e.g., Richardson, Abraham, & Bond, 2012; Sackett et al., 2012; Westrick, Le, Robbins, Radunzel, &
Schmidt, 2015).
Given the increasing participation of students from low SES backgrounds and the weak to moderate relation between SES and
academic performance, one could wonder whether we still need to study the relationship between SES and academic performance in
☆
This research was supported in part by the Colombian Department of Science, Technology and Innovation (COLCIENCIAS) under the grant 756
of 2016.
∗
Corresponding author.
E-mail addresses: rodriguezcf@gmail.com (C.F. Rodríguez-Hernández), cascallar@msn.com (E. Cascallar), eva.kyndt@uantwerpen.be (E. Kyndt).
https://doi.org/10.1016/j.edurev.2019.100305
Received 11 June 2018; Received in revised form 17 September 2019; Accepted 20 November 2019
Available online 23 November 2019
1747-938X/ © 2019 Elsevier Ltd. All rights reserved.
C.F. Rodríguez-Hernández, et al. Educational Research Review 29 (2020) 100305
higher education. However, both practical and conceptual reasons exist that warrant continued attention. Firstly, the common trend
in the literature has been to use SES as a covariate instead of establishing, in a more comprehensive way, its influence on students'
experiences and outcomes (McKenzie & Schweitzer, 2001; Walpole, 2003). By doing the latter, the higher education sector can gain a
deeper understanding on how SES and academic performance are related, which might be necessary in order to deal appropriately
with the increased diversity in the student population. Secondly, recent meta-analyses in higher education (Richardson et al., 2012;
Schneider & Preckel, 2017; Westrick et al., 2015) have focused primarily on calculating the effect size of the relationship between SES
and academic performance, possibly ignoring the influence of several other students' and institutional characteristics on this re-
lationship. Thirdly, based on analytic schemes such as the Astin's input-environment-output model (Astin, 1993), it could be argued
that the relationship between SES and academic performance in higher education changes when additional variables are taken into
account. As such, it seems inadequate to explore students' academic performance as a single-factor phenomenon (De Clercq, Galand,
Dupont, & Frenay, 2013).
Although studies reviewing the relationship between SES and academic performance in primary and secondary schools are
available (e.g., Sirin, 2005), it cannot be assumed that these results are generalizable to the context of higher education. By carrying
out a mixed-methods systematic literature review, this study seeks to fill the gap that exists in the extensive literature devoted to
examining the relationship between SES and academic performance in higher education. This article begins by presenting several
issues pertaining to the definition of SES and academic performance, and then describes previous research in the literature regarding
their relationship. Next, the methodology of this study is outlined in detail, explaining how both summative content analysis and
meta-analysis are carried out. Subsequently, the answers to the research questions addressed in this research are presented. The
article concludes with the discussion and implications of the key findings of this systematic literature review.
2. Theoretical framework
The understanding of students’ socio-economic conditions became a major concern for educational researchers when low aca-
demic performance at school was observed in students whose parents had low income, low levels of education, and were employed at
low-status jobs (Cowan et al., 2012). Although SES can be considered as one of the most commonly used variables in educational
research (Sirin, 2005), it has been conceptualized in different ways in the literature. For instance, Chapin (as cited in White, 1982)
defined SES in 1928 as: “the position that an individual or family occupies with reference to the prevailing average of standards of
cultural possessions, effective income, material possessions, and participation in group activity in the community” (p. 99). Mueller
and Parcel (1981) defined SES as the position of an individual, family, or group on a hierarchy based on economic, power, and
prestige dimensions. More recently, SES has been defined as the amount of economic, social, and cultural resources available to one
student (Cowan et al., 2012; De Clercq, Galand, & Frenay, 2017).
The different dimensions of SES have been operationalized using either single indicators, multiple indicators analyzed separately,
or several indicators combined in a composite score (Australian Bureau of Statistics, 2011; Cowan et al., 2012; Shavers, 2007).
Moreover, the indicators of SES can be observed at several levels, namely, the individual, family, or area levels (Australian Bureau of
Statistics, 2011; Krieger, Williams, & Moss, 1997). At the individual level, education, occupation, and income have been used as
indicators for SES in previous educational research (Cowan et al., 2012; Sackett, Kuncel, Arneson, Cooper, & Waters, 2009; Van Ewijk
& Sleegers, 2010). Education, occupation, and income can consistently capture students' socio-economic conditions regardless of the
time in which they are observed (Erola, Jalonen, & Lehti, 2016). In addition, these measurements are easy to interpret and com-
municate (Cowan et al., 2012). At the family level, household resources have been suggested as the fourth indicator for SES (Sirin,
2005). Household resources refer to possessions such as cars, books, computers, and musical instruments (De Clercq et al., 2017;
Pedrosa, Dachs, Maia, Andrade, & Carvalho, 2007). Finally, at the area level, neighborhood resources have been reported as the fifth
indicator for SES (Australian Bureau of Statistics, 2011; Cowan et al., 2012; Shavers, 2007). Interestingly, financial and social
resources that do not come exclusively from the family can also be related to students’ academic performance (Cowan et al., 2012).
Such is the case, for example, with neighborhood characteristics and resources like the degree of urbanization (Hansen & Mastekaasa,
2006), and the number of parks and libraries in the area where students live (Cowan et al., 2012).
How education, occupation, income, and household resources interact in the measurement of SES, however, is rather complex. In
particular, education has been the most commonly used indicator to assess SES (Australian Bureau of Statistics, 2011; Shavers, 2007)
because of its relationship with other aspects of socio-economic status (Erola et al., 2016; Galobardes, Shaw, Lawlor, Lynch, & Smith,
2006). In fact, higher levels of education are related to the subsequent benefits they offer for a person's life and wellbeing, such as a
better job, working conditions, and higher-income (Shavers, 2007). Similarly, occupation is also commonly used as an indicator of
SES mainly due to its relationship with education and income (Erola et al., 2016; Ganzeboom, De Graaf, & Treiman, 1992). In this
case, income represents the amount of social and economic resources a student can have (Australian Bureau of Statistics, 2011;
Galobardes et al., 2006; Sirin, 2005), whereas household resources, therefore, can also indicate whether a student's home situation is
adequate for learning (Van Ewijk & Sleegers, 2010).
In summary, SES is a broad concept that encompasses two primary dimensions: prestige and resources (Krieger et al., 1997). The
first dimension determines the hierarchical position of an individual in a society (Mueller & Parcel, 1981), while the second di-
mension determines the economic, social, and cultural resources which an individual has access to (Cowan et al., 2012; De Clercq
et al., 2017). In addition, education, occupation, income, and household resources have been widely used as measurements to assess
SES.
2
C.F. Rodríguez-Hernández, et al. Educational Research Review 29 (2020) 100305
When searching for the definition of students' academic performance in higher education, the lack of consensus in the educational
literature is evident. Terms such as performance, achievement, and success are used interchangeably among educational researchers
without any specific reason (e.g., Casillas et al., 2012; Rochford, Connolly, & Drennan, 2009; Tracey, Allen, & Robbins, 2012). Also,
an operationalization (e.g., Grade Point Average) rather than a conceptual definition is mostly reported when defining academic
performance in higher education. Despite this lack of consensus, academic achievement, competencies, and persistence have been
used as separate, although interrelated, measurements to assess students' academic performance in higher education. Simply looking
at academic achievement does not necessarily encompass or represent students’ acquisition of competencies nor their persistence
(York, Gibson, & Rankin, 2015).
Academic achievement can be defined as the attainment of either medium- or long-term educational goals (Yusuf, 2002). In this
respect, Li, Chen, and Duanmu (2010) have pointed out that prior academic achievement is strongly related to students' academic
performance at university. As a matter of fact, a considerable number of studies have reported the explanatory role of prior academic
achievement in academic performance at university (e.g. Betts, Elder, Hartley, & Blurton, 2008; Byrne & Flood, 2008; Casillas et al.,
2012; McKenzie & Schweitzer, 2001; Pike & Saupe, 2002; Roberts, 2007). Furthermore, a competency is a “performance capacity to
do as well as to know which is judged by some level or standard of performance” (Shavelson, 2010, p. 44). In particular, higher
education aims at developing both specific and generic competencies (Sadler, 2013). Undoubtedly, a deeper understanding of aca-
demic performance in higher education requires the assessment of both generic and specific student competencies (Blömeke, Zlatkin-
Troitschanskaia, Kuhn, & Fege, 2013). Consequently, the assessment of competencies has arisen in many countries at different stages
of the higher education learning process (Zlatkin-Troitschanskaia, Shavelson, & Kuhn, 2015). Finally, Tinto's (1993) theory of de-
parture indicates that students persist when they are integrated into both the academic and social systems of the university. Per-
sistence can be understood as the students' academic progression towards degree completion regardless of institutional transfers,
academic programs, or institutional contexts (York et al., 2015). The dropout rate has usually been suggested as an indicator of
persistence in higher education (Hilton, 1982; Tinto, 1975, 1993).
One of the most crucial turning points in educational research during the 20th century was the publication of a 1966 report by
Coleman and colleagues entitled Equality of Educational Opportunity (EEO). The report suggested that high school characteristics
were unrelated to academic performance in the USA, but students' socio-economic conditions were. Consequently, many educational
researchers have carried out studies aimed at understanding Coleman's main findings.
On the one hand, several authors have postulated theoretical frameworks, such as Astin's (1984, 1999) student involvement
theory or Bourdieu's (1986) social capital theory, which could explain how SES and academic performance are related. Regarding
social capital theory (Bourdieu, 1986), Dika and Singh (2002) critically reviewed the literature (published between 1986 and 2001)
that relates social capital to educational outcomes and identified several problems with the conceptualization and measurement of
social capital as a predictor of academic performance. In particular, sources of social capital are often confused with the resources and
opportunities coming from it; thus, there is no clear distinction between possession and activation of social capital (Dika & Singh,
2002). Additionally, the selection of cross-sectional data has made it difficult to determine how social resources and educational
outcomes are related (Dika & Singh, 2002). Therefore, it cannot be entirely accepted that social capital explains how SES is related to
academic performance (Jæger, 2011; Sullivan, 2001).
On the other hand, several meta-analytic studies have been conducted in different educational settings. Focusing on the ele-
mentary and secondary levels, the main objectives of these meta-analyses (e.g., Sirin, 2005; Van Ewijk & Sleegers, 2010; White, 1982)
have been: (1) to determine the effect size of the relationship between SES and academic performance; and (2) to identify which
factors could moderate the relationship between SES and academic performance. Regarding the first objective, the findings show a
positive, albeit moderate, relationship, as indicated by average correlations of .343 (S.D. = .204; White, 1982), .299 (S.D. = .169;
Sirin, 2005) and .32 (S.E. = .016; Van Ewijk & Sleegers, 2010). With respect to the second objective, the results suggest that
methodological factors such as the unit of analysis (Sirin, 2005; White, 1982), the definition of SES (White, 1982), the source of the
SES data, the range of the SES, and the type of SES-performance measure (Sirin, 2005), moderate the relationship between SES and
academic performance.
Delving into higher education, one of the objectives of these meta-analyses (e.g., Richardson et al., 2012; Schneider & Preckel,
2017; Westrick et al., 2015) has been to explore the effect size of the relationship between SES and academic performance.
Richardson et al. (2012) found a small correlation between SES and academic performance (r = .11, 95% CI [.08, .15]). Similarly,
Westrick et al. (2015) reported that SES is weakly related to first-year GPA (r = .24, 95% CI [.24, .25]) and second-year retention at
university (r = .10, 95% CI [.09, .11]). Finally, SES was ranked in the 68th place among 105 variables associated with academic
performance in higher education (Schneider & Preckel, 2017). A concluding remark of this body of research is that there is a weak to
moderate relationship between SES and academic performance in higher education. However, a more comprehensive exploration of
this relationship is still missing in the educational literature.
Several theories have been proposed to explain how students grow and change during their university studies (Long, 2012). A
3
C.F. Rodríguez-Hernández, et al. Educational Research Review 29 (2020) 100305
well-known example within this body of literature is Astin's (1984, 1999) theory of involvement. Students' involvement refers to the
extent to which a student invests energy into his or her university experience —the greater the student's involvement, the greater the
students' learning and development (Astin, 1984, 1999). One analytic scheme drawn from Astin's theory of involvement is the input-
environment-output (IEO) model (Astin, 1993). The I-E-O model suggests that students' educational outcomes are defined by the
students' inputs (e.g., their demographic characteristics, prior academic achievement), the environmental elements (e.g., university
organizations, peer relations), and the interaction among students' inputs and environmental elements (Astin, 1993). Most of the
predictive studies in higher education lack of a theoretical foundation, being more empirically-based than theory-driven. Never-
theless, the I-E-O model seems to be a suitable approach to analyze the literature in higher education regarding the prediction of
academic performance for two reasons. First, the I-E-O model allows for the investigation of the direct and indirect influence (via
environmental characteristics) of students' inputs on students' educational outcomes. Second, the I-E-O model recognizes the long-
itudinal nature of the student retention process and provides a framework for the investigation of it (Kelly, 1996).
Starting from the I-E-O model, predictive studies in higher education can be classified into two types. The first type of predictive
studies, which is most likely the most frequent one in higher education, has examined academic performance as an “input-output”
process, a common approach in the educational field. A review of the literature on the input-output analysis of the schools was
carried out by Glasman and Biniaminov (1981). The authors concluded that inputs can be categorized into either student or school
type, while the outputs can be classified as either cognitive or non-cognitive. Furthermore, a causal model including both the direct
and indirect effects of inputs on outputs was also proposed by Glasman and Biniaminov (1981). The second type of predictive studies
in higher education has investigated academic performance as an “input-environment-output” process. A similar analytic scheme at
the school level is the context, input, process, and output model proposed by Scheerens (1990). In brief, context here refers to the
school environment as well as the policy measures at a higher administrative level, while input relates to the available resources,
teacher qualifications, and student characteristics. Process includes curriculum, school organization, and school climate, while output
is generally defined in terms of students’ achievement.
Furthermore, the I-E-O model can frame the analysis of the mediators of the relationship between SES and academic performance
in higher education. First, several “input-output” studies in higher education (e.g., Crawford, 2014; Stratton & Wetzel, 2011;
Warburton, Bugarin, & Nuñez, 2001) have shown that (1) prior academic achievement is strongly related to academic performance in
university and (2) prior academic achievement might diminish the strength of the SES-academic performance relationship. Although
it has been amply documented that SES determines prior academic achievement, Marks (2017) has suggested that the influence of
prior academic achievement on students’ outcomes is not solely explained by their SES at previous stages of life. Therefore, the first
mediator investigated in this systematic literature review is prior academic achievement.
Second, the “input-process-output” studies in higher education have suggested that university experience (Gerken & Volkwein,
2000; Smith, 2016; Walpole, 2003) does influence the relationship between SES and academic performance. University experience
refers to how a student connects to the academic environment of the university (Astin, 1999). More specifically, perception of the
learning environment, peer support, and institutional commitment could define university experience (Astin, 1999; De Clercq et al.,
2013). Thus, the second mediator investigated in this systematic literature review is university experience.
Third, although Astin (1999) suggested that holding a part-time job on campus could have a beneficial influence on students'
retention, the explanatory role of working status has usually been investigated separately from the university experience. In this
respect, the general trend in the literature has been to analyze the influence of worked hours on students’ academic performance (e.g.,
Nonis & Hudson, 2006; Rochford et al., 2009; Stinebrickner & Stinebrickner, 2003). Nevertheless, the reasons why students decide to
work when attending university are diverse; so, it can be argued that not only would low SES students work during their studies
(Yanbarisova, 2015). Hence, the third mediator investigated in this systematic literature review is working status.
3. Present study
Past educational research has contributed to the understanding of the relationship between SES and academic performance.
However, recent meta-analyses in higher education (Richardson et al., 2012; Schneider & Preckel, 2017; Westrick et al., 2015) are
limited, for two main reasons. Firstly, both SES and academic performance had been operationalized in these studies using only one
indicator, which narrowed the understanding regarding how additional measures to assess such complex terms are related. Secondly,
these meta-analyses did not explore how SES is first related to several student characteristics and, subsequently, is related to aca-
demic performance. This systematic review focuses on investigating the relationship between socio-economic status and academic
performance in higher education in a more comprehensive manner. The first objective of this study is to analyze the different
measures of SES and academic performance in higher education. Thus, the first research question addressed in this study is: How are
SES and academic performance in higher education measured? The second objective of this study is to determine the mediating role of
several factors on the relationship between SES and academic performance in higher education. Therefore, the second pair of research
questions of this study are: (a) What is the relationship between SES and academic performance in higher education? And (b) Is the
relationship between SES and academic performance in higher education mediated by (i) prior academic achievement, (ii) university ex-
perience, and/or (iii) working status? To answer these research questions, a mixed-methods research synthesis (Heyvaert, Maes, &
Onghena, 2013) of the selected studies has been carried out. A mixed-methods approach makes it possible to integrate both quali-
tative analyses (e.g., for this study, summative content analysis) and quantitative analyses (e.g., for this study, meta-analysis) of the
results of the studies in order to obtain conclusions about the current state of the art of the literature (Heyvaert et al., 2013).
4
C.F. Rodríguez-Hernández, et al. Educational Research Review 29 (2020) 100305
Table 1
Overview of the literature search hits.
Query Search terms ERIC (Ovid) PsycArticles Scopus SSCI
1 ‘Higher Education’ AND ‘Academic Achievement’ 13,668 429 988 345 15,430
Update May 2017 333 17 110 80 540
2 ‘Higher Education’ AND ‘Academic Performance’ 9535 287 752 553 11,127
Update May 2017 264 9 186 145 604
3 ‘Higher Education’ AND ‘Academic Outcomes’ 0 1708 83 66 1857
Update May 2017 395a 78 20 15 508
Sub-total initial search 23,203 2424 1823 964 28,414
Sub-total update May 2017 992 104 316 240 1652
Total 24,195 2528 2139 1204 30,066
a
This number of hits was obtained using the multi-field function and selecting references between 2000 and 2017.
4. Method
This systematic review proceeded in three phases. In the first phase, an extensive literature search within several scientific
databases was conducted. Next, the relevant literature retrieved from these databases was selected for inclusion according to several
criteria. In the second phase, the quality of the selected studies was critically appraised, and finally, the primary studies were
analyzed following the guidelines of Aveyard (2014) and the performance of both a summative content analysis and meta-analysis.
In this systematic review, four databases were consulted: ERIC, Scopus, SSCI, and PsycArticles, using combinations of the fol-
lowing search terms: “higher education”, “academic performance”, “academic achievement”, and “academic outcomes”. The initial
search yielded 28,414 non-unique studies, as shown in Table 1. The selection of the literature was based on eight criteria for
inclusion. As reported by Gamoran and Long (2007), the citations of Coleman's report increased again by the end of the ‘90s and
achieved an average of 55 citations per year from 2000, which represents a new interest for studying academic performance since
then. Thus, studies published after 2000 (Criterion 1) were considered for subsequent analysis. Second, only empirical studies ex-
ploring academic performance in higher education were included in this analysis (Criterion 2). Studies focusing on specific subgroups
of students (i.e., students with disabilities; online learners) were excluded (Criterion 3). As this systematic literature review focused
on variables related to SES, studies concerning learning styles were not included (Criterion 4). Similarly, studies regarding age
differences (Criterion 5), gender differences (Criterion 6), and ethnic differences (Criterion 7) were not included in this analysis.
Finally, only studies that explicitly report the relationship between SES and academic performance were selected for further analysis
(Criterion 8).
The selection process of the initial 28,414 studies was carried out in six steps. In step 1, duplicate studies were eliminated using
the EndNote software, leaving 24,246 studies. In step 2, studies published before 2000 were excluded, leaving 9928 studies. Next, in
step 3, studies without a date, a wrong date, or those that were not written in English or Spanish were eliminated, leaving 9658
studies. As expected, a summative content analysis requires a full understanding of the reviewed studies. Therefore, in step 4, the title
and the abstract of the remaining studies were screened using the first seven criteria for inclusion presented above. As a result of this
fourth step, 208 studies were retained for further analysis. In step 5, a total of 202 studies were scanned/read diagonally as six full
texts articles could not be retrieved. This fifth step, using the same inclusion criteria, led to a further reduction in the number of
studies to a total of 100. In the final step, the full texts of these 100 studies were read in-depth, and 69 additional studies were
excluded using Criterion 8 presented above. As a result of the selection process, 31 studies remained. As any systematic review is a
challenging and time-consuming task, 18 months passed between the first literature search and the writing of the first draft of this
article. Hence, an update of the literature search was carried out on May 2017. In total, 1652 new hits were retrieved, and after using
the previously mentioned selection criteria, six additional studies were selected. Finally, a back-tracing process of the 37 resulting
studies was performed to identify and select additional relevant studies. The outcome of this process was the selection of ten further
studies, and as a result of the selection process, a total of 47 primary studies were considered for critical appraisal.
The quality of the selected primary studies (n = 47) was evaluated using the checklists of the National Institute for Health and
Clinical Excellence (2009). The main criteria for the quality appraisal were (a) a clear statement of the aims of the research, (b) an
appropriate research design, (c) a well-described and appropriate sampling strategy, data collection, and analysis method; and (d) a
clear description of the research findings. Each study was rated as either high, medium, or low quality. Following this critical
appraisal, five studies were excluded due to their low quality, leaving 42 studies for analysis. Appendix A shows the results of the
critical appraisal process.
5
C.F. Rodríguez-Hernández, et al. Educational Research Review 29 (2020) 100305
The analysis of the literature was conducted under the guidelines proposed by Aveyard (2014). First, the main characteristics of
the selected studies were summarized (see Appendix B). Then, every study was reread to identify and codify the relevant information.
Consequently, all the studies were coded and assigned the following themes: operationalizations of SES (Theme 1); oper-
ationalizations of academic performance (Theme 2); relationship between SES and academic performance (Theme 3); prior academic
achievement (Theme 4), university experience (Theme 5), and working status (Theme 6). The first research question was answered by
summative content analysis. The second research questions were answered using both summative content analysis and meta-analysis.
6
C.F. Rodríguez-Hernández, et al. Educational Research Review 29 (2020) 100305
articles (Loehr, Almarode, Tai, & Sadler, 2012; Morlaix & Suchaut, 2014; Pedrosa et al., 2007; Rodríguez Albor, Ariza, & Ramos,
2014) could not be calculated due to insufficient information. It is essential to notice that the inclusion of unstandardized regression
coefficients could dramatically increase the average effect size. Similarly, in two of the analyzed studies (Frischenschlager, Haidinger,
& Mitteraurer, 2005; Stratton & Wetzel, 2011), it was not possible to convert the reported odds ratio due to a lack of information. In
five of the articles (Anderton et al., 2016; Gerken & Volkwein, 2000; Ifenthaler & Widanapathirana, 2014; Nguyen, 2016; Zheng,
Saunders, Shelley, Mack, & Whalen, 2002) the effect size was not reported due to it not being significant. Finally, in two of the articles
(Bahamón & Reyes Ruiz, 2014; Triventi, 2014), the relationship between SES and academic performance was described but not
reported through a specific effect size.
Statistical independence. One crucial methodological aspect when performing a meta-analysis is to ensure that the effect sizes are
independent among them. To achieve such independence, the average effect size was calculated in studies reporting more than one
effect size. In this way, the sample on which it was based contributed only with one effect size to the analysis (Sirin, 2005). One
article (De Clercq et al., 2013) reported two different effect sizes coming from two different data sets. Both effect sizes were included
in the meta-analysis.
Combining effect sizes across studies. Another major important consideration when conducting a meta-analysis is to decide how to
transform the different effect sizes retrieved from the examined studies so that a meaningful and valid aggregation can be made. In
this meta-analysis, the effect sizes were converted using Fisher's transformation as recommended by Hedges and Olkin (1985).
Fisher's transformation is a variance stabilizing transformation so that the r-value becomes independent from the population p-value
(Aloe & Becker, 2012; Bowman, 2012).
Homogeneity analysis. The homogeneity among the effect sizes was analyzed using Hedge's Q test for homogeneity. This test is
based on chi-square statistics with k-1 degrees of freedom, where k is the number of investigated effect sizes. A significant result
suggests that effect sizes across the studies are heterogeneous, so further exploration of the existence of possible mediators should be
conducted.
Publication bias. A common fact in scientific literature is publication bias. Publication bias means that only statistically significant
results or results which support the expected relationship are published (Rothstein, Sutton, & Borenstein, 2005). In this study,
publication bias was assessed using the funnel plot. To evaluate the funnel plot symmetry, Egger's regression test (Egger, Smith,
Schneider, & Minder, 1997) was performed, and the results indicated that there was no publication bias in the studies summarized
through this meta-analysis (z = .79, p = .43).
Analysis of the mediators. Similar to the summative content analysis, the existence of mediators was analyzed by contrasting the
effect size of the relationships indicated with numbers in Fig. 1. The average effect size between SES and academic performance (1)
was compared to the average effect size between the presumed mediator and academic performance (2). As such, a larger and
significant average effect size between the mediator and academic performance would suggest mediation.
5. Results
The results of this systematic literature review are presented in accordance with the research questions. Sections 5.1 and 5.2 are
based on the results derived from the summative content analysis, while Section 5.3 is based on the results of both the summative
content analysis and the meta-analysis.
Table 2 presents the classification of the operationalizations of SES into five major measurements: parental educational level,
parental occupation, income, household resources, and neighborhood resources. Table 2 also provides information regarding the type
of measure (i.e., single or composite score) and the type of scale (i.e., categorical or continuous) of each one of the examined
operationalizations. It is important to note that a study can appear more than once in Table 2, as it might have reported several
indicators for the assessment of SES. The classification of the operationalizations of SES is described in detail in the following
sections.
7
Table 2
Operationalizations of SES.
Measurement Type of measurement Scale Operationalization Reference(s)
Parental Educational level As a single indicator Categorical (n = 19) Highest level of parental education (n = 4) Bruinsma and Jansen (2007); Ifenthaler and Widanapathirana (2014);
(n = 25) (n = 21) Loehr et al. (2012); Tai, Sadler, and Loehr (2005)
A dichotomous variable to determine whether parents Bonsaksen (2016); Nguyen (2016); Waqas et al. (2013)
have attended college (n = 3)
3 categories Rodríguez Ayan and Ruiz Díaz(2011)
C.F. Rodríguez-Hernández, et al.
8
& Treas, 1994).
Parental Occupation (n = 10) As a single indicator Categorical (n = 7) Dichotomous variable to indicate whether parents work Guimarães and Sampaio (2013)
(n = 7) Dichotomous variable to indicate whether parents' Bonsaksen (2016)
occupation(s) requires higher education
4 categories Yao et al. (2015)
5 categories Arulampalam et al. (2004)
8 categories Morlaix and Suchaut (2014)
10 categories Hansen and Mastekaasa (2006)
The Standard Occupational Classification scale 2000 Smith (2016)
Within a composite score Categorical (n = 2) 7 categories Gouvias et al. (2012)
(n = 3) 12 categories Rodríguez Albor et al. (2014)
Continuous Occupational prestige and socioeconomic scores (Nakao Walpole (2003)
& Treas, 1994).
(continued on next page)
Educational Research Review 29 (2020) 100305
Table 2 (continued)
Income (n = 20) As a single indicator Categorical (n = 16) 3 categories (high, middle and low) (n = 3) Frischenschlager et al. (2005); Wolniak and Engberg (2010); Yao et al.
(n = 17) (2015)
5 categories Black et al. (2015)
5 categories Stratton and Wetzel (2011)
5 categories (quintiles) Bozick (2007)
C.F. Rodríguez-Hernández, et al.
9
Neighborhood resources (n = 9) As a single indicator Categorical (n = 3) Students' stratum (n = 2) Bahamón and Reyes Ruiz (2014); Rodríguez Albor et al. (2014)
(n = 3) Degree of urbanization Hansen and Mastekaasa (2006)
As a composite score Continuous (n = 6) Index of Economic Resources (IER) (n = 2) Birch and Miller (2006); Win and Miller (2005)
(n = 6) Index of Education and Occupation (IEO) Win and Miller (2005)
Index of Multiple Deprivation (IMD) Thiele et al. (2016)
Index of Relative Socioeconomic Advantage and Puddey and Mercer (2014)
Disadvantage (IRSAD)
School decile Shulruf et al. (2008)
Educational Research Review 29 (2020) 100305
C.F. Rodríguez-Hernández, et al. Educational Research Review 29 (2020) 100305
using the International Standard Classification of Education (ISCED). The ISCED is a classification of educational programs based on
levels and areas of knowledge proposed in 1997 by the United Nations Educational, Scientific, and Cultural Organization (UNESCO),
and then revised in 2011. The main goal behind this classification is the need to compare internationally different educational
systems (Schneider, 2013). More specifically, there are nine ISCED levels ranging from early childhood education to a doctoral or
equivalent level. On the continuous scales, Walpole (2003) recoded the parental educational level into a continuous SES variable
based on the occupational prestige and socioeconomic scores as proposed by Nakao and Treas (1994). In particular, Nakao and Treas
(1994) suggested the following regression equation to calculate a socio-economic index (SEI): SEI = 9.24 + 0.64 (Education) + 0.31
(Income).
5.1.3. Income
This category (n = 20) sorts between operationalizations that measured income as a single indicator (n = 17) or within a com-
posite score (n = 3). Regarding “single indicator” (n = 17), the use of categorical scales (n = 16) was identified to measure income
with: (a) several categories to discriminate between low and high income (n = 9); (b) dichotomous scales to determine whether
students received financial aid (n = 4) or received subsidized lunches (n = 2); and (c) quartiles to classify university tuition fees.
Additionally, Hansen and Mastekaasa (2006) proposed a continuous scale between 0 and 1 to determine the relative position of a
student's family within the distribution of all family incomes (i.e., a score of 0.52 indicates that 52% of the families have less income).
Concerning “within a composite score” (n = 3), continuous scales were used by Rodríguez Albor et al. (2014) to combine tuition
fees and monthly income into a composite score. Similar to parental educational level and occupation, parental income was also re-
coded by Walpole (2003) into a continuous SES variable, based on the occupational prestige and socioeconomic scores proposed by
Nakao and Treas (1994).
10
C.F. Rodríguez-Hernández, et al. Educational Research Review 29 (2020) 100305
instance, whether schools are receiving students coming from low-SES areas.
Table 3a and Table 3b present the classification of the operationalizations to assess academic performance in higher education
into three measurements: achievement, competencies, and persistence, both before and during university. Tables 3a and 3b also
display information regarding the level of measurement (i.e., categorical or continuous) as well as the scale used in each of the
examined references. Again, the studies can appear more than once in Tables 3a and 3b, as they might have used several indicators to
assess academic performance. The classification of the operationalizations of academic performance in higher education is explained
in the upcoming sections.
11
Table 3a
Operationalizations of academic performance at university.
Measurement Operationalization Type of scale Scale Reference(s)
Achievement (n = 43) GPA (n = 32) First year GPA (n = 16) Categorical (n = 4) 3 categories (high, medium, Shulruf et al. (2008); Yao et al. (2015)
low) (n = 2)
C.F. Rodríguez-Hernández, et al.
12
From 0 to 100 Thiele et al. (2016)
Single grade (n = 4) Test at the end of the first year Categorical High or low performance Frischenschlager et al. (2005)
Introductory college chemistry Continuous (n = 3) From 0 to 12 Rodríguez Ayan and Ruiz Díaz(2011)
Introductory college chemistry From 0 to 100 Tai et al. (2005)
Introductory college biology From 0 to 100 Loehr et al. (2012)
Number of credits Course credits (n = 2) Continuous (n = 4) Black et al. (2015); Gerken and Volkwein (2000)
(n = 6) Study unit outcomes (n = 2) Ifenthaler and Widanapathirana (2014); Puddey and Mercer (2014)
Degree progression index Continuous From 0 to 1 Rodríguez Ayan and Ruiz Díaz(2011)
ECTS credits Continuous Triventi (2014)
Relative achievement Index to compare students' performance at Continuous From −1 to 1 Pedrosa et al. (2007)
the entrance and exit of all courses
Competencies (n = 6) Standardized test SABER PRO (Colombia) (n = 2) Continuous (n = 2) From 1 to 300 Bahamón and Reyes Ruiz (2014); Rodríguez Albor et al. (2014)
(n = 6) CET (College English Test) (China) Continuous The highest possible score is Yao et al. (2015)
710
DALF (France) Continuous From 0 to 100 Morlaix and Suchaut (2014)
GAMSAT (Australia) Continuous From 0 to 100 Puddey and Mercer (2014)
PELA (Australia) Continuous From 0 to 10 Anderton et al. (2016)
Persistence (n = 6) Completion status Dropout (n = 2) Categorical (n = 2) Yes/No Arulampalam et al. (2004); Gerken and Volkwein (2000)
(n = 6) Final degree classification (n = 2) Categorical (n = 2) British undergraduate degree Smith (2016); Thiele et al. (2016)
classification
Attending graduate school Categorical Yes/No Walpole (2003)
Graduation rate Continuous Stratton and Wetzel (2011)
Educational Research Review 29 (2020) 100305
Table 3b
Operationalizations of academic performance before university.
Measurement Operationalization Type of scale Scale Reference
13
NCEA (New Zealand) Continuous From 0 to 80 credits (each NCEA Shulruf et al. (2008)
level)
SABER 11 (Colombia) Continuous Before 2014: From 0 to 400 Bahamón and Reyes Ruiz (2014)
As of 2014: From 0 to 500
Competencies (n = 15) Aptitude exams SAT (USA) (n = 9) Continuous (n = 9) Before 2016: from 600 to 2400 Black et al. (2015); Gerken and Volkwein (2000); Loehr et al. (2012);
(n = 12) As of 2016: from 400 to 1600 Rothstein (2004); Sackett et al. (2009); Stratton and Wetzel (2011); Tai et al.
(2005); Walpole (2003); Wolniak and Engberg (2010)
ACT (USA) (n = 3) Continuous (n = 3) From 1 to 36 Stratton and Wetzel (2011); Wolniak and Engberg (2010); Zheng et al. (2002)
Subject area exams Vestibular (Brazil) Continuous (n = 3) Guimarães and Sampaio (2013)
(n = 3) Not specified (Greece) Gouvias et al. (2012)
Not specified (Vietnam) Nguyen (2016)
Persistence (n = 8) Admission ranks High school rank (n = 2) Continuous (n = 2) Black et al. (2015); Zheng et al. (2002)
(n = 5) Tertiary Entrance Rank Continuous (n = 3) From 0 to 99.95 Birch and Miller (2006); Win and Miller (2005)
(TER) (n = 2)
Australian Tertiary Anderton et al. (2016)
Admission Rank (ATAR)
Grade retention Years repeated in high Categorical Yes/No De Clercq et al. (2013)
(n = 3) school
Number of class repetitions Continuous (n = 2) Frischenschlager et al. (2005)
Years repeated in high Morlaix and Suchaut (2014)
school
Educational Research Review 29 (2020) 100305
C.F. Rodríguez-Hernández, et al. Educational Research Review 29 (2020) 100305
5.3. The relationship between SES and academic performance in higher education
Table 4 provides information on the relationship between SES and academic performance in higher education, as well as the
mediators identified in the analyzed primary studies. Such information was analyzed through both summative content analysis and
meta-analysis. This section first presents the results for the SES-academic performance relationship. Next, the results for the in-
vestigated mediators are provided.
The summative content analysis demonstrated that there are three types of relationships between SES and academic performance
in higher education: namely, positive (n = 25), negative (n = 6), and no significant (n = 12) relationships. A positive relationship
indicated that the better one's socio-economic conditions, the better one's academic performance in higher education. However, a
closer review of the negative relationship (n = 6) revealed enlightening information. Pedrosa et al. (2007) indicated that students who
came from public schools had a better academic performance than their counterparts coming from private schools. Those students
with less favorable socio-economic conditions were able to develop a certain “educational resilience”, which was described by
Pedrosa et al. (2007) as the process of transforming early disadvantages in life into better academic performance in higher education.
In addition, students who either (a) were scholarship holders (Morlaix & Suchaut, 2014), (b) lived in a crowded house (Harb & El-
14
Table 4
The relationship between SES and academic performance in higher education.
Reference N SES-Academic Average Prior academic PAA-AP Average University UE-AP Average Working status WS-AP Average
performance effect size achievement relationship effect size experience (UE) relationship effect size (WS) measure relationship effect size
relationship (PAA) measure measure
15
De Clercq et al. (2013) 111 Positive 0.26 Failure in Negative −0.21
secondary school
De Clercq et al. (2013) 206 Not significant 0.15 Failure in Negative −0.19 Social experience Not 0.15
secondary school (peer support) significant
De Clercq et al. (2017) 2178 Positive 0.12 HSGPA Positive 0.37
Delaney et al. (2011) 1867 Not significant −0.02 Entrance exam Positive 0.31
score
Frischenschlager et al. 245 Not significant HSGPA Positive
(2005)
Gerken and Volkwein – Not significant HSGPA Positive Academic Positive
(2000) experience
Gouvias et al. (2012) 874 Positive 0.06 HSGPA Positive 0.79
Guimarães and Sampaio 54,877 Positive 0.09
(2013)
Hansen and Mastekaasa 56,792 Positive 0.02 HSGPA Positive 0.36
(2006)
Harb and El-Shaarawi 296 Negative −0.05 Science HS Positive 0.11 Institutional Positive 0.17 Employed or not Negative −0.3
(2007) diploma experience
(positive attitude
towards university)
Ifenthaler and 146,001 Not significant
Widanapathirana
(2014)
Loehr et al. (2012) 2667 Positive HSGPA Positive
(continued on next page)
Educational Research Review 29 (2020) 100305
Table 4 (continued)
Reference N SES-Academic Average Prior academic PAA-AP Average University UE-AP Average Working status WS-AP Average
performance effect size achievement relationship effect size experience (UE) relationship effect size (WS) measure relationship effect size
relationship (PAA) measure measure
16
Thiele et al. (2016) 3730 Positive 0.05+ UCAS points Positive 0.003
Triventi (2014) 1834 Positive
Walpole (2003) 6470 Positive 0.01 GPA at entry of Positive 0.09 Academic Positive 0.13
graduate (n = 1177) experience (n = 1177)
program (working on
research)
Wang et al. (2010) 323 Positive 0.06 Institutional Positive 0.12 Reasons for Positive 0.06
experience (sense of working and
belonging and characteristics of
school integration) work
Waqas et al. (2013) 267 Positive 0.05 Employed or not Negative −0.14
Win and Miller (2005) 1803 Positive 0.03+ TER score Positive 0.1
Wolniak and Engberg 3750 Positive HSGPA, SAT Positive 0.26
(2010)
Yanbarisova (2015) 1988 Not significant 0.03 Characteristics of Negative −0.01
work
Yao et al. (2015) 2989 Positive 0.16
Zheng et al. (2002) 1166 Not significant HSGPA Positive
(+) Effect sizes calculated from SES indicators at area level. Not considered in the analysis.
Educational Research Review 29 (2020) 100305
C.F. Rodríguez-Hernández, et al. Educational Research Review 29 (2020) 100305
Fig. 4. Forest plot of the relationship between SES and academic performance in higher education.
Shaarawi, 2007), or (c) came from high schools with a high proportion of free/reduced lunches (Black, Lincove, Cullinane, & Veron,
2015), also had low academic performance in university. Finally, Arulampalam et al. (2004) suggested that students who had higher
scores in biology, chemistry, and physics in high school also had a lower likelihood of dropping out during university.
The meta-analysis revealed that the average effect size of the relationship between SES and academic performance in higher
education was weak and significant (ES = .06, Se = .013, CI = [.03; .08], p < .001). The Q test for homogeneity for this average
effect size was significant (Q = 460.30, df = 22, p < .001). Fig. 4 displays the forest plot with the average effect size of the re-
lationship between SES and academic performance in higher education.
17
C.F. Rodríguez-Hernández, et al. Educational Research Review 29 (2020) 100305
6. Discussion
The objectives of this systematic literature review were (1) to analyze how SES and academic performance in higher education are
measured; (2) to determine whether the relationship between SES and academic performance in higher education is mediated by a)
prior academic achievement; b) university experience; and c) working status.
18
C.F. Rodríguez-Hernández, et al. Educational Research Review 29 (2020) 100305
Second, the results of this study showed that occupation is predominantly assessed using categorical scales. In this regard, a well-
established classification to measure occupation is the Standard Occupation Classification (SOC). Such a classification is based on the
type of work, skills, and level of education. Even though the SOC was first proposed in the USA, national variants also exist in
countries within Europe and Asia. Therefore, the SOC could be used not only for international comparisons but also as a classification
system for countries which have not developed their own classification system.
Third, the findings of this study indicated that income is typically measured with intervals to categorize the amount of money
being earned. However, a more advisable way to operationalize income is through a multiple of the minimum wage paid in each
country (i.e., equivalent to one minimum wage, twice minimum wage, etc.). As such, the minimum wage could be related to the type
of work and level of education of a wage-earner. Besides, the use of the minimum wage as a measurement would allow for the
comparison of socio-economic conditions across several different countries.
Fourth, although the results from this study revealed that measures of household resources are related to the possessions available
at home, it seems adequate to distinguish between material resources and cultural resources (Gouvias et al., 2012). Material resources
are merely the items students have at home (i.e., a personal computer, internet connection, an individual room), while cultural
resources are items which might represent an intellectual added value to the students (i.e., books related to schoolwork or musical
instruments).
Finally, this study revealed that neighborhood resources can be operationalized through indexes which rank areas according to
their socio-economic advantages and disadvantages. Well-established examples of these indexes are the Socio-Economic Indexes for
Areas (SEIFA) proposed by the Australian Bureau of Statistics and the Index of Multiple Deprivation (IMD) proposed by the UK
government. Even though these indexes were developed for specific national contexts, the methodology underlying their creation can
be replicated to develop indexes within each country. However, it does not seem convenient to use these indices directly to measure
students’ SES. What is recommended, instead, is to use area-based indicators such as SEIFA to achieve a better understanding of the
social and economic conditions where students live (Australian Bureau of Statistics, 2011). This suggestion is consistent with previous
meta-analytic studies focusing on primary and secondary education (e.g., Sirin, 2005; White, 1982), where it has been recommended
to avoid using aggregated indicators to assess SES at the individual level, as they can overestimate the effect of the relationship
between SES and academic performance.
6.1.3. The relationship between SES and academic performance in higher education
The third conclusion of this study is that the relationship between SES and academic performance in higher education is weak.
19
C.F. Rodríguez-Hernández, et al. Educational Research Review 29 (2020) 100305
This result is coherent with previous meta-analyses in higher education, which have also reported a weak effect size (e.g., Richardson
et al., 2012). A critical interpretation of the findings of this study could beg the question of the actual importance of SES as a predictor
of academic performance in higher education. To begin with, it could be the case that the influence of socio-economic conditions on
students’ performance is lower in higher education than in previous levels of education (the influence of SES on prior academic
achievement has been well-established in educational research). One can also argue that regardless of the hindrances that low-SES
students face when entering university, those who are admitted share a similar educational experience to their wealthier counterparts
(Smith, 2016). Therefore, the higher education system could have the same influence on any student despite his or her socio-
economic conditions.
Furthermore, the findings of this study indicate that the relationship between SES and academic performance in higher education
is weak when other factors are considered. This fact urges the educational research field to select more robust analytical techniques
when investigating academic performance in higher education. A mere bivariate analysis no longer suffices. In addition, regardless of
the multiple theories in higher education which suggest that SES and academic performance are positively related, strong empirical
evidence supporting these theoretical claims is still missing in the educational literature (Marks, 2017).
However, a weak relationship between SES and academic performance in higher education does not imply that low-SES students
should be ignored or that increasing their participation in university should be dismissed. How to efficiently attend to low-SES
students’ educational needs remains a challenge for the higher education system, and in this respect, the findings of this systematic
literature review might be transferred in one of three ways to properly deal with that challenge.
Firstly, it was identified that prior academic achievement is more strongly related to academic performance in university than
SES. While this finding is not surprising, it does support the need to reinforce the past performance of low-SES students through, for
instance, academic preparation courses before university. An example of this type of program is the enabling programs proposed by
the Australian government. Enabling programs are designed to provide disadvantaged students with specific competencies (e.g.,
literacy, numeracy, communication, and critical thinking skills) so that they can be prepared for their university studies (Pitman
et al., 2016). Moreover, enabling programs are effective pathways to higher education for almost half of the enrolled disadvantaged
students (Hodges et al., 2013).
Secondly, the findings from this study also revealed that the influence of university experience on academic performance is larger
than the influence of SES. The defining factors of the university experience such as classroom climate, quantity and quality of the
instruction (Bruinsma & Jansen, 2007), sense of belonging and school integration (Wang et al., 2010), and peer support (De Clercq
et al., 2013) would help low-SES students to adapt to their new academic settings at university. Interestingly, Devlin, Kift, Nelson,
Smith, and McKay (2012) have proposed a set of teaching guidelines in order to foster low-SES students’ academic performance. Far
from being prescriptive, these guidelines can be understood as key practical advice for teachers whose students come from low socio-
economic settings.
Thirdly, there was also evidence of the likely mediating role of working status in the SES-academic performance relationship. This
finding supports the assumption that working during university studies might have a negative influence on students’ performance.
However, students who work part-time within their academic fields might perform better academically than students who work
outside their academic areas (Wang et al., 2010; Yanbarisova, 2015). Thus, working should allow low-SES students not only to
overcome their financial needs but also to extend their academic experience by increasing their body of knowledge while attending
university. A concrete example of this type of job for low-SES students is serving as an undergraduate teaching assistant (UTA).
6.2. Limitations
Although the results of this systematic literature review provide insights into the relationship between SES and academic per-
formance in higher education, several limitations of the present study should be acknowledged. First, the number of studies which
explore the relationship between SES and academic performance is quite low. Hence, all studies that have aimed to predict academic
performance in higher education were considered. However, a precise definition of the relationship between SES and academic
performance was often lacking in the analyzed studies. Second, several additional variables which might also interact with SES were
not always reported in the reviewed studies. Thus, variables such as students' cognitive factors could not be considered for the
summative content analysis. Third, information about the students' academic programs was not always reported in the analyzed
studies. Therefore, whether the relationship between SES and academic performance in higher education depends on students’
academic programs could not be determined. Fourth, there was no information on the relationship between SES and the meta-
analyzed mediators. Therefore, a complete analysis of the selected mediators could not be carried out. Finally, the Q test for
homogeneity was not significant for the average effect size of university experience. This result might be suggesting that the resulting
average effect size is less generalizable.
Starting from the findings and limitations of this systematic literature review discussed earlier, future research in higher education
could benefit from focusing on several topics, listed as follows. Firstly, it is interesting to note that using dimensional reduction
techniques such as Principal Component Analysis (PCA) leads to a composite score to assess SES. However, composite scores also
represent a limitation to fully capturing the underlying variance of SES indicators. Therefore, the matter of how to construct com-
posite scores to assess SES is an issue which requires further exploration.
Secondly, previous research at the elementary and secondary educational levels (e.g., Sirin, 2005; White, 1982) has demonstrated
20
C.F. Rodríguez-Hernández, et al. Educational Research Review 29 (2020) 100305
the moderating role of methodological aspects, such as the type of SES-achievement measure, on the relationship between SES and
academic performance. However, exploring such a moderating role still remains an unfinished task for the higher education field.
Thirdly, the criticism that standardized tests merely measure students’ socio-economic conditions and do not predict their future
academic performance in higher education (Mattern, Shawn, & Williams, 2008) persists among some educational researchers.
Therefore, further research could contribute to clarifying the relationship between standardized test outcomes, SES, and academic
performance at university.
Fourthly, when considering working status to predict academic performance, it seems essential to include additional char-
acteristics such as the type of work (part-time or full-time), correspondence with the academic field, and reasons for working. In fact,
including working status merely as a dichotomous variable in any predictive analysis of academic performance could be misleading
(Wang et al., 2010). Therefore, to gain a better understanding of the influence of working status, both quantitative and qualitative
research methods are highly recommended (Yanbarisova, 2015).
Fifthly, after completion of their undergraduate degree, low- SES students are more likely to join the workforce instead of
pursuing a postgraduate degree, as seems to be the case with high- SES students (Walpole, 2003). However, an additional question
worth exploring is what happens with the relationship between SES and the academic performance of low- SES students who do
continue to the postgraduate educational level.
Finally, recent educational research (Musso, Kyndt, Cascallar, & Dochy, 2012, 2013; Cascallar, Musso, Kyndt, & Dochy, 2015;
Kyndt, Musso, Cascallar, & Dochy, 2015; Musso & Cascallar, 2009) has utilized predictive systems based on neural network ap-
proaches to study academic performance in primary, secondary, and higher education. The improvement of the validity, the increase
in the accuracy of the predictions and classifications, and the possibility to determine the predictive weight contributions of each of
the variables in the models are the principal advantages of developing predictive systems based on neural networks. Therefore, we
would like to encourage the use of neural networks in order to gain a more exhaustive understanding of the relationship between SES
and academic performance in higher education.
References
Studies marked with an asterisk (∗) were included in the summative content analysis.
Studies marked with a cross (+) were included in the meta-analysis.
Aloe, A. M., & Becker, B. J. (2012). An effect size for regression predictors in meta-analysis. Journal of Educational and Behavioral Statistics, 37, 278–297. https://doi.
org/10.3102/1076998610396901.
Aloe, A. M., & Thompson, C. G. (2013). The synthesis of partial effect sizes. Journal of the Society for Social Work and Research, 4, 390–405. https://doi.org/10.5243/
jsswr.2013.24.
(∗)Anderton, R., Evans, T., & Chivers, P. (2016). Predicting academic success of health science students for first year anatomy and physiology. International Journal of
Higher Education, 5, 250–260. https://doi.org/10.5430/ijhe.v5n1p250.
(∗+)Arulampalam, W., Naylor, R., & Smith, J. (2004). Factors affecting the probability of first year medical student dropout in the UK: A logistic analysis for the intake
cohorts of 1980–92. Medical Education, 38, 492–503. https://doi.org/10.1046/j.1365-2929.2004.01815.x.
Astin, A. W. (1984). Student involvement: A developmental theory for higher education. Journal of College Student Personnel, 25, 297–308.
Astin, A. W. (1993). What matters in college? Four years revisited. San Francisco, USA: Jossey-Bass.
Astin, A. W. (1999). Student involvement: A developmental theory for higher education. Journal of College Student Development, 40, 518–529.
Australian Bureau of Statistics (2011). Measures of socioeconomic status. ABS Publication No. 1244.0.55.001 . Retrieved from: http://www.ausstats.abs.gov.au/
Ausstats/subscriber.nsf/0/367D3800605DB064CA2578B60013445C/$File/1244055001_2011.pdf.
Aveyard, H. (2014). Doing a literature review in health and social care: A practical guide. London, United Kingdom: McGraw-Hill Educationhttps://doi.org/10.7748/nr.18.
4.45.s2.
(∗)Bahamón, M. J., & Reyes Ruiz, L. (2014). Characterization of the intellectual capacity, sociodemographic, and academic factors of the students with high and low
performance in the SABER PRO test – 2012 [Caracterización de la capacidad intelectual, factores sociodemográficos y académicos de estudiantes con alto y bajo
desempeño en los exámenes SABER PRO-AÑO 2012]. Avances en Psicología Latinoamericana, 32, 459–476. https://doi.org/10.12804/apl32.03.2014.01.
Betts, L. R., Elder, T. J., Hartley, J., & Blurton, A. (2008). Predicting university performance in Psychology: The role of previous performance and discipline-specific
knowledge. Educational Studies, 34, 543–556. https://doi.org/10.1080/03055690802288528.
(∗+)Beyene, K. M., & Yimam, J. A. (2016). Multilevel analysis for identifying factors influencing academic achievement of students in higher education institution:
The case of Wollo University. Journal of Education and Practice, 7, 17–23.
(∗+)Birch, E. R., & Miller, P. W. (2006). Student outcomes at university in Australia: A quantile regression approach. Australian Economic Papers, 45, 1–17. https://doi.
org/10.1111/j.1467-8454.2006.00274.x.
(∗)Black, S. E., Lincove, J., Cullinane, J., & Veron, R. (2015). Can you leave high school behind?. Economics of Education Review, 46, 52–63. https://doi.org/10.3386/
w19842.
Blömeke, S., Zlatkin-Troitschanskaia, O., Kuhn, C., & Fege, J. (2013). Modeling and measuring competencies in higher education. In S. Blömeke, O. Zlatkin-
Troitschanskaia, C. Kuhn, & J. Fege (Eds.). Professional and vet learning: Vol. 1. Modeling and measuring competencies in higher education (pp. 1–10). Dordrecht, The
Netherlands: Sense Publishers. https://doi.org/10.1007/978-94-6091-867-4.
(∗+)Bonsaksen, T. (2016). Predictors of academic performance and education programme satisfaction in occupational therapy students. British Journal of Occupational
Therapy, 79, 361–367. https://doi.org/10.1177/0308022615627174.
Borenstein, M., Hedges, L. V., Higgins, J. P., & Rothstein, H. R. (2009). Introduction to meta-analysis. Chichester, UK: John Wiley.
Bourdieu, P. (1986). The forms of capital. In J. Richardson (Ed.). Handbook of theory and research for the sociology of education (pp. 241–258). New York, NY:
Greenwood.
Bowman, N. A. (2012). Effect sizes and statistical methods for meta-analysis in higher education. Research in Higher Education, 53, 375–382. https://doi.org/10.1007/
s11162-011-9232-5.
(∗+)Bozick, R. (2007). Making it through the first year of college: The role of students' economic resources, employment, and living arrangements. Sociology of
Education, 80, 261–285. https://doi.org/10.1177/003804070708000304.
(∗+)Bruinsma, M., & Jansen, E. P. W. A. (2007). Educational productivity in higher education: An examination of part of the Walberg educational productivity model.
21
C.F. Rodríguez-Hernández, et al. Educational Research Review 29 (2020) 100305
22
C.F. Rodríguez-Hernández, et al. Educational Research Review 29 (2020) 100305
Long, D. (2012). Theories and models of student development. In L. J. Hinchliffe, & M. A. Wong (Eds.). Environments for student growth and development: Librarians and
student affairs in collaboration (pp. 41–55). Chicago: Association of College & Research Libraries.
Marks, G. N. (2017). Is SES really that important for educational outcomes in Australia? A review and some recent evidence. Australian Educational Researcher, 44,
191–211. https://doi.org/10.1007/s13384-016-0219-2.
Mattern, K., Shawn, E., & Williams, F. (2008). Examining the relationship between the SAT®, high school measures of academic performance, and socioeconomic status:
Turning our attention to the unit of analysis (College Board RN-36) . Retrieved from: https://files.eric.ed.gov/fulltext/ED562606.pdf.
McKenzie, K., & Schweitzer, R. (2001). Who succeeds at university? Factors predicting academic performance in first year Australian university students. Higher
Education Research and Development, 20, 21–33. https://doi.org/10.1080/07924360120043621.
(∗)Morlaix, S., & Suchaut, B. (2014). The social, educational and cognitive factors of success in the first year of university: A case study. International Review of
Education, 60, 841–862. https://doi.org/10.1007/s11159-014-9459-4.
Mueller, C. W., & Parcel, T. L. (1981). Measures of socioeconomic status: Alternatives and recommendations. Child Development, 52, 13–30. https://doi.org/10.2307/
1129211.
Musso, M. F., & Cascallar, E. C. (2009). Predictive systems using artificial neural networks: An introduction to concepts and applications in education and social
sciences. In M. C. Richaud, & J. E. Moreno (Vol. Eds.), Research in behavioral sciences: Vol. 1, (pp. 433–459). Buenos Aires, Argentina: CIIPME/CONICET.
Musso, M., Kyndt, E., Cascallar, E. C., & Dochy, F. (2012). Predicting mathematical performance: The effects of cognitive processes and self-regulation factors.
Educational Research International, 1–13. https://doi.org/10.1155/2012/250719 2012.
Musso, M. F., Kyndt, E., Cascallar, E. C., & Dochy, F. (2013). Predicting general academic performance and identifying the differential contribution of participating
variables using artificial neural networks. Frontline Learning Research, 1, 42–71. https://doi.org/10.14786/flr.v1i1.13.
Nakao, K., & Treas, J. (1994). Updating occupational prestige and socioeconomic scores: How the new measures measure up. Sociological Methodology, 24, 1–72.
https://doi.org/10.2307/270978.
National Institute for Health and Clinical Excellence (2009). Methods for the development of NICE public health guidance (2nd ed.). . Retrieved from http://www.nice.org.
uk/media/2FB/53/PHMethodsManual110509.pdf.
(∗)Nguyen, T. M. (2016). Learning approaches, demographic factors to predict academic outcomes. International Journal of Educational Management, 30, 653–667.
https://doi.org/10.1108/ijem-06-2014-0085.
Nonis, S. A., & Hudson, G. I. (2006). Academic performance of college students: Influence of time spent studying and working. The Journal of Education for Business, 81,
151–159. https://doi.org/10.3200/joeb.81.3.151-159.
(∗)Pedrosa, R. H., Dachs, J. N. W., Maia, R. P., Andrade, C. Y., & Carvalho, B. S. (2007). Academic performance, students' background and affirmative action at a
Brazilian University. Higher Education Management and Policy, 19, 1–20. https://doi.org/10.1787/hemp-v19-art18-en.
Peterson, R. A., & Brown, S. P. (2005). On the use of beta coefficients in meta-analysis. Journal of Applied Psychology, 90, 175–181. https://doi.org/10.1037/0021-
9010.90.1.175.
Pike, G. R., & Saupe, J. L. (2002). Does high school matter? An analysis of three methods of predicting first-year grades. Research in Higher Education, 43, 187–207.
Pitman, T., Trinidad, S., Devlin, M., Harvey, A., Brett, M., & McKay, J. (2016). Pathways to higher education: The efficacy of enabling and sub-bachelor pathways for
disadvantaged students. National centre for student equity in higher education (NCSEHE). Perth: Curtin University.
(∗+)Puddey, I. B., & Mercer, A. (2014). Predicting academic outcomes in an Australian graduate entry medical programme. BMC Medical Education, 14, 1–12. https://
doi.org/10.1186/1472-6920-14-31.
Reason, R. D. (2009). An examination of persistence research through the lens of a comprehensive conceptual framework. Journal of College Student Development, 50,
659–682. https://doi.org/10.1353/csd.0.0098.
Richardson, M., Abraham, C., & Bond, R. (2012). Psychological correlates of university students' academic performance: A systematic review and meta-analysis.
Psychological Bulletin, 138, 353–387. https://doi.org/10.1037/a0026838.
Roberts, A. S. (2007). Predictors of future performance in architectural design education. Educational Psychology, 27, 447–463. https://doi.org/10.1080/
01443410601104361.
Rochford, C., Connolly, M., & Drennan, J. (2009). Paid part-time employment and academic performance of undergraduate nursing students. Nurse Education Today,
29, 601–606. https://doi.org/10.1016/j.nedt.2009.01.004.
(∗)Rodríguez Albor, G., Ariza Dau, M., & Ramos Ruíz, J. L. (2014). Calidad institucional y rendimiento académico: El caso de las universidades del Caribe colombiano.
[Institutional quality and academic performance: The case of Colombian Caribbean universities]. Perfiles Educativos, 36, 10–29. https://doi.org/10.1016/s0185-
2698(14)70607-5.
(∗+)Rodríguez Ayan, M. N., & Ruiz Díaz, M. A. (2011). Performance's indicators of college students: Grades versus accumulated credits [Indicadores de rendimiento
de estudiantes universitarios: Calificaciones versus créditos acumulados]. doi:10-4438/1988-592X-RE-2011-355-033 Revista de Educación, 355, 467–492.
(∗+)Rothstein, J. M. (2004). College performance predictions and the SAT. Journal of Econometrics, 121, 297–317. https://doi.org/10.1016/j.jeconom.2003.10.003.
Rothstein, H. R., Sutton, A. J., & Borenstein, M. (2005). Publication bias in meta-analysis: Prevention, assessment and adjustments. Chichester, UK: John Wiley.
(∗+)Sackett, P. R., Kuncel, N. R., Arneson, J. J., Cooper, S. R., & Waters, S. D. (2009). Does socioeconomic status explain the relationship between admissions tests and
post-secondary academic performance? Psychological Bulletin, 135, 1–22. https://doi.org/10.1037/a0013978.
Sackett, P. R., Kuncel, N. R., Beatty, A. S., Rigdon, J. L., Shen, W., & Kiger, T. B. (2012). The role of socioeconomic status in SAT-grade relationships and in college
admissions decisions. Psychological Science, 23, 1000–1007. https://doi.org/10.1177/0956797612438732.
Sadler, D. R. (2013). Making competent judgments of competence. In S. Blömeke, O. Zlatkin-Troitschanskaia, C. Kuhn, & J. Fege (Eds.). Professional and vet learning:
Vol. 1. Modeling and measuring competencies in higher education (pp. 13–27). Dordrecht, The Netherlands: Sense Publishers. https://doi.org/10.1007/978-94-6091-
867-4.
Scheerens, J. (1990). School effectiveness research and the development of process indicators of school functioning. School Effectiveness and School Improvement, 1,
61–80. https://doi.org/10.1080/0924345900010106.
Schneider, S. L. (2013). The international standard classification of education 2011. In G. E. Birkelund (Ed.). Comparative social research: Vol. 30. Class and stratification
analysis (pp. 365–379). Bingley, UK: Emerald Group Publishing Limited. https://doi.org/10.1108/s0195-6310(2013)0000030017.
Schneider, M., & Preckel, F. (2017). Variables associated with achievement in higher education: A systematic review of meta-analyses. Psychological Bulletin, 143,
565–600. https://doi.org/10.1037/bul0000098.
Shavelson, R. J. (2010). On the measurement of competency. Empirical Research in Vocational Education and Training, 2, 41–63.
Shavers, V. L. (2007). Measurement of socioeconomic status in health disparities research. Journal of the National Medical Association, 99, 1013–1023.
(∗)Shulruf, B., Hattie, J., & Tumen, S. (2008). Individual and school factors affecting students' participation and success in higher education. Higher Education, 56,
613–632. https://doi.org/10.1007/s10734-008-9114-8.
Sidhu, K. S. (2005). New approaches to measurement and evaluation. New Delhi: India: Sterling Publishers Private Limited.
Sirin, S. (2005). Socioeconomic status and academic achievement: A meta-analytic review of research. Review of Educational Research, 75, 417–453. https://doi.org/10.
3102/00346543075003417.
(∗+)Smith, E. (2016). Can higher education compensate for society? Modelling the determinants of academic success at university. British Journal of Sociology of
Education, 37, 970–992. https://doi.org/10.1080/01425692.2014.987728.
Stinebrickner, R., & Stinebrickner, T. R. (2003). Working during school and academic performance. Journal of Labor Economics, 21, 473–491. https://doi.org/10.1086/
345565.
(∗)Stratton, L. S., & Wetzel, J. N. (2011, May). The role of socioeconomic status when controlling for academic background in a multinomial logit model of six-year
college outcomes. Paper presented at the 51st annual forum of the association for institutional research, Toronto, ON.
Sullivan, A. (2001). Cultural capital and educational attainment. Sociology, 35, 893–912. https://doi.org/10.1017/s0038038501008938.
(∗+)Tai, R. H., Sadler, P. M., & Loehr, J. F. (2005). Factors influencing success in introductory college chemistry. Journal of Research in Science Teaching, 42, 987–1012.
https://doi.org/10.1002/tea.20082.
23
C.F. Rodríguez-Hernández, et al. Educational Research Review 29 (2020) 100305
The World Bank (2012). Reviews of national policies for education: Tertiary education in Colombia 2012. Paris: OECD Publishinghttps://doi.org/10.1787/
9789264180697-en.
(∗+)Thiele, T., Singleton, A., Pope, D., & Stanistreet, D. (2016). Predicting students' academic performance based on school and socio-demographic characteristics.
Studies in Higher Education, 41, 1424–1446. https://doi.org/10.1080/03075079.2014.974528.
Tinto, V. (1975). Dropout from higher education: A theoretical synthesis of recent research. Review of Educational Research, 45, 89–125.
Tinto, V. (1993). Leaving college. Rethinking the causes and cures of student attrition. Chicago, IL: The University of Chicago Press.
Tracey, T. J., Allen, J., & Robbins, S. B. (2012). Moderation of the relation between person–environment congruence and academic success: Environmental constraint,
personal flexibility and method. Journal of Vocational Behavior, 80, 38–49. https://doi.org/10.1016/j.jvb.2011.03.005.
(∗)Triventi, M. (2014). Does working during higher education affect students' academic progression? Economics of Education Review, 41, 1–13. https://doi.org/10.
1016/j.econedurev.2014.03.006.
Van Ewijk, R., & Sleegers, P. (2010). The effect of peer socioeconomic status on student achievement: A meta-analysis. Educational Research Review, 5, 134–150.
https://doi.org/10.1016/j.edurev.2010.02.001.
(∗+)Walpole, M. (2003). Socioeconomic status and college: How SES affects college experiences and outcomes. The Review of Higher Education, 27, 45–73. https://doi.
org/10.1353/rhe.2003.0044.
(∗+)Wang, H., Kong, M., Shan, W., & Vong, S. K. (2010). The effects of doing parttime jobs on college student academic performance and social life in a Chinese
society. Journal of Education and Work, 23, 79–94. https://doi.org/10.1080/13639080903418402.
(∗+)Waqas, M., Abbasi, A., & Idrees, R. (2013). Academic performance of undergraduates in universities of Pakistan. Middle-East Journal of Scientific Research, 16,
55–61.
Warburton, E., Bugarin, R., & Nuñez, A. (2001). Bridging the gap: Academic preparation and postsecondary success of first-generation students (NCES 2001–153).
Washington, DC: National Center for Education Statistics, U.S. Government Printing Office.
Westrick, P. A., Le, H., Robbins, S. B., Radunzel, J. M., & Schmidt, F. L. (2015). College performance and retention: A meta-analysis of the predictive validities of ACT®
scores, high school grades, and SES. Educational Assessment, 20, 23–45. https://doi.org/10.1080/10627197.2015.997614.
White, K. (1982). The relation between socioeconomic status and academic achievement. Psychological Bulletin, 91, 461–481. https://doi.org/10.1037//0033-2909.91.
3.461.
(∗+)Win, R., & Miller, P. W. (2005). The effects of individual and school factors on university students' academic performance. The Australian Economic Review, 38,
1–18. https://doi.org/10.1111/j.1467-8462.2005.00349.x.
(∗+)Wolniak, G. C., & Engberg, M. E. (2010). Academic achievement in the first year of college: Evidence of the pervasive effects of the high school context. Research
in Higher Education, 51, 451–467. https://doi.org/10.1007/s11162-010-9165-4.
(∗+)Yanbarisova, D. M. (2015). The effects of student employment on academic performance in Tatarstan higher education institutions. Russian Education and Society,
57, 459–482. https://doi.org/10.1080/10609393.2015.1096138.
(∗+)Yao, G., Zhimin, L., & Peng, F. (2015). The effect of family capital on the academic performance of college students. A survey at 20 higher education institutions
in Jiangsu province. Chinese Education and Society, 48, 81–91. https://doi.org/10.1080/10611932.2015.1014713.
York, T. T., Gibson, C., & Rankin, S. (2015). Defining and measuring academic success. Practical Assessment, Research and Evaluation, 20, 1–20.
Yusuf, A. (2002). Interrelationships among academic performance, academic achievement and learning outcomes. Journal of Curriculum and Instruction, 1, 87–96.
(∗)Zheng, J. L., Saunders, K. P., Shelley, I. I., Mack, C., & Whalen, D. F. (2002). Predictors of academic success for freshmen residence hall students. Journal of College
Student Development, 43, 267–283.
Zlatkin-Troitschanskaia, O., Shavelson, R. J., & Kuhn, C. (2015). The international state of research on measurement of competency in higher education. Studies in
Higher Education, 40, 393–411. https://doi.org/10.1080/03075079.2015.1004241.
Zwick, R. (2012). The role of admissions test scores, socioeconomic status, and high school grades in predicting college achievement. Pensamiento Educativo. Revista de
Investigación Educacional Latinoamericana, 2, 23–30. https://doi.org/10.7764/pel.49.2.2012.3.
24