research-article

Examining University Ranking Metrics: Articulating Issues of Size and Web Dependency

Authors:

Zachary TaylorAuthors Info & Claims

ICCBD '18: Proceedings of the 2018 International Conference on Computing and Big Data

Pages 73 - 77

https://doi.org/10.1145/3277104.3277111

Published: 08 September 2018 Publication History

Abstract

Universities pay serious attention to a wide variety of rankings in comparison with other national or international universities. Such ranking is used for peer comparisons, funds' acquisition and distribution, hiring, recruiting, and more. Several organizations or websites evaluate and publish those rankings yearly. In this paper, we evaluated those ranking models. We showed influence of University size, and web presence as two major contributing factors. We noticed while most ranking metrics claim that such two factors have no significant impact on their overall ranking methods, we showed in this paper that such dependency is significant. We also proposed methods to normalize or equalize such influences and showed that such methods are feasible and hence should be adopted.

References

[1]

Forbes Media, LLC. (2017). America's top colleges. Retrieved from https://www.forbes.com/top-colleges/#167b3cf61987.

[2]

Quacquarelli Symonds Limited. (2017). QS world university rankings. Retrieved from https://www.topuniversities.com/university-rankings/world-university-rankings/2018

[3]

Griffith, A., & Rask, K. (2007). The influence of the US News and World Report collegiate rankings on the matriculation decision of high-ability students: 1995-2004. Economics of Education Review, 26(2), 244--255.

[4]

Hazelkorn, E. (2009). Impact of global rankings on higher education research and production of knowledge. Unesco Forum on Higher Education, Research and Knowledge, (18), 1--14.

[5]

Sauder, M., & Espeland, W. N. (2009). The discipline of rankings: Tight coupling and organizational change. American Sociological Review, 74(1), 63--82.

[6]

Bastedo, M. N., & Bowman, N. A. (2010). U.S. News & World Report college rankings: Modeling institutional effects on organizational reputation. American Journal of Education, 116(2), 163--183.

[7]

Gnolek, S. L., Falciano, V. T., & Kuncl, R. W. (2014). Modeling change and variation in U.S. News & World Report college rankings: What would it really take to be in the top 20? Research in Higher Education, 55(8), 761--779.

[8]

Cybermetrics Lab. (2017a). About us. Retrieved from http://www.webometrics.info/en.

[9]

ShanghaiRanking Consultancy. (2017a). About academic ranking of world universities. Retrieved from http://www.shanghairanking.com/aboutarwu.html

[10]

Altbach, P. G. (2012). The globalization of college and university rankings. Change: The Magazine of Higher Learning, 44(1), 26--31.

[11]

Marginson, S. (2014). University rankings and social science. European Journal of Education, 49(1), 45--59.

[12]

van Dijk, D., Manor, O., & Carey, L. B. (2014). Publication metrics and success on the academic job market. Current Biology, 24(11), 516--517.

[13]

Bunzel, D. L. (2007). Universities sell their brands. Journal of Product & Brand Management, 16(2), 152--153.

[14]

Marginson, S. (2014). University rankings and social science. European Journal of Education, 49(1), 45--59.

[15]

Grewal, R., Dearden, J. A., & Glilien, G. L. (2008). The university rankings game: Modeling the competition among universities for ranking. The American Statistician, 62(3), 232--237.

[16]

Ingwersen, P. (1998). The calculation of web impact factors. Journal of Documentation, 54(2), 236--243.

[17]

National Center for Education Statistics. (2017). Integrated postsecondary education database. Retrieved from https://nces.ed.gov/ipeds/Home/UseTheData

[18]

Safón, V. (2013). What do global university rankings really measure? The search for the X factor and the X entity. Scientometrics, 97(2), 223--244.

Digital Library

Cited By

Rybiński KWodecki A(2022)Are university ranking and popularity related? An analysis of 500 universities in Google Trends and the QS ranking in 2012-2020Journal of Marketing for Higher Education10.1080/08841241.2022.204995234:2(584-601)Online publication date: 13-Mar-2022
https://doi.org/10.1080/08841241.2022.2049952
Leydesdorff LWagner CZhang L(2021)Are University Rankings Statistically Significant? A Comparison among Chinese Universities and with the USAJournal of Data and Information Science10.2478/jdis-2021-00146:2(67-95)Online publication date: 2-Mar-2021
https://doi.org/10.2478/jdis-2021-0014
Sarwar RZia ANawaz RFayoumi AAljohani NHassan S(2021)Webometrics: evolution of social media presence of universitiesScientometrics10.1007/s11192-020-03804-yOnline publication date: 3-Jan-2021
https://doi.org/10.1007/s11192-020-03804-y
Show More Cited By

Index Terms

Examining University Ranking Metrics: Articulating Issues of Size and Web Dependency
1. Information systems
  1. Information retrieval

Recommendations

Incorporating robustness into web ranking evaluation
CIKM '09: Proceedings of the 18th ACM conference on Information and knowledge management

In many Web search engines, a ranking function is selected for deployment mainly by comparing the relevance measurements over candidates. Due to the dynamical nature of the Web, the ranking features and the query and URL distribution on which the ...
Google Scholar's Ranking Algorithm: The Impact of Articles' Age (An Empirical Study)
ITNG '09: Proceedings of the 2009 Sixth International Conference on Information Technology: New Generations

Google Scholar is one of the major academic search engines but its ranking algorithm for academic articles is unknown. In recent studies we partly reverse-engineered the algorithm. This paper presents the results of our third study. While the first ...
Comparing both relevance and robustness in selection of web ranking functions
SIGIR '09: Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval

In commercial search engines, a ranking function is selected for deployment mainly by comparing the relevance measurements over candidates. In this paper we suggest to select Web ranking functions according to both their relevance and robustness to the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICCBD '18: Proceedings of the 2018 International Conference on Computing and Big Data

September 2018

103 pages

ISBN:9781450365406

DOI:10.1145/3277104

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 September 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICCBD '18

ICCBD '18: 2018 International Conference on Computing and Big Data

September 8 - 10, 2018

SC, Charleston, USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
149
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)1

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Rybiński KWodecki A(2022)Are university ranking and popularity related? An analysis of 500 universities in Google Trends and the QS ranking in 2012-2020Journal of Marketing for Higher Education10.1080/08841241.2022.204995234:2(584-601)Online publication date: 13-Mar-2022
https://doi.org/10.1080/08841241.2022.2049952
Leydesdorff LWagner CZhang L(2021)Are University Rankings Statistically Significant? A Comparison among Chinese Universities and with the USAJournal of Data and Information Science10.2478/jdis-2021-00146:2(67-95)Online publication date: 2-Mar-2021
https://doi.org/10.2478/jdis-2021-0014
Sarwar RZia ANawaz RFayoumi AAljohani NHassan S(2021)Webometrics: evolution of social media presence of universitiesScientometrics10.1007/s11192-020-03804-yOnline publication date: 3-Jan-2021
https://doi.org/10.1007/s11192-020-03804-y
Alsmadi ITaylor ZChilds J(2020)U.S. News & World Report Best Colleges rankings: Which institutional metrics contribute to sustained stratification?Scientometrics10.1007/s11192-020-03560-zOnline publication date: 13-Jun-2020
https://doi.org/10.1007/s11192-020-03560-z
Taylor ZChilds JBicak IAlsmadi I(2019)Is Bigger, Better? Exploring U.S. News Graduate Education Program Rankings and Internet CharacteristicsInterchange10.1007/s10780-019-09366-0Online publication date: 17-Apr-2019
https://doi.org/10.1007/s10780-019-09366-0

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents