research-article

Learning analytics in higher education --- challenges and policies: a review of eight learning analytics policies

Authors:

Dragan GasevicAuthors Info & Claims

LAK '17: Proceedings of the Seventh International Learning Analytics & Knowledge Conference

Pages 233 - 242

https://doi.org/10.1145/3027385.3027400

Published: 13 March 2017 Publication History

Abstract

This paper presents the results of a review of eight policies for learning analytics of relevance for higher education, and discusses how these policies have tried to address prominent challenges in the adoption of learning analytics, as identified in the literature. The results show that more considerations need to be given to establishing communication channels among stakeholders and adopting pedagogy-based approaches to learning analytics. It also reveals the shortage of guidance for developing data literacy among end-users and evaluating the progress and impact of learning analytics. Moreover, the review highlights the need to establish formalised guidelines to monitor the soundness, effectiveness, and legitimacy of learning analytics. As interest in learning analytics among higher education institutions continues to grow, this review will provide insights into policy and strategic planning for the adoption of learning analytics.

References

[1]

Ali, L., Asadi, M., Gašević, D., Jovanović, J. and Hatala, M. 2013. Factors Influencing Beliefs for Adoption of a Learning Analytics Tool: An Empirical Study. Computers & Education. 62, (Mar. 2013), 130--148.

Digital Library

[2]

Arnold, K.E., Lonn, S. and Pistilli, M.D. 2014. An Exercise in Institutional Reflection: The Learning Analytics Readiness Instrument (LARI). Proceedings of the Fourth International Conference on Learning Analytics And Knowledge (New York, NY, USA, 2014), 163--167.

Digital Library

[3]

Arnold, K.E., Lynch, G., Huston, D., Wong, L., Jorn, L. and Olsen, C.W. 2014. Building Institutional Capacities and Competencies for Systemic Learning Analytics Initiatives. Proceedings of the Fourth International Conference on Learning Analytics And Knowledge (New York, NY, USA, 2014), 257--260.

Digital Library

[4]

Arnold, K.E. and Pistilli, M.D. 2012. Course Signals at Purdue: Using Learning Analytics to Increase Student Success. Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (New York, NY, USA, 2012), 267--270.

Digital Library

[5]

Arroway, P., Morgan, G., O'Keefe, M. and Yanosky, R. 2016. Learning Analytics in Higher Education. ECAR.

[6]

Baer, L.L., Duin, A.H., Norris, D. and Brodnick, R. 2013. Crafting Transformative Strategies for Personalized Learning/Analytics. Proceedings of the Third International Conference on Learning Analytics and Knowledge (New York, NY, USA, 2013), 275--277.

Digital Library

[7]

Baron, J., Whatley, M., Schilling, J. and McGovern, M. 2013. Scaling Learning Analytics across Institutions of Higher Education. EDUCAUSE.

[8]

Bichsel, J. 2012. Analytics in Higher Education: Benefits, Barriers, Progress, and Recommendations. ECAR.

[9]

Charles Sturt University 2015. CSU Learning Analytics Code of Practice. Charles Sturt University.

[10]

Colvin, C., Rogers, T., Wade, A., Dawson, S., Gasevic, D., Shum, S.B., Nelson, K., Alexander, S., Lockyer, L., Kennedy, G., Corrin, L. and Fisher, J. 2015. Student Retention and Learning Analytics: A Snapshot of Australian Practices and a Framework for Advancement. The Australian Government Office for Learning and Teaching.

[11]

Drachsler, H. and Greller, W. 2016. Privacy and Analytics: It's a DELICATE Issue a Checklist for Trusted Learning Analytics. Proceedings of the Sixth International Conference on Learning Analytics & Knowledge (New York, NY, USA, 2016), 89--98.

Digital Library

[12]

Dyckhoff, A.L. 2011. Implications for Learning Analytics Tools: A Meta-analysis of Applied Research Questions. International Journal of Computer Information Systems and Industrial Management Applications. 3, (2011), 594--601.

[13]

Ferguson, R., Macfadyen, L.P., Clow, D., Tynan, B., Alexander, S. and Dawson, S. 2014. Setting Learning Analytics in Context: Overcoming the Barriers to Large-Scale Adoption. Journal of Learning Analytics. 1, 3 (Sep. 2014), 120--144.

[14]

Goldstein, P.J. and Katz, R.N. 2005. Academic Analytics: The Uses of Management Information and Technology in Higher Education. ECAR.

[15]

Hoel, T. and Chen, W. 2015. Data Sharing for Learning Analytics - Questioning the Risks and Benefits. Proceedings of the 23rd International Conference on Computers in Education (ICCE (2015).

[16]

Macfadyen, L. and Dawson, S. 2012. Numbers Are Not Enough. Why E-learning Analytics Failed to Inform an Institutional Strategic Plan. Faculty of Education - Papers (Archive). (Jan. 2012), 149--163.

[17]

Macfadyen, L.P., Dawson, S., Pardo, A. and Gaševic, D. 2014. Embracing Big Data in Complex Educational Systems: The Learning Analytics Imperative and the Policy Challenge. Research & Practice in Assessment. 9, (2014), 17--28.

[18]

National Union of Students 2015. Learning Analytics: A Guide for Students' Unions. National Union of Students.

[19]

Newland, B., Martin, L. and Ringan, N. 2015. Learning Analytics in UK HE 2015: A HeLF Survey Report.

[20]

Norris, D.M. and Baer, L.L. 2013. Building Organizational Capacity for Analytics.

[21]

Nottingham Trent University 2015. Use of Learning Analytics to Support Student Success Policy. Nottingham Trent University.

[22]

Oster, M., Lonn, S., Pistilli, M.D. and Brown, M.G. 2016. The Learning Analytics Readiness Instrument. Proceedings of the Sixth International Conference on Learning Analytics & Knowledge (New York, NY, USA, 2016), 173--182.

Digital Library

[23]

Sclater, N. 2014. Learning Analytics: The Current State of Play in UK Higher and Further Education. Jisc.

[24]

Sclater, N. and Bailey, P. 2015. Code of Practice for Learning Analytics. Jisc.

[25]

SEG Education Committee 2016. Principles for the Use of University-held Student Personal Information for Learning Analytics at The University of Sydney. The University of Sydney.

[26]

Siemens, G., Dawson, S. and Lynch, G. 2013. Improving the Quality and Productivity of the Higher Education Sector: Policy and Strategy for Systems-level Deployment of Learning Analytics. Society for Learning Analytics Research for the Australian Office for Learning and Teaching.

[27]

Signals: Applying Academic Analytics: 2010. http://er.educause.edu/articles/2010/3/signals-applying-academic-analytics. Accessed: 2016-07-27.

[28]

Slade, S. and Prinsloo, P. 2014. Student Perspectives on the Use of Their Data: Between Intrusion, Surveillance and Care. Challenges for Research into Open & Distance Learning: Doing Things Better-Doing Better Things (Oxford, UK, Oct. 2014), 291--300.

[29]

Steiner, C.M., Masci, D., Johnson, M., Türker, A., Drnek, M. and Kickmeier-Rust, M. 2014. Privacy and Data ProtectionPolicy. Deliverable D2.3. LEA's Box.

[30]

The European Parliament and the Council of the European Union 2016. Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the Protection of Natural Persons with Regard to the Processing of Personal Data and on the Free Movement of Such Data, and Repealing Directive 95/46/EC (General Data Protection Regulation) (Text with EEA Relevance). Official Journal of the European Union. OJ, L119 (May 2016), 1--88.

[31]

The Open University 2014. Policy on Ethical use of Student Data for Learning Analytics. The Open University.

[32]

Wasson, B. and Hansen, C. 2015. Data Literacy and Use for Teaching. Measuring and Visualizing Learning in the Information-Rich Classroom. P. Reimann, S. Bull, M. Kickmeier-Rust, R. Vatrapu, and B. Wasson, eds. Routledge. 56--73.

[33]

Wolff, A., Moore, J., Zdrahal, Z., Hlosta, M. and Kuzilek, J. 2016. Data Literacy for Learning Analytics. Proceedings of the Sixth International Conference on Learning Analytics & Knowledge (New York, NY, USA, 2016), 500--501.

Digital Library

[34]

Yanosky, R. 2009. Institutional Data Management in Higher Education. ECAR.

[35]

Yanosky, R. and Arroway, P. 2015. The Analytics Landscape in Higher Education. ECAR.

[36]

Young, J. and Mendizabal, E. 2009. Helping Researchers Become Policy Entrepreneurs-How to Develop Engagement Strategies for Evidence-based Policy-making. Overseas Development Institute.

Cited By

Fadli SEl Mediouni A(2025)Digital Transformation in Higher Education: Moroccan University Students’ Perceptions and Expectations on Learning Analytics Implementation for Learning OptimizationInternationalization of Higher Education and Digital Transformation10.1007/978-3-031-76444-8_14(259-276)Online publication date: 6-Feb-2025
https://doi.org/10.1007/978-3-031-76444-8_14
Taşçı STunaz M(2024)OPPORTUNITIES AND CHALLENGES IN AI-ASSISTED LANGUAGE TEACHING: PERCEPTIONS OF PRE-SERVICE EFL TEACHERSAraştırma ve Deneyim Dergisi10.47214/adeder.15758979:2(74-83)Online publication date: 15-Dec-2024
https://doi.org/10.47214/adeder.1575897
Merello AMorante PLara AFarias G(2024)Impacto de las inteligencias artificiales en el bachillerato técnico en producciones agropecuarias en Mocache, Los Ríos, EcuadorSouth Florida Journal of Development10.46932/sfjdv5n9-0255:9(e4381)Online publication date: 17-Sep-2024
https://doi.org/10.46932/sfjdv5n9-025
Show More Cited By

Index Terms

Learning analytics in higher education --- challenges and policies: a review of eight learning analytics policies
1. Applied computing
  1. Education
2. Security and privacy
  1. Human and societal aspects of security and privacy

Recommendations

Untangling connections between challenges in the adoption of learning analytics in higher education
Abstract
Potential benefits of learning analytics (LA) for improving students’ performance, predicting students’ success, and enhancing teaching and learning practice have increasingly been recognized in higher education. However, the adoption of LA in ...
Improving Higher Education: Learning Analytics & Recommender Systems Research
RecSys '17: Proceedings of the Eleventh ACM Conference on Recommender Systems

An enduring issue in higher education is student retention to successful graduation. Studies in the U.S. report that average six-year graduation rates across higher-education institutions is 59% and have remained relatively stable over the last 15 ...
A Systematic Review on Big Data Analytics Frameworks for Higher Education - Tools and Algorithms
EBIMCS '19: Proceedings of the 2019 2nd International Conference on E-Business, Information Management and Computer Science

The development of Big Data applications in education has drawn much attention in the last few years due to the enormous benefits it brings to improving teaching and learning. The integration of these Big Data applications in education generates massive ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

LAK '17: Proceedings of the Seventh International Learning Analytics & Knowledge Conference

March 2017

631 pages

ISBN:9781450348706

DOI:10.1145/3027385

General Chairs:
Alyssa Wise
New York University, USA
,
Phillip H. Winne
Simon Fraser University, Canada
,
Grace Lynch
Society for Learning Analytics Research
,
Program Chairs:
Xavier Ochoa
Escuela Superior Politecnica del Litoral, Ecuador
,
Inge Molenaar
Radboud University, The Netherlands
,
Shane Dawson
University of South Australia, Australia
,
Publications Chair:
Marek Hatala
Simon Fraser University, Canada

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 March 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

European Commission

Conference

LAK '17

LAK '17: 7th International Learning Analytics and Knowledge Conference

March 13 - 17, 2017

British Columbia, Vancouver, Canada

Acceptance Rates

LAK '17 Paper Acceptance Rate 36 of 114 submissions, 32%;

Overall Acceptance Rate 236 of 782 submissions, 30%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

121
Total Citations
View Citations
2,787
Total Downloads

Downloads (Last 12 months)311
Downloads (Last 6 weeks)22

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Fadli SEl Mediouni A(2025)Digital Transformation in Higher Education: Moroccan University Students’ Perceptions and Expectations on Learning Analytics Implementation for Learning OptimizationInternationalization of Higher Education and Digital Transformation10.1007/978-3-031-76444-8_14(259-276)Online publication date: 6-Feb-2025
https://doi.org/10.1007/978-3-031-76444-8_14
Taşçı STunaz M(2024)OPPORTUNITIES AND CHALLENGES IN AI-ASSISTED LANGUAGE TEACHING: PERCEPTIONS OF PRE-SERVICE EFL TEACHERSAraştırma ve Deneyim Dergisi10.47214/adeder.15758979:2(74-83)Online publication date: 15-Dec-2024
https://doi.org/10.47214/adeder.1575897
Merello AMorante PLara AFarias G(2024)Impacto de las inteligencias artificiales en el bachillerato técnico en producciones agropecuarias en Mocache, Los Ríos, EcuadorSouth Florida Journal of Development10.46932/sfjdv5n9-0255:9(e4381)Online publication date: 17-Sep-2024
https://doi.org/10.46932/sfjdv5n9-025
Mpofu SChasokela D(2024)Data-Informed Decision-MakingBuilding Organizational Capacity and Strategic Management in Academia10.4018/979-8-3693-6967-8.ch004(103-138)Online publication date: 22-Nov-2024
https://doi.org/10.4018/979-8-3693-6967-8.ch004
Rajendran RSubramanian YPoddar SGeetha V(2024)Empowering Healthcare Professionals Through AI-Powered Lifelong Learning for Improving Patient CareIntegrating Generative AI in Education to Achieve Sustainable Development Goals10.4018/979-8-3693-2440-0.ch006(98-122)Online publication date: 17-May-2024
https://doi.org/10.4018/979-8-3693-2440-0.ch006
Tang YSu L(2024)Graduate Education in China Meets AI: Key Factors for Adopting AI-Generated Content ToolsLibri10.1515/libri-2024-0079Online publication date: 31-Oct-2024
https://doi.org/10.1515/libri-2024-0079
Bergdahl NBond MSjöberg JDougherty MOxley E(2024)Unpacking student engagement in higher education learning analytics: a systematic reviewInternational Journal of Educational Technology in Higher Education10.1186/s41239-024-00493-y21:1Online publication date: 20-Dec-2024
https://doi.org/10.1186/s41239-024-00493-y
Carr TRosas SNoble CSong MFernandez CBrandert KDonnald KCorbie GDave G(2024)Strengthening healthcare providers’ leadership capabilities, interprofessional collaboration, and systems thinking: a conceptualization of the Clinical Scholars program impactBMC Medical Education10.1186/s12909-024-06240-124:1Online publication date: 7-Nov-2024
https://doi.org/10.1186/s12909-024-06240-1
Yan LMartinez-Maldonado RGasevic D(2024)Generative Artificial Intelligence in Learning Analytics: Contextualising Opportunities and Challenges through the Learning Analytics CycleProceedings of the 14th Learning Analytics and Knowledge Conference10.1145/3636555.3636856(101-111)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3636555.3636856
Topali PCobos RAgirre‐Uribarren UMartínez‐Monés AVillagrá‐Sobrino S(2024) ‘Instructor in action’: Co‐design and evaluation of human‐centred LA ‐informed feedback in MOOCs Journal of Computer Assisted Learning10.1111/jcal.1305740:6(3149-3166)Online publication date: 4-Sep-2024
https://doi.org/10.1111/jcal.13057
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten