Explainable AI for Early Detection of Academic Disengagement in Blended Learning Environments

Authors

Keywords:

Learning Analytics, Explainable Artificial Intelligence, Student Disengagement, Early Warning Systems, Blended Learning, Educational Data Mining

Abstract

Learning management systems generate detailed behavioural traces, and predictive models built on those traces can identify students at risk of failure or withdrawal well before conventional assessment does. As these models have moved from research prototypes toward institutional deployment, opacity has become the binding constraint: an instructor asked to act on an unexplained risk flag has no basis for choosing an intervention, and no basis for deciding whether the flag is wrong. Explainable artificial intelligence has been proposed as the remedy, with feature attribution methods now standard in the learning analytics literature. This review examines that proposal critically. It argues that the field has adopted attribution methods to satisfy a legitimate demand for transparency, but has largely not asked whether the explanations produced are of the kind instructors actually need. Three problems are developed. Disengagement is treated as equivalent to its behavioural proxies, so models explain platform inactivity rather than the underlying construct, and blended delivery makes this substitution especially unsafe because much learning occurs off-platform. Attribution explains the model rather than the student, and the features that carry the most attribution are frequently not the features an instructor can act on. And the evaluation literature measures predictive accuracy while the outcome that matters — whether flagged students are helped — is rarely measured at all. The paper proposes reorientation toward actionable and contestable explanation, evaluation against intervention outcomes, and explicit treatment of the equity and self-fulfilling-prophecy risks that early warning systems carry.

References

Adnan, M., Habib, A., Ashraf, J., Mussadiq, S., Raza, A. A., Abid, M., Bashir, M., & Khan, S. U. (2021). Predicting at-risk students at different percentages of course length for early intervention using machine learning models. IEEE Access, 9, 7519–7539. https://doi.org/10.1109/ACCESS.2021.3049446

Akcapınar, G., Altun, A., & Aşkar, P. (2019). Using learning analytics to develop early-warning system for at-risk students. International Journal of Educational Technology in Higher Education, 16(1), 1–20. https://doi.org/10.1186/s41239-019-0172-z

Arnold, K. E., & Pistilli, M. D. (2012). Course Signals at Purdue: Using learning analytics to increase student success. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 267–270). ACM. https://doi.org/10.1145/2330601.2330666

Feng, W., Tang, J., & Liu, T. X. (2019). Understanding dropouts in MOOCs. Proceedings of the AAAI Conference on Artificial Intelligence, 33, 517–524.

Halawa, S., Greene, D., & Mitchell, J. (2014). Dropout prediction in MOOCs using learner activity features. In Proceedings of the Second European MOOC Stakeholder Summit (pp. 58–65).

He, J., Bailey, J., & Rubinstein, B. I. P. (2015). Identifying at-risk students in massive open online courses. In Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence (pp. 1749–1755).

Islam, M. R., Ahmed, M. U., Barua, S., & Begum, S. (2022). A systematic review of explainable artificial intelligence in terms of different application domains and tasks. Applied Sciences, 12(3), 1353. https://doi.org/10.3390/app12031353

Jayaprakash, S. M., Moody, E. W., Lauría, E. J. M., Regan, J. R., & Baron, J. D. (2014). Early alert of academically at-risk students: An open source analytics initiative. Journal of Learning Analytics, 1(1), 6–47. https://doi.org/10.18608/jla.2014.11.3

Jivet, I., Scheffel, M., Drachsler, H., & Specht, M. (2017). Awareness is not enough: Pitfalls of learning analytics dashboards in the educational practice. In Data Driven Approaches in Digital Education (pp. 82–96). Springer.

Lundberg, S. M., & Lee, S.-I. (2017). A unified approach to interpreting model predictions. In Advances in Neural Information Processing Systems 30 (pp. 4765–4774).

Macfadyen, L. P., & Dawson, S. (2010). Mining LMS data to develop an “early warning system” for educators: A proof of concept. Computers & Education, 54(2), 588–599.

Mangaroska, K., & Giannakos, M. (2017). Learning analytics for learning design: Towards evidence-driven decisions to enhance learning. In European Conference on Technology Enhanced Learning (pp. 428–433). Springer.

Ribeiro, M. T., Singh, S., & Guestrin, C. (2016). “Why should I trust you?” Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 1135–1144). https://doi.org/10.1145/2939672.2939778

Rudin, C. (2019). Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature Machine Intelligence, 1(5), 206–215. https://doi.org/10.1038/s42256-019-0048-x

You, J. W. (2016). Identifying significant indicators using LMS data to predict course achievement in online learning. The Internet and Higher Education, 29, 23–30.

Downloads

Published

2026-09-03

How to Cite

Dubey , A. (2026). Explainable AI for Early Detection of Academic Disengagement in Blended Learning Environments. Journal of Emerging Multidisciplinary Research, 2(3), 11–14. Retrieved from https://journals.koshubhresearchfoundation.org/index.php/jemr/article/view/19