An AI Governance Framework to Address Algorithmic Bias and Educational Equity: A Systematic Literature Review

Muhammad Ruslan Maulani, Saripudin Saripudin, Mumu Komaro

Abstract


The rapid integration of artificial intelligence (AI) in educational systems has generated unprecedented opportunities for personalized learning and operational efficiency. However, it has also exposed deep-rooted concerns regarding algorithmic bias and educational equity. Employing the PRISMA 2020 protocol, this systematic literature review synthesizes evidence from 46 peer-reviewed studies (2021–2026) selected from an initial pool of 102 Scopus-indexed records to examine the sources and manifestations of algorithmic bias, its differential impact on marginalized students, and the adequacy of existing AI governance frameworks in education. Findings show that bias operates through interlocking channels—biased training data, opaque model architectures, and inequitable institutional deployment—that disproportionately disadvantage students from low-income, racially minoritized, and geographically remote backgrounds, while existing governance frameworks remain largely generic and fail to address education's distinctive pedagogical and institutional dynamics. To address this gap, the study's principal contribution is the Educational AI Governance Framework (EAGF), a novel five-layer model—spanning technical accountability, institutional policy, pedagogical integration, participatory governance, and regulatory alignment—grounded in the FAIR principles (Fairness, Accountability, Inclusivity, and Responsiveness) and aligned with UNESCO, OECD, and EU AI governance standards. Unlike prior general-purpose AI ethics frameworks, the EAGF integrates these dimensions into a single coherent architecture, offering both a theoretical advance in intersectionality-aware AI governance and a practical roadmap for policymakers, educational institutions, EdTech developers, and vocational education and training (VET) systems seeking to operationalize equitable AI governance.

Keywords


algorithmic bias; AI governance; educational equity; fairnes in AI; vocational education

Full Text:

Link Download

References


Akchurin, M., & Chouhy, G. (2024). Designing better access to education? Unified enrollment, school choice, and the limits of algorithmic fairness in New Orleans school admissions. Qualitative Sociology, 47(2), 281–323. https://doi.org/10.1007/s11133-024-09565-x

Alotaibi, N. S. (2024). The impact of AI and LMS integration on the future of higher education: opportunities, challenges, and strategies for transformation. Sustainability, 16(23), 10357. https://doi.org/10.3390/su162310357

Assefa, E. A. (2025). AI and the digital divide in ensuring educational access andmulticultural inclusivity. Journal of Information, Communication and Ethics in Society. https://doi.org/10.1108/JICES-05-2025-0125

Baker, R. S., & Hawn, A. (2021). Algorithmic bias in education. International Journal of Artificial Intelligence in Education, 32(4), 1052–1092. https://doi.org/10.1007/s40593-021-00285-9

Bearman, M., & Ajjawi, R. (2025). Artificial intelligence and gender equity: An integrated approach for health professional education. Medical Education, 59(10), 1049–1057. https://doi.org/10.1111/medu.15657

Berisha Qehaja, A. (2025). Strategic integration of artificial intelligence solutions to transform teaching practices in higher education. Foresight, 27(5), 970–991. https://doi.org/10.1108/FS-04-2024-0079

Bird, K. A., Castleman, B. L., & Song, Y. (2025). Are algorithms biased in education? Exploring racial bias in predicting community college student success. Journal of Policy Analysis and Management, 44(2), 379–402. https://doi.org/10.1002/pam.22569

Bouakaz, L., & Khalid, S. (2025). AI in education: A sociological exploration of technology in learning environments. Frontiers in Education, 10, 1700876. https://doi.org/10.3389/feduc.2025.1700876

Buragohain, D., & Chaudhary, S. (2025). Navigating ChatGPT in ASEAN higher education: Ethical and pedagogical perspectives. Computer Applications in Engineering Education, 33(4), e70062. https://doi.org/10.1002/cae.70062

Coleman, O. F., & Waterfield, D. A. (2026). Ethical AI use in IEP development: A guiding Framework. Journal of Special Education Technology, 01626434261419099. https://doi.org/10.1177/01626434261419099

Dieterle, E., Dede, C., & Walker, M. (2022). The cyclical ethical effects of using artificial intelligence in education. AI & SOCIETY, 39(2), 633–643. https://doi.org/10.1007/s00146-022-01497-w

Gaskins, N. (2022). Interrogating algorithmic bias: From speculative fiction to liberatory design. TechTrends, 67(3), 417–425. https://doi.org/10.1007/s11528-022-00783-0

Ifenthaler, D., Majumdar, R., Gorissen, P., Judge, M., Mishra, S., Raffaghelli, J., & Shimada, A. (2024). Artificial Intelligence in education: Implications for policymakers, researchers, and practitioners. Technology, Knowledge and Learning, 29(4), 1693–1710. https://doi.org/10.1007/s10758-024-09747-0

Kalim, U., Kanwar, A., Xu, L., Xu, H., Chen, X., Irfan, S., & Rasool, A. (2025). Female gender bias in artificial intelligence applications for education: A systematic review of regional disparities and equity implications. AI & SOCIETY. https://doi.org/10.1007/s00146-025-02811-y

Kundu, A., Bej, T., & Mondal, R. (2025). Exploring teachers’ AI literacy: Cognitive, pedagogical, ethical, and contextual insights from Indian schools. Teaching Education, 1–21. https://doi.org/10.1080/10476210.2025.2570227

Lee, J., Hicke, Y., Yu, R., Brooks, C., & Kizilcec, R. F. (2024). The life cycle of large language models in education: A framework for understanding sources of bias. British Journal of Educational Technology, 55(5), 1982–2002. https://doi.org/10.1111/bjet.13505

Li, J., & Huang, Q. (2025). Navigating ethical dilemmas in AI-enhanced education: A critical bibliometric analysis of global research trends and collaboration networks. International Journal of Knowledge Management, 21(1), 1–21. https://doi.org/10.4018/IJKM.382384

Lockwood, A. B., & Brown, J. (2025). Mitigating AI bias in school psychology: Toward equitable and ethical implementation. School Psychology Review, 1–13. https://doi.org/10.1080/2372966X.2025.2529148

Luo, J., Zheng, C., Yin, J., & Teo, H. H. (2025). Design and assessment of AI-based learning tools in higher education: A systematic review. International Journal of Educational Technology in Higher Education, 22(1), 42. https://doi.org/10.1186/s41239-025-00540-2

Mangal, M., & Pardos, Z. A. (2024). Implementing equitable and intersectionality‐aware ML in education: A practical guide. British Journal of Educational Technology, 55(5), 2003–2038. https://doi.org/10.1111/bjet.13484

Marín, Y. R., Caro, O. C., Rituay, A. M. C., Llanos, K. A. G., Perez, D. T., Bardales, E. S., Tuesta, J. N. A., & Santos, R. C. (2025). Ethical challenges associated with the use of Artificial Intelligence in university education. Journal of Academic Ethics, 23(4), 2443–2467. https://doi.org/10.1007/s10805-025-09660-w

Mariyono, D., & Alif Hidayatullah, A. N. (2025). Navigating the moral maze: Ethical challenges and opportunities of generative chatbots in global higher education. Applied Computational Intelligence and Soft Computing, 2025(1), 8584141. https://doi.org/10.1155/acis/8584141

Marzal García-Quismondo, M. Á., Parra-Valero, P., & Martínez-Cardama, S. (2024). A look at critical information literacy from Europe’s educability project. The Journal of Academic Librarianship, 50(5), 102917. https://doi.org/10.1016/j.acalib.2024.102917

Matjie, M. A., Nethavhani, A., & Matlakala, M. (2026). AI and the digital divide in education. Frontiers in Computer Science, 8, 1759027. https://doi.org/10.3389/fcomp.2026.1759027

Muthukrishna, M., Dai, J., Panizo Madrid, D., Sabherwal, R., Vanoppen, K., & Yao, H. (2025). AI can revolutionise education but technology is not enough: Human development meets cultural evolution. Journal of Human Development and Capabilities, 26(3), 482–492. https://doi.org/10.1080/19452829.2025.2517740

Nopas, D. (2025). Algorithmic learning or learner autonomy? Rethinking AI’s role in digital education. Qualitative Research Journal. https://doi.org/10.1108/QRJ-11-2024-0282

Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Systematic Reviews, 10(1), 89. https://doi.org/10.1186/s13643-021-01626-4

Pham, N., Do, M. K., Dai, T. V., Hung, P. N., & Nguyen-Duc, A. (2025). FAIREDU: A multiple regression-based method for enhancing fairness in machine learning models for educational applications. Expert Systems with Applications, 269, 126219. https://doi.org/10.1016/j.eswa.2024.126219

Rahman, M. I. (2026). Algorithmic bias and transparency in artificial intelligence tools for nursing education: A scoping review. Nurse Education in Practice, 92, 104756. https://doi.org/10.1016/j.nepr.2026.104756

Roshanaei, M. (2024). Towards best practices for mitigating artificial intelligence implicit bias in shaping diversity, inclusion and equity in higher education. Education and Information Technologies, 29(14), 18959–18984. https://doi.org/10.1007/s10639-024-12605-2

Sha, L., Rakovic, M., Das, A., Gasevic, D., & Chen, G. (2022). Leveraging class balancing techniques to alleviate algorithmic bias for predictive tasks in education. IEEE Transactions on Learning Technologies, 15(4), 481–492. https://doi.org/10.1109/TLT.2022.3196278

Urbina, J. T., Vu, P. D., & Nguyen, M. V. (2025). Disability ethics and education in the age of Artificial Intelligence: Identifying ability bias in ChatGPT and Gemini. Archives of Physical Medicine and Rehabilitation, 106(1), 14–19. https://doi.org/10.1016/j.apmr.2024.08.014

Von Winckelmann, S. L. (2023). Predictive algorithms and racial bias: A qualitative descriptive study on the perceptions of algorithm accuracy in higher education. Information and Learning Sciences, 124(9/10), 349–371. https://doi.org/10.1108/ILS-05-2023-0045

Wongvorachan, T., Bulut, O., Liu, J. X., & Mazzullo, E. (2024). A comparison of bias mitigation techniques for educational classification tasks using supervised machine learning. Information, 15(6), 326. https://doi.org/10.3390/info15060326




DOI: http://dx.doi.org/10.35671/telematika.v19i2.3348

Refbacks

  • There are currently no refbacks.


 


Indexed by:

   

Telematika
ISSN: 2442-4528 (online) | ISSN: 1979-925X (print)
Published by : Universitas Amikom Purwokerto
Jl. Let. Jend. POL SUMARTO Watumas, Purwonegoro - Purwokerto, Indonesia


Creative Commons License This work is licensed under a Creative Commons Attribution 4.0 International License .