Digital Transformation of Assessment in the Evaluation of Vocational Education Competencies: A Literature Review (2021–2026)

Muhammad Akbar; Muhammad Giatman; Ambiyar; Fahmi Rizal; Nurhasan Syah

doi:10.56806/jh.v7i3.453

Authors

Muhammad Akbar Universitas Negeri Padang
Muhammad Giatman Universitas Negeri Padang
Ambiyar Universitas Negeri Padang
Fahmi Rizal Universitas Negeri Padang
Nurhasan Syah Universitas Negeri Padang

DOI:

https://doi.org/10.56806/jh.v7i3.453

Keywords:

Digital Assessment, E-Assessment, Competency Assessment, Artificial Intelligence, Learning Analytics, Vocational Education, TVET, Digital Transformation

Abstract

Digital transformation has brought significant changes to competency assessment systems in vocational education. Technological advancements such as e-assessment, learning analytics, Artificial Intelligence (AI), Generative AI, computer-based assessment, and virtual simulation are driving the creation of more effective, adaptive, and data-driven assessment systems. This project will examine the evolution of research on digital transformation in competence assessment in vocational education between 2021-2026. The approach employed is a Literature Review using the PRISMA phases, which comprise identification, screening, eligibility evaluation, and the inclusion of publications. The ScienceDirect database was used for the literature search, which included terms such as digital assessment, competency assessment, and vocational education. The screening method produced 23 papers that matched the inclusion criteria for analysis. The findings show that research trends have evolved from a focus on digital abilities and user perceptions to the use of AI, Generative AI, learning analytics, and intelligent algorithms in competence evaluation. The implementation of digital assessment has proven to enhance efficiency, objectivity, and the accuracy of evaluations, as well as the ability to provide real-time feedback. However, challenges such as educators’ digital competencies, technological infrastructure, and data security remain major concerns. Therefore, strengthening digital competencies, developing infrastructure, and integrating intelligent technologies are crucial strategies for optimizing the implementation of digital assessment in vocational education.

Downloads

Download data is not yet available.

References

Akbar, M., Syah, N., & Jalinus, N. (2026). Humanism In Project-Based Learning at Vocational High Schools?: Building Human Values and Social Skills. jurnal Hurriah: Journal of Educational Evaluation and Research, 7(1), 1–13.

Alalawi, K., Athauda, R., & Chiong, R. (2025). An Extended Learning Analytics Framework Integrating Machine Learning and Pedagogical Approaches for Student Performance Prediction and Intervention. In International Journal of Artificial Intelligence in Education (Vol. 35, Nomor 3). The Author(s). https://doi.org/10.1007/s40593-024-00429-7

Alfredo, R., Echeverria, V., Jin, Y., Yan, L., Swiecki, Z., Gaševi?, D., & Martinez-Maldonado, R. (2024a). Human-centred learning analytics and AI in education: A systematic literature review. Computers and Education: Artificial Intelligence, 6, 100215. https://doi.org/10.1016/j.caeai.2024.100215

Alfredo, R., Echeverria, V., Jin, Y., Yan, L., Swiecki, Z., Gaševi?, D., & Martinez-Maldonado, R. (2024b). Human-centred learning analytics and AI in education: A systematic literature review. Computers and Education: Artificial Intelligence, 6(December 2023). https://doi.org/10.1016/j.caeai.2024.100215

Amenduni, F., Rauseo, M., Antonietti, C., & Cattaneo, A. (2022). Challenges and opportunities perceived by Swiss vocational education and training (VET) teachers during emergency remote teaching: The role of teachers’ digital competence. Qwerty - Open and Interdisciplinary Journal of Technology, Culture and Education, 17(2). https://doi.org/10.30557/QW000057

Antonietti, C., Cattaneo, A., & Amenduni, F. (2022). Can teachers’ digital competence influence technology acceptance in vocational education? Computers in Human Behavior, 132, 107266. https://doi.org/10.1016/j.chb.2022.107266

Asghar, M. Z., Barbera, E., Iqbal, J., Akp?nar, E., & Narimani, A. (2026). Applying artificial neural networks, symmetrical and asymmetrical approaches to measure the nexus of digital competences among European educators. Information Processing & Management, 63(4), 104610. https://doi.org/10.1016/j.ipm.2026.104610

Bygstad, B., Øvrelid, E., Ludvigsen, S., & Dæhlen, M. (2022). From dual digitalization to digital learning space: Exploring the digital transformation of higher education. Computers & Education, 182, 104463. https://doi.org/10.1016/j.compedu.2022.104463

Caspari-Sadeghi, S. (2023). Learning assessment in the age of big data: Learning analytics in higher education. Cogent Education, 10(1). https://doi.org/10.1080/2331186X.2022.2162697

Cattaneo, A. A. P., Antonietti, C., & Rauseo, M. (2022). How digitalised are vocational teachers? Assessing digital competence in vocational education and looking at its underlying factors. Computers & Education, 176, 104358. https://doi.org/10.1016/j.compedu.2021.104358

Cattaneo, A. A. P., Antonietti, C., & Rauseo, M. (2025). How do vocational teachers use technology? The role of perceived digital competence and perceived usefulness in technology use across different teaching profiles. Vocations and Learning, 18(1), 5. https://doi.org/10.1007/s12186-025-09359-4

Cattaneo, A., Schmitz, M. L., Gonon, P., Antonietti, C., Consoli, T., & Petko, D. (2025). The role of personal and contextual factors when investigating technology integration in general and vocational education. Computers in Human Behavior, 163(May 2024). https://doi.org/10.1016/j.chb.2024.108475

Crompton, H., & Burke, D. (2023). Artificial intelligence in higher education: the state of the field. International Journal of Educational Technology in Higher Education, 20(1). https://doi.org/10.1186/s41239-023-00392-8

Dybå, T., & Dingsøyr, T. (2008). Empirical studies of agile software development: A systematic review. Information and software technology, 50(9), 833–859.

Grant, M. J., Booth, A., & Centre, S. (2009). A typology of reviews?: an analysis of 14 review types and. Health information & libraries journal, 26(2), 91–108. https://doi.org/10.1111/j.1471-1842.2009.00848.x

Habibi, A., Sofyan, S., & Mukminin, A. (2023a). Factors affecting digital technology access in vocational education. Scientific Reports, 13(1), 5682. https://doi.org/10.1038/s41598-023-32755-6

Habibi, A., Sofyan, S., & Mukminin, A. (2023b). Factors affecting digital technology access in vocational education. Scientific Reports. https://www.nature.com/articles/s41598-023-32755-6

Held, T., & Mejeh, M. (2024). Students’ motivational trajectories in vocational education: Effects of a self-regulated learning environment. Heliyon, 10(8), e29526. https://doi.org/10.1016/j.heliyon.2024.e29526

Hizam, S. M., Akter, H., Sentosa, I., & Ahmed, W. (2021). Digital competency of educators in the virtual learning environment: A structural equation modeling analysis. IOP Conference Series: Earth and Environmental Science, 704(1), 1–10. https://doi.org/10.1088/1755-1315/704/1/012023

Holmes, W., & Tuomi, I. (2022). State of the art and practice in AI in education. European Journal of Education, 57(4), 542–570. https://doi.org/10.1111/ejed.12533

Ifenthaler, D., Schumacher, C., & Kuzilek, J. (2023). Investigating students’ use of self?assessments in higher education using learning analytics. Journal of Computer Assisted Learning, 39(1), 255–268. https://doi.org/10.1111/jcal.12744

Jur?ne-Br?mane, A. (2023). Digital Assessment in Technology-Enriched Education: Thematic Review. Education Sciences, 13(5), 522. https://doi.org/10.3390/educsci13050522

Kandul, S., Micheli, V., Beck, J., Burri, T., Fleuret, F., Kneer, M., & Christen, M. (2023). Human control redressed: Comparing AI and human predictability in a real-effort task. Computers in Human Behavior Reports, 10, 100290. https://doi.org/10.1016/j.chbr.2023.100290

Kholifah, N., Nurtanto, M., Sutrisno, V. L. P., Majid, N. W. A., Subakti, H., Daryono, R. W., & Achmadi, A. (2025). Unlocking workforce readiness through digital employability skills in vocational education Graduates: A PLS-SEM analysis based on human capital Theory. Social Sciences & Humanities Open, 11, 101625. https://doi.org/10.1016/j.ssaho.2025.101625

Kumarawel, N., & Yusop, F. D. (2022). Technology-Enhanced Authentic-Based Competency Assessment (TABA) Portfolio for Vocational Subjects: Authentic Online Portfolio-Based Assessment. In Alternative Assessments in Malaysian Higher Education (hal. 231–240). Springer Singapore. https://doi.org/10.1007/978-981-16-7228-6_23

Li, H. (2025). Machine learning optimization for vocational literacy education evaluation: A big data-powered decision support system. Alexandria Engineering Journal, 129, 1258–1271. https://doi.org/10.1016/j.aej.2025.08.029

Lucas, M., Bem-Haja, P., Siddiq, F., Moreira, A., & Redecker, C. (2021). The relation between in-service teachers’ digital competence and personal and contextual factors: What matters most? Computers & Education, 160, 104052. https://doi.org/10.1016/j.compedu.2020.104052

Luengo-Aravena, D., Cabello, P., & Rodriguez-Milhomens Bachino, B. (2024). Online collaborative problem-solving as a tangible outcome of digital skills in technical and vocational higher education. Computers and Education, 218(May), 105079. https://doi.org/10.1016/j.compedu.2024.105079

Luo, W., Zang, L., Liang, W., Ma, Q., & Chu, J. (2026). Course assessment model in vocational education based on BPNN optimized by genetic algorithm. Scientific Reports, 16(1), 1–16. https://doi.org/10.1038/s41598-026-43397-9

Ofem, U. J., Amanso, E. O. I., Ene, E. I., Asuquo, E. N., Unwada Ekpang, P., Idung, J. U., Edam Agbor, I. B., Ajuluchukwu, E. N., Anashie, A. I., Elogbo, E. I., Aderibigbe, S. A., Orim, F. S., & Edeh, S. O. (2024). Re-engineering inclusive classroom assessment practices in a digitalized environment. The mediating effect of digital competencies, instructional practices and assessment literacy. Social Sciences and Humanities Open, 10(June), 101150. https://doi.org/10.1016/j.ssaho.2024.101150

Rahmawati, S., Prestridge, S., Abdullah, A. G., & Widiaty, I. (2025). Unpacking the digital competence challenge in vocational education: A case from Indonesia. Social Sciences and Humanities Open, 12(January), 101803. https://doi.org/10.1016/j.ssaho.2025.101803

Roll, M. J. J., & Ifenthaler, D. (2021). Multidisciplinary digital competencies of pre-service vocational teachers. Empirical Research in Vocational Education and Training, 13(1). https://doi.org/10.1186/s40461-021-00112-4

Romero, C., & Ventura, S. (2020). Educational data mining and learning analytics: An updated survey. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 10(3). https://doi.org/10.1002/widm.1355

Sene, S. (2023). Inclusion of all in the neighbourhood school and student well?being in Senegal from the perspective of a practicing pedagogue. European Journal of Education, 58(2), 267–276. https://doi.org/10.1111/ejed.12554

Silva, M., Bermúdez, K., & Caro, K. (2023). Effect of an augmented reality app on academic achievement, motivation, and technology acceptance of university students of a chemistry course. Computers & Education: X Reality, 2, 100022. https://doi.org/10.1016/j.cexr.2023.100022

Subarno, A. (2026). Visual programming for digital competency development in vocational education and training teachers: a pilot feasibility study with implications for post-compulsory education. Research in Post-Compulsory Education, 31(2), 365–390. https://doi.org/10.1080/13596748.2026.2647629

Sun, X., & Tian, H. (2026). AI-Enhanced Skill Assessment in Higher Vocational Education: A Systematic Review and Meta-Analysis. Informatics, 13(2), 20. https://doi.org/10.3390/informatics13020020

Thomann, H., Zimmermann, J., & Deutscher, V. (2024a). How effective is immersive VR for vocational education? Analyzing knowledge gains and motivational effects. Computers &Education. https://www.sciencedirect.com/science/article/pii/S0360131524001416

Thomann, H., Zimmermann, J., & Deutscher, V. (2024b). How effective is immersive VR for vocational education? Analyzing knowledge gains and motivational effects. Computers and Education, 220(July), 105127. https://doi.org/10.1016/j.compedu.2024.105127

Tlili, A., Shehata, B., Adarkwah, M. A., Bozkurt, A., Hickey, D. T., Huang, R., & Agyemang, B. (2023). What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education. Smart Learning Environments, 10(1). https://doi.org/10.1186/s40561-023-00237-x

Tzafilkou, K., Perifanou, M., & Economides, A. A. (2023). Assessing teachers’ digital competence in primary and secondary education: Applying a new instrument to integrate pedagogical and professional elements for digital education. Education and Information Technologies, 28(12), 16017–16040. https://doi.org/10.1007/s10639-023-11848-9

Valle, N., Antonenko, P., Valle, D., Dawson, K., Huggins-Manley, A. C., & Baiser, B. (2021). The influence of task-value scaffolding in a predictive learning analytics dashboard on learners’ statistics anxiety, motivation, and performance. Computers & Education, 173, 104288. https://doi.org/10.1016/j.compedu.2021.104288

Wang, X., & Cao, K. (2025). Personalized learning effect evaluation model for vocational education with cloud computing technology. Systems and Soft Computing, 7(May), 200264. https://doi.org/10.1016/j.sasc.2025.200264

Wang, X., Tian, Z., & Zhang, J. (2026). Exploration of AI-driven innovation and entrepreneurship training models in vocational education: A design-based framework and evaluation protocol. Systems and Soft Computing, 8(May). https://doi.org/10.1016/j.sasc.2026.200506

Wild, S., & Schulze Heuling, L. (2021). Re-evaluation of the D21-digital-index assessment instrument for measuring higher-level digital competences. Studies in Educational Evaluation, 68, 100981. https://doi.org/10.1016/j.stueduc.2021.100981