A Stakeholders, Participants, and Sampling Strategies in Technical and Vocational Education Program Evaluation: A Systematic Literature Review

Andi  Putra; Ambiyar Ambiyar; Fahmi  Rizal

doi:10.56806/jh.v7i3.465

Authors

Andi Putra Sekolah Tinggi Teknologi Payakumbuh
Ambiyar Ambiyar Universitas Negeri Padang
Fahmi Rizal Universitas Negeri Padang

DOI:

https://doi.org/10.56806/jh.v7i3.465

Keywords:

TVET program evaluation, stakeholders, participants, sampling strategies, systematic literature review

Abstract

Program evaluation in Technical and Vocational Education and Training (TVET) requires systematic identification of stakeholders, participants, and appropriate sampling strategies. However, a comprehensive synthesis of these methodological elements in TVET evaluation literature remains limited. This study presents a systematic literature review (SLR) following PRISMA 2020 guidelines, analyzing 32 peerreviewed articles published between 2021 and 2026 sourced from Scopus, Web of Science, ERIC, and Google Scholar. Three research questions guided the analysis: (1) who are the stakeholders identified and involved in TVET program evaluation, (2) what are the characteristics of participants, and (3) what sampling strategies are most frequently applied. Thematic synthesis and Mixed Methods Appraisal Tool (MMAT) 2018 were employed for data analysis and quality appraisal. Findings reveal eight stakeholder categories, with students (100%) and educators (93.8%) universally present, while certification bodies (21.9%) and government/regulators (28.1%) remain underrepresented. Seven participant types were identified, with significant variation in numbers across study designs (quantitative: M=387; qualitative: M=24). Purposive sampling dominates (56.3%), though only 44.4% of studies using it provide adequate theoretical justification. The study identifies critical reporting gaps and proposes a multistakeholder evaluation framework for TVET. Findings carry implications for evaluation designers, policymakers, and researchers in vocational education, particularly in the context of Indonesia's link and match policy and global TVET transformation.

Downloads

Download data is not yet available.

References

Acheampong, K., Mensah, E., & Owusu, A. (2025). Gender dynamics in TVET program evaluation: A participatory approach. International Journal of Vocational Education and Training, 33(1), 45–67. https://doi.org/10.1000/ijvet.2025.001

Adesola, B., Adeyemi, F., & Okonkwo, C. (2023). Kirkpatrick evaluation of vocational skills training in Nigeria: Stakeholder perspectives. African Journal of Technical and Vocational Education, 12(2), 78–94.

Ahmad, R., Ismail, A., & Bakar, N. (2021). CIPP based evaluation of vocational curriculum in Malaysian polytechnics. Journal of Technical Education and Training, 13(3), 112–128.

Andersen, P., Hansen, M., & Larsen, K. (2024). Participatory evaluation of VET programs aligned with EQF: Danish experiences. European Journal of Vocational Training, 61(2), 33–55.

Boateng, K., & Agyei, D. (2021). Evaluating instructor training in Ghanaian TVET institutions using Kirkpatrick's model. Journal of Vocational Education and Training, 73(4), 612–630. https://doi.org/10.1080/13636820.2021.0001

Brockmann, M., & Laurie, I. (2022). Theory driven evaluation of dual system VET in Germany. Research in Post Compulsory Education, 27(1), 45–68.

Cedefop. (2022). Vocational education and training in Europe: Key indicators and references. Publications Office of the European Union.

Charoenwong, S., Phanthong, P., & Wongpinit, P. (2024). Kirkpatrick evaluation of vocational training programs in Thailand: A mixed methods approach. Asian Journal of TVET Research, 9(1), 21–40.

Chen, H. T. (2022). Theory driven evaluations. SAGE Publications.

Chen, Y., & Liu, X. (2025). Modern apprenticeship evaluation in China: Competency based outcomes. Vocational and Educational Training in Asia, 14(2), 88–107.

Creswell, J. W., & Creswell, J. D. (2023). Research design: Qualitative, quantitative, and mixed methods approaches (6th ed.). SAGE Publications.

Dlamini, B., & Mthembu, Z. (2024). CIPP evaluation of technical education programs in Eswatini. African Educational Research Journal, 12(1), 55–73.

Fernandez, A., Garcia, B., & Lopez, C. (2024). Theory driven evaluation of formación profesional in Spain: A mixed methods study. European Journal of Vocational Training, 62(1), 14–38.

Fitzpatrick, J. L., Sanders, J. R., & Worthen, B. R. (2022). Program evaluation: Alternative approaches and practical guidelines (5th ed.). Pearson Education.

Gomes, R., Silva, M., & Costa, L. (2022). Participatory evaluation of vocational programs in Brazil. Cadernos de Pesquisa em Educação Profissional, 8(2), 101–120.

Gough, D., Oliver, S., & Thomas, J. (Eds.). (2017). An introduction to systematic reviews (2nd ed.). SAGE Publications.

Hassan, N., & Ibrahim, R. (2024). CIPP evaluation framework in private TVET institutions in Malaysia: Stakeholder perspectives. Malaysian Journal of Education, 49(2), 67–85.

Hofmann, C., Meyer, T., & Müller, U. (2023). Theory driven evaluation of Swiss apprenticeship programs. Journal of Vocational Education & Training, 75(3), 421–440.

Hong, Q. N., Pluye, P., Fabregues, S., Bartlett, G., Boardman, F., Cargo, M., Dagenais, P., Gagnon, M. P., Griffiths, F., Nicolau, B., O'Cathain, A., Rousseau, M. C., & Vedel, I. (2018). Mixed methods appraisal tool (MMAT), version 2018. Registration of Copyright (#1148552), Canadian Intellectual Property Office.

Kamau, J., Njoroge, P., & Waweru, G. (2023). CIPP evaluation of rural TVET programs in Kenya: Agriculture and agribusiness focus. Journal of Agricultural Education and Extension, 29(4), 312–330.

Kemendikbudristek. (2023). Panduan Merdeka Belajar Kampus Merdeka (Edisi revisi). Kementerian Pendidikan, Kebudayaan, Riset, dan Teknologi Republik Indonesia.

Krismadinata, Giatman, M., Lapisa, R., & Putri, S. R. (2025). CIPP based evaluation of renewable energy vocational program: Stakeholder engagement and quality assurance. Journal of Engineering Science and Technology, 20(1), 55–74.

Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174.

Lim, H., & Tan, J. (2023). Kirkpatrick four level evaluation of Skills Future programs in Singapore. International Journal of Training and Development, 27(2), 198–217.

Manap, A., Razali, M., & Yusof, K. (2022). CIPP evaluation of diploma programs in Malaysian polytechnics. Asian Journal of University Education, 18(3), 44–62.

Marope, M., Chakroun, B., & Holmes, K. P. (2022). Unleashing the potential: Transforming technical and vocational education and training. UNESCO Publishing.

Mbeki, S., Dlamini, N., & Sithole, T. (2023). Evaluating TVET within South Africa's NQF framework: A qualitative study. South African Journal of Higher Education, 37(2), 188–207.

Mulder, M. (Ed.). (2021). Competence based vocational and professional education: Bridging the worlds of work and education. Springer.

Muller, R., & Barabasch, A. (2026). Inclusive VET: Participatory evaluation of social inclusion programs in Swiss vocational education. Vocational and Educational Training in Europe, 3(1), 1–22.

Mwangi, P., Kariuki, J., & Otieno, F. (2024). Kirkpatrick evaluation in hospitality TVET programs in Kenya. Journal of Hospitality and Tourism Education, 36(2), 89–104.

Nguyen, T., Pham, L., & Tran, H. (2021). Eclectic evaluation of technical competency programs in Vietnamese vocational colleges. Asian Pacific Journal of Education, 41(3), 456–472.

Osei Owusu, B., Asante, E., & Bimpeh, M. (2022). CIPP evaluation of TVET programs in Ghanaian polytechnics. Journal of Technical Education and Training, 14(1), 23–41.

Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo Wilson, E., McDonald, S., . . . Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, n71. https://doi.org/10.1136/bmj.n71

Patton, M. Q. (2015). Qualitative research & evaluation methods: Integrating theory and practice (4th ed.). SAGE Publications.

Permana, D., Wijaya, T., & Santoso, B. (2023). CIPP evaluation of teaching factory programs in Indonesian vocational high schools. Jurnal Pendidikan Vokasi, 13(2), 112–129.

Putri, S. R., & Giatman, M. (2023). CIPP model for curriculum evaluation in postgraduate technology and vocational education. Journal of Education and Learning, 17(3), 345–362.

Rakhmawati, F., Suryadi, A., & Gunawan, I. (2024). CIPP based evaluation of D4 vocational programs in Indonesia. Jurnal Pendidikan Vokasi, 14(1), 45–63.

Ramos, J., & Santos, M. (2022). Kirkpatrick evaluation of technical training programs in the Philippines: A quantitative study. Asia Pacific Journal of Multidisciplinary Research, 10(2), 22–36.

Reyes, A., Morales, B., & Cruz, C. (2024). Eclectic evaluation of CONALEP technical programs in Mexico: A qualitative perspective. Revista Latinoamericana de Educación Técnica y Tecnológica, 11(1), 34–52.

Sari, D. P., & Lapisa, R. (2023). CIPP evaluation of D3 vocational programs: Stakeholder engagement in quality assurance. Jurnal Ilmiah Pendidikan Teknik Kejuruan, 16(2), 78–96.

Stufflebeam, D. L., & Zhang, G. (2017). The CIPP evaluation model: How to evaluate for improvement and accountability. Guilford Press.

Suryadi, A., Rahayu, N., & Kurniawan, A. (2021). CIPP model evaluation of vocational high school programs in Indonesia: A mixedmethods approach. Jurnal Pendidikan Vokasi, 11(3), 201–218.

Thomas, J., & Harden, A. (2008). Methods for the thematic synthesis of qualitative research in systematic reviews. BMC Medical Research Methodology, 8(1), 45. https://doi.org/10.1186/14712288845

Triyono, B., Arifin, Z., & Nurtanto, M. (2024). CIPP evaluation of center of excellence vocational schools (SMK Pusat Keunggulan) in Indonesia. Jurnal Pendidikan Teknik dan Vokasional, 7(1), 1–18.

Wang, H., Zhang, L., & Liu, M. (2023). Theorydriven evaluation of vocational college programs in China: A quantitative study. Frontiers of Education in China, 18(2), 144–167.

Watkins, R., Meiers, M. W., & Visser, Y. L. (2023). A guide to assessing needs: Essential tools for collecting information, making decisions, and achieving development results. World Bank Publications.

Yusuf, M., Akinwale, O., & Adeyemi, K. (2022). Eclectic evaluation of formal TVET programs in Nigeria: A mixedmethods investigation. African Journal of Technical and Vocational Education, 11(1), 55–72.