Asesmen Pembelajaran dengan Tools Generative AI untuk Guru pada Pendidikan Vokasi

Authors

  • Willson Mangoki Universitas Kristen Satya Wacana
  • Krismiyati Universitas Kristen Satya Wacana
  • Hanita Yulia Universitas Kristen Satya Wacana

DOI:

https://doi.org/10.26623/kolaboratif.v4i1.13070

Keywords:

Assessment, Generative Artificial Intelligence, Pedagogical Capacity, Teachers, Vocational High School

Abstract

The rapid advancement of generative artificial intelligence (generative AI) has created new opportunities for innovation in assessment practices within vocational education. Nevertheless, a large proportion of vocational high school (SMK) teachers continue to experience difficulties in understanding, contextualizing, and ethically integrating this technology into the design of assessments that are aligned with the demands of 21st-century skills. As a result, the evaluations implemented in classrooms tend to remain conventional and insufficiently representative of authentic workplace conditions in industry. This community engagement program was designed to enhance the competencies of SMK teachers in developing AI-based assessments that are adaptive, contextual, and responsible. The training was conducted using a hybrid approach, encompassing conceptual seminars, interactive discussions, and hands-on practical sessions utilizing MagicSchool as an AI platform for assessment design. A total of 100 teachers participated in the program, consisting of 30 onsite participants and 70 online participants. Evaluation results indicate an increase in the average score from 84.0 to 94.0, demonstrating a significant improvement in teachers’ assessment design competencies. Overall, the program proved effective in strengthening teachers’ technological literacy and pedagogical capacity, while also promoting the ethical and contextually relevant application of AI in industry-oriented vocational learning.

References

Arslan, B., Lehman, B., Tenison, C., Sparks, J. R., López, A. A., Gu, L., & Zapata-Rivera, D. (2024). Opportunities and challenges of using generative AI to personalize educational assessment. Frontiers in Artificial Intelligence, 7. https://doi.org/10.3389/frai.2024.1460651

Basilio, M. B., & Bueno, D. C. (2021). Instructional supervision and assessment in the 21 st -century and beyond. Institutional Multidisciplinary Research and Development Journal, 4(June), 1–8. http://files.eric.ed.gov/fulltext/ED629212.pdf

Bower, M., Torrington, J., Lai, J. W. M., Petocz, P., & Alfano, M. (2024). How should we change teaching and assessment in response to increasingly powerful generative Artificial Intelligence? Outcomes of the ChatGPT teacher survey. In Education and Information Technologies (Vol. 29, Issue 12). Springer US. https://doi.org/10.1007/s10639-023-12405-0

Brandt, C., Evans, C., & Domaleski, C. (2025). Assessing 21st Century Competencies: Guiding Principles for States and Districts (Issue January). http://files.eric.ed.gov/fulltext/ED671665.pdf

Delcker, J., Heil, J., & Ifenthaler, D. (2025). Evidence-based development of an instrument for the assessment of teachers’ self-perceptions of their artificial intelligence competence. Educational Technology Research and Development, 73(1), 115–133. https://doi.org/10.1007/s11423-024-10418-1

Ilieva, G., Yankova, T., Ruseva, M., & Kabaivanov, S. (2025). A Framework for Generative AI-Driven Assessment in Higher Education. Information (Switzerland), 16(6), 1–22. https://doi.org/10.3390/info16060472

Kekado, N. C., & Krismiyati, K. (2025). Teachers’ and Students’ Perspectives on the Ethical Use of Artificial Intelligence in Vocational Education using Technology Acceptance Model Approach. Jurnal Ilmu Komputer Dan Informatika, 5(1), 57–68. https://doi.org/10.54082/jiki.281

Kılınç, S. (2024). Comprehensive AI assessment framework: Enhancing educational evaluation with ethical AI integration. Journal of Educational Technology and Online Learning, 7(4-ICETOL 2024 Special Issue), 521–540. https://doi.org/10.31681/jetol.1492695

Krismiyati, Y, H., & Dwi Kurnaningsih, Y. (2024). Pemberdayaan Guru Untuk Peningkatan Keterampilan Menyusun Ajar Menggunakan Modul Generator. Abdimas Bina Bangsa, 5(2), 1864–1873. https://doi.org/https://doi.org/10.46306/jabb.v5i2.1472

May, T. A., Provinzano, K., Koskey, K. L. K., Sondergeld, C. J., Stone, G. E., Archer, J. N., & Rimkunas, N. (2025). Expanding the Team: Integrating Generative Artificial Intelligence into the Assessment Development Process. Applied Sciences (Switzerland), 15(18), 1–18. https://doi.org/10.3390/app15189976

Pitpit, L. J., Obenza, B., & Inojales, G. J. (2025). Teachers’ Attitudes Toward Generative AI In Assessment Planning: A UTAUT-Based Structural Equation Model. Asia Pacific Journal of Educational Technologies, Psychology, and Social Sciences, 1(1), 185–202. https://doi.org/10.70847/622109

Ratumanan, E. A., & Krismiyati, K. (2025). The Use of AI for Learning Planning Viewed from the UTAUT Perspective. International Journal of Active Learning, 10(2), 74–84. https://doi.org/10.15294/ijal.v10i2.32387

Yulia, H., Gundo, A. J., Fibriani, C., Kristen, U., Wacana, S., Informasi, S., Kristen, U., & Wacana, S. (2025). Pengembangan Media Literasi Digital Bagi Guru SD di Boyolali. Jurnal Adimas Bina Bangsa, 6(2), 1264–1274. https://doi.org/10.46306/jabb.v6i2.1892

Yulia, H., Krismiyati, K., Paseleng, M. C., Gundo, A. J., Setiyanti, A. A., Tacoh, Y. T. B., & Efendi, R. (2024). Pelatihan Pengembangan Media Pembelajaran Komik Digital bagi Guru Sekolah Dasar di Kecamatan Banyudono. Abdi Wiralodra : Jurnal Pengabdian Kepada Masyarakat, 6(2), 188–202. https://doi.org/10.31943/abdi.v6i2.177

Zhao, Y., & Ko, J. (2024). Orchestrating vocational education classrooms for adaptive instruction and collaborative learning. Cogent Education, 11(1). https://doi.org/10.1080/2331186X.2024.2351238

Downloads

Published

2026-01-22

Issue

Section

Articles

How to Cite

Mangoki, W., Krismiyati, & Yulia, H. (2026). Asesmen Pembelajaran dengan Tools Generative AI untuk Guru pada Pendidikan Vokasi. Jurnal Pengabdian KOLABORATIF, 4(1), 68-75. https://doi.org/10.26623/kolaboratif.v4i1.13070