Evaluating the implementation of the mechanical engineering student skills competency

Galan Raditya Saputra; Mujiyono Mujiyono

doi:10.21831/jpv.v14i2.71359

Evaluating the implementation of the mechanical engineering student skills competency

Galan Raditya Saputra, Universitas Negeri Yogyakarta, Indonesia
Mujiyono Mujiyono, Universitas Negeri Yogyakarta, Indonesia

10.21831/jpv.v14i2.71359

Abstract

This study aims to evaluate the implementation of the Expertise Competency Test (UKK) for students of Vocational High Schools (VHS) in the Machining Engineering Expertise Program implemented by the First Party Professional Certification Agency (LSP P1) in Banten Province. The evaluation was conducted using the CIPP model (Context, Input, Process, Product, and Outcome). This study is useful for assessing the performance of LSP P1 in implementing the UKK and evaluating the impact of UKK graduates on their acceptance in the industrial world. The research was conducted in three vocational schools in Banten Province with the research subjects including the head of LSP P1, the head of the machining engineering expertise programme, and competency assessors. The research instruments used were questionnaires, observations, documents and interviews, which had been validated by expert judgement. The data analysis technique used was descriptive quantitative. The results showed that the implementation of UKK by LSP P1 in Banten vocational schools received the following evaluations: (1) Context aspect scored 3.36 (very good category), (2) Input aspect scored 3.47 (very good category), (3) Process aspect scored 3.36 (very good category), (4) Product aspect scored 3.26 (very good category), and (5) Outcome aspect scored 2.94 (good category). In conclusion, the implementation of the UKK by LSP P1 in the Machining Engineering Expertise Programme at SMK Banten Province has been running very well in most aspects, although there is room for improvement in the Outcome aspect related to the impact of graduates in the industrial world. The contribution of this research is to provide an overview of the effectiveness of expertise competency certification in SMKs as well as input to improve the quality of graduates who are better prepared to compete in the world of work.

Keywords

Evaluation; First Party Professional Certification Institute (LSP P1); machining engineering; skills competency test; vocational high school

References

Abdurrahman, A., Parmin, P., & Muryanto, S. (2022). Evaluation on the automotive skill competency test through ‘discontinuity’ model and the competency test management of vocational education school in Central Java, Indonesia. Heliyon, 8(2), e08872. https://doi.org/10.1016/j.heliyon.2022.e08872

Afandi, K., & Wijanarka, B. S. (2019). Outcomes of vocational high schools in machining expertise in the labor market in Yogyakarta, Indonesia. American Journal of Educational Research, 7(9), 599–603. https://doi.org/10.12691/education-7-9-1

Ahyanuardi, A., Rahmadhani, S., Suryati, L., & Zuryana, Z. (2022). Realization of vocational high school curriculum based on work culture. Jurnal Pendidikan Vokasi, 12(1), 86–92. https://doi.org/10.21831/jpv.v12i1.44243

Ali, M., Mardapi, D., & Koehler, T. (2020). Identification key factor in link and match between technical and vocational education and training with industry needs in Indonesia. Proceedings of the International Conference on Online and Blended Learning 2019 (ICOBL 2019), 241–245. https://doi.org/10.2991/assehr.k.200521.053

Amegah, A. (2023). Business without social responsibility is business without morality’: Employer engagement in upper secondary technical and vocational education and training schools in Ghana. Journal of Vocational Education & Training, 75(2), 391–415. https://doi.org/10.1080/13636820.2021.1879904

Andriansyah, E. H., & Kamalia, P. U. (2021). National Standards of Education affect the employment opportunities of vocational high school graduates. Jurnal Pendidikan Vokasi, 11(2), 112–124. https://doi.org/10.21831/jpv.v11i2.40791

Badan Nasional Sertifikasi Profesi Republik Indonesia. (2013). Peraturan Badan Nasional Sertifikasi Profesi Nomor : 03/BNSP.302/X/2013 tentang Pedoman Penerbitan Sertifikasi Kompetensi. Badan Nasional Sertifikasi Profesi Republik Indonesia. https://cdn.shopify.com/s/files/1/0788/8227/5621/files/DE_26_Peraturan_BNSP_No.3_Tahun_2013_tentang_Pedoman_Penerbitan_Sertifikat_Kompetensi.pdf?v=1689302947

Badan Pusat Statistik Republik Indonesia. (2022). Tingkat pengangguran terbuka berdasarkan tingkat pendidikan, 2021-2022. Bps.Go.Id. https://www.bps.go.id/id/statistics-table/2/MTE3OSMy/tingkat-pengangguran-terbuka-berdasarkan-tingkat-pendidikan.html

Bakar, R. (2018). The influence of professional teachers on Padang vocational school students’ achievement. Kasetsart Journal of Social Sciences, 39(1), 67–72. https://doi.org/10.1016/j.kjss.2017.12.017

Boud, D., & Dawson, P. (2023). What feedback literate teachers do: An empirically-derived competency framework. Assessment & Evaluation in Higher Education, 48(2), 158–171. https://doi.org/10.1080/02602938.2021.1910928

Braxton, S. N. (2023). Competency frameworks, alternative credentials and the evolving relationship of higher education and employers in recognizing skills and achievements. The International Journal of Information and Learning Technology, 40(5), 373–387. https://doi.org/10.1108/IJILT-10-2022-0206

Budiyanto, B., & Suyanto, W. (2020). The evaluation of competency certification program through the LSP P-1 at vocational high school. Jurnal Pendidikan Vokasi, 10(1), 44–55. https://doi.org/10.21831/jpv.v10i1.30155

Crisanty, T. M., & Pasaribu, E. (2022). Determinan pengangguran lulusan SMK Provinsi Sulawesi Utara sebelum dan saat Pandemi Covid-19. Seminar Nasional Official Statistics, 2022(1), 769–778. https://doi.org/10.34123/semnasoffstat.v2022i1.1155

Ernawati, E., Ghani, A. R. A., Trisnawati, R. D., & Malik, Z. A. (2023). Teacher’s understanding of minimum competence assessment and its impact on assessment conducted in class. Journal of Research and Educational Research Evaluation, 12(1), 86–92. https://journal.unnes.ac.id/sju/jere/article/view/66041

Fakhrunnisaa, N., & Munadi, S. (2019). Relevance of multimedia expertise competency in vocational schools toward the needs of business/industrial world. Journal of Educational Science and Technology (EST), 5(1), 58–66. https://doi.org/10.26858/est.v5i1.6923

Fattah, A. (2021). The effectiveness of the program to improve undergraduate qualifications through dual mode system for Islamic elementary school teachers in West Nusa Tenggara, East Nusa Tenggara and Bali, Indonesia. Multicultural Education, 7(9), 79–91. http://ijdri.com/me/wp-content/uploads/2021/09/9.pdf

Gerhard, K., Jäger-Biela, D. J., & König, J. (2023). Opportunities to learn, technological pedagogical knowledge, and personal factors of pre-service teachers: understanding the link between teacher education program characteristics and student teacher learning outcomes in times of digitalization. Zeitschrift Für Erziehungswissenschaft, 26(3), 653–676. https://doi.org/10.1007/s11618-023-01162-y

Haerudin, D., Hermawan, B., Ruhaliah, R., Wibawa, S., Awaliah, Y. R., & Hardini, T. I. (2023). Inventorying authentic teaching materials on Youtube for listening learning plan of Pupuh in elementary school. Jurnal Cakrawala Pendidikan, 42(2), 549–564. https://doi.org/10.21831/cp.v42i2.46233

Hamdani, M. I., & Hanafi, I. (2021). The CIPP model-based evaluation on information technology competence certification program at Universitas Brawijaya. Indonesian Journal of Social & Humanity Study/Wacana: Jurnal Sosial Dan Humaniora, 24(3), 120. https://search.ebscohost.com/login.aspx?direct=true&profile=ehost&scope=site&authtype=crawler&jrnl=14110199&AN=164713151&h=KSGIQjKD0O1FyWj%2Fc3G%2BdCJfUSGHBoXAbEpFAF1a6Mm%2BcnMLm%2FYLS1d6ubq%2FQTkbzxmDEFUM8%2FhhxtFUjtpbNQ%3D%3D&crl=c

Irani, U., R, M. A., & Khairuddin, K. (2014). Implementasi manajemen strategik dalam upaya peningkatan mutu pendidikan pada SMAN 10 Fajar Harapan. Jurnal Administrasi Pendidikan: Program Pascasarjana Unsyiah, 4(2), 58–70. https://jurnal.usk.ac.id/JAP/article/view/2519

Irwanto, I. (2021). Link and match pendidikan kejuruan dengan dunia usaha dan industri di indonesia. Jurnal Inovasi Penelitian, 2(2), 549–562. https://ejournal.stpmataram.ac.id/JIP/article/view/714

Ismail, S. M., Rahul, D. R., Patra, I., & Rezvani, E. (2022). Formative vs. summative assessment: Impacts on academic motivation, attitude toward learning, test anxiety, and self-regulation skill. Language Testing in Asia, 12(1), 40. https://doi.org/10.1186/s40468-022-00191-4

Jamiludin, J., & Darnawati, D. (2022). E-learning on history learning: Aspect of material, teacher, learning environment, and student. International Journal of Evaluation and Research in Education (IJERE), 11(2), 546. https://doi.org/10.11591/ijere.v11i2.22471

Joesoef, J. R., Muawanah, U., Poernamawatie, F., Mulyono, S., & Mukhlis, I. (2016). Peran SMK dalam menunjang pertumbuhan ekonomi daerah: Sebuah analisis markoekonomika. Direktorat Pembinaan Sekolah Menengah Kejuruan, Direktorat Jenderal Manajemen Pendidikan Dasar dan Menengah, Departemen Pendidikan Nasional. http://www.ejournal.unigamalang.ac.id/index.php/RDOS/article/view/50

Kementerian Pendidikan Kebudayaan Riset dan Teknologi Republik Indonesia. (2022). Peraturan Menteri Pendidikan, Kebudayaan, Riset, dan Teknologi tentang Standar Penilaian Pendidikan pada Pendidikan Anak Usia Dini, Jenjang Pendidikan Dasar, dan Jenjang Pendidikan Menengah. Kementerian Pendidikan, Kebudayaan, Riset, dan Teknologi. https://peraturan.bpk.go.id/Home/Download/219038/Salinan_Permendikbudristek No_21 Tahun 2022_ Standar Penilaian Pendidikan.pdf

Khairunnisa, T. N., & Trisnawati, N. (2024). Pengaruh praktik kerja industri, informasi dunia kerja dan status sosial ekonomi orang tua terhadap kesiapan kerja siswa SMK. Jurnal Nakula : Pusat Ilmu Pendidikan, Bahasa Dan Ilmu Sosial, 2(5), 106–122. https://doi.org/10.61132/nakula.v2i5.1017

Kurniawan, R., Jaedun, A., Mutohhari, F., & Kusuma, W. M. (2021). The absorption of vocational education graduates in the automotive sector in the industrial world. Journal of Education Technology, 5(3), 482–490. https://doi.org/10.23887/jet.v5i3.35365

Marsono, M., Muzani, M. R., Basuki, B., Sutadji, E., Yoto, Y., Mustakim, S. S., Ali, S. bin P., & Khasanah, F. (2019). School and industries collaboration on implementing vocational education internship program: Best practice in Indonesia. Proceedings of the 1st Vocational Education International Conference (VEIC 2019), 293–299. https://doi.org/10.2991/assehr.k.191217.047

Mncayi, P., & Dunga, S. H. (2016). Career choice and unemployment length. Industry and Higher Education, 30(6), 413–423. https://doi.org/10.1177/0950422216670500

Mukhlason, A., Winanti, T., & Yundra, E. (2020). Analisa indikator SMK penyumbang pengangguran di provinsi Jawa Timur. Journal of Vocational and Technical Education (JVTE), 2(2), 29–36. https://doi.org/10.26740/jvte.v2n2.p29-36

Nuryanto, A., & Eryandi, K. Y. (2020). The 21st century ideal skills for vocational high schools. Proceedings of the International Conference on Educational Research and Innovation (ICERI 2019), 142–147. https://doi.org/10.2991/assehr.k.200204.026

Presiden Republik Indonesia. (1990). Peraturan Pemerintah Republik Indonesia Nomor 29 Tahun 1990 tentang Pendidikan Menengah. http://www.bphn.go.id/data/documents/90pp029.pdf

Presiden Republik Indonesia. (2003). Undang-Undang Republik Indonesia Nomor 20 Tahun 2003 tentang Sistem Pendidikan Nasional. Presiden Republik Indonesia. http://simkeu.kemdikbud.go.id/index.php/peraturan1/8-uu-undang-undang/12-uu-no-20-tahun-2003-tentang-sistem-pendidikan-nasional

Qotimah, K., Basuki, I., & Muslim, S. (2019). Study of the contribution of entrepreneurial insights and industrial work practices to work readiness by student graduates in vocational high schools. Proceedings of the International Conference on Science, Technology, Education, Arts, Culture and Humanity - “Interdisciplinary Challenges for Humanity Education in Digital Era” (STEACH 2018), 6–12. https://doi.org/10.2991/steach-18.2019.2

Rahmawati, R. (2021). Implementation of authentic assessment in learning the learning the learning the Indonesian Language. INTERNATIONAL JOURNAL OF EDUCATIONAL DEVELOPMENT AND INNOVATION, 1(1). https://scholar.uinib.ac.id/id/eprint/275/

Riduwan, R. (2018). Skala pengukuran variabel-variabel penelitian. Alfabeta.

Setiyawami, S., Sugiyo, S., Sugiyono, S., & Rahardjo, T. J. (2020). The role of vocational education on the advancement of human development in Indonesia. Proceedings of the International Conference on Science and Education and Technology (ISET 2019), 406–410. https://doi.org/10.2991/assehr.k.200620.079

Setyawan, E., Rubai, B., & Yudiono, H. (2022). The development of online integrated competency test material to improve graduate competency. Journal of Vocational and Career Education, 7(1), 9–20. https://journal.unnes.ac.id/nju/jvce/article/view/38238

Stufflebeam, D. L. (2003). The CIPP model for evaluation. In International Handbook of Educational Evaluation (pp. 31–62). Springer Netherlands. https://doi.org/10.1007/978-94-010-0309-4_4

Stufflebeam, D. L., & Coryn, C. L. S. (2014). Evaluation theory, models, and applications. John Wiley & Sons.

Suhendar, S., Surjono, H. D., PH, S., Priyanto, P., & Hanafi, I. (2020). The cluster-based skills passport assessment model to improve the effectiveness of electrical power installation competency certification in Indonesian vocational school. INTERNATIONAL JOURNAL OF ADVANCED SCIENCE AND TECHNOLOGY, 29(1), 11–17. https://eprints.untirta.ac.id/15551/

Susanti, N. I., Brahmasari, I. A., & Suryani, T. (2022). Effect of competence and self-leadership on the organizational commitment of assessors of P1 professional certification institutions (LSP-P1) in Indonesia. International Research Journal of Management, IT and Social Sciences, 9(2), 235–243. https://doi.org/10.21744/irjmis.v9n2.2052

Wahjusaputri, S., & Bunyamin, B. (2022). Development of teaching factory competency-based for vocational secondary education in Central Java, Indonesia. International Journal of Evaluation and Research in Education (IJERE), 11(1), 353–360. https://doi.org/10.11591/ijere.v11i1.21709

Wahyuni, V. S., Nurlela, N., & Haryanto, Y. (2021). The implementation of vocational regulation of education. EDUTEC: Journal of Education And Technology, 5(2), 348–356. https://ejournal.ijshs.org/index.php/edu/article/view/340

Widayanto, L. D., Soeharto, S., Sudira, P., Daryono, R. W., & Nurtanto, M. (2021). Implementation of the Education and Training Program seen from the CIPPO Perspective. Journal of Education Research and Evaluation, 5(4), 614–623. https://doi.org/10.23887/jere.v5i4.36826

Yuliana, L., Setiawan, J., & Fadli, M. R. (2023). The performance of vocational high school principal’s learning supervision in Indonesia. International Journal of Evaluation and Research in Education (IJERE), 12(3), 1486–1496. https://doi.org/10.11591/ijere.v12i3.24995

DOI: https://doi.org/10.21831/jpv.v14i2.71359