Are the Final Semester Examination Questions for Basic Science Concepts Made by Lecturers Have the Quality According to the Rasch Model?

Anasufi Banawi, Institut Agama Islam Negeri Ambon, Indonesia
Muhammad Irfan Rumasoreng, Universitas Mercu Buana Yogyakarta, Indonesia
Irawati Basta, Madrasah Ibtidaiyah Terpadu As-Salam Ambon, Indonesia
Adam Latuconsina, Institut Agama Islam Negeri Ambon, Indonesia

 10.21831/jpe.v11i1.53633

Abstract


Analysis of Final semester examination items in the Basic Science Concepts course using the Rasch model has not been widely carried out, even though analyzing subject matter test items is a reflection of education and a noble task that can be carried out by educators in order to perfect and improve the quality of the tests they make themselves. The Rasch model is chosen so that the quality of the items does not depend on the test taker's ability to respond to answers. This study aims to describe the quality of the items from the Final Semester Examination on Basic Science Concepts course using the Rasch model. In this research used descriptive method. Data were collected through a documented study of 10 multiple choice questions in the form of answer sheets from 42 (6 male; 36 female) students of Madrasah Ibtidaiyah Teacher Education (PGMI) at a state university in Ambon. The Rasch model with the help of the Winstep software program is used in analyzing the items. The results showed that a number of items according to the Rasch model with test reliability were in the high category. Existing results can be used by lecturers as diagnostic material for achieving student knowledge competence and improving lectures.


Keywords


quality, items, basic science concepts, rasch model

Full Text:

FULLTEXT PDF

References


Abdillah. (2013). Profil kesalahan dalam menyelesaikan soal persamaan dan pertidaksamaan linier satu dan dua variabel mahasiswa semester ii angkatan 2012/2013 jurusan pendidikan matematika iain ambon [Profile of errors in solving one and two variable linear equations and inequalities of second semester students in Class of 2012/2013 majoring in Mathematics Education IAIN Ambon]. Horizon Pendidikan, 8(1), 1–13.

Al Fajar, S. N., Sitompul, S. S., & Arsyid, S. B. (2022). Analisis kemampuan peserta didik dalam menyelesaikan tes higher order thinking skill (hots) berbantuan aplikasi winstep tentang materi pesawat sederhana [Analysis of students' ability to complete the higher order thinking skill (hots) test with the help of the winstep application on simple machine material]. Jurnal Inovasi Penelitian Dan Pembelajaran Fisika, 3(1), 10–17. https://doi.org/10.26418/JIPPF.V3I1.44544

Alfarisa, F., & Purnama, D. N. (2019). Analisis butir soal ulangan akhir semester mata pelajaran ekonomi sma menggunakan rasch model [Analysis of items on the final semester exam in high school economics using the Rasch model]. Jurnal Pendidikan Ekonomi Undiksha, 11(2), 366–374. https://doi.org/10.23887/JJPE.V11I2.20878

Alpusari, M. (2015). Analisis Butir soal konsep dasar ipa 1 melalui penggunaan program komputer anates versi 4.0 for windows [Item analysis on the basic concepts of Science 1 through the use of the computer program Anates version 4.0 for Windows]. Primary: Jurnal Pendidikan Guru Sekolah Dasar, 3(2), 106–115. https://doi.org/10.33578/jpfkip.v3i2.2501

Anggraini, D. & Suyata, P. (2014). Karakteristik soal uasbn mata pelajaran bahasa indonesia di daerah istimewa yogyakarta pada tahun pelajaran 2008/2009. Jurnal Prima Edukasia, 2(1), 57-65.

Arikunto, S. (2006). Dasar-dasar evaluasi pendidikan (edisi revisi) [Fundamentals of educational evaluation (revised edition)]. PT Bumi Aksara.

Astuti, B., Purwanta, E., Ayriza, Y., Bhakti, C. P., Lestari, R., & Herwin, H. (2022). School connectedness instrument’s testing with the Rasch model for high school students during the COVID-19 pandemic. Cypriot Journal of Educational Sciences, 17(2), 410–421. https://doi.org/10.18844/cjes.v17i2.6828

Azizah, & Wahyuningsih, S. (2020). Penggunaan model rasch untuk analisis instrumen tes pada mata kuliah matematika aktuaria [The use of the Rasch model for the analysis of test instruments in Actuarial Mathematics course]. Jurnal Pendidikan Matematika (JUPITEK), 3(1), 45–50. https://doi.org/10.30598/JUPITEKVOL3ISS1PP45-50

Banawi, A., Syafit, M., Basta, I., Ridwan, M., & Sulaeman. (2022). Evaluating educational concepts mastery of prospective teachers in ambon: an-ex-post-facto study from comprehensive examination result. Jurnal Pendidikan Progresif, 12(2), 621–634. https://doi.org/10.23960/JPP.V12.I2.202217

Banawi. (2021). Rencana pembelajaran semester-matakuliah konsep dasar ipa [Semester lesson plan for the Basic Science Concept course]. Program Studi Pendidikan Guru Madrasah Ibtidaiyah, Fakultas Ilmu Tarbiyah dan Keguruan, Institut Agama Islam Negeri Ambon.

Black, P., & Wiliam, D. (2018). Classroom assessment and pedagogy. Assessment in Education: Principles, Policy & Practice, 25(6), 1-25. https://doi.org/10.1080/0969594X.2018.1441807

Boone, W. J., Staver, J. R., & Yale, M. S. (2014). Rasch Analysis in the Human Sciences. Amsterdam, Netherlands: Springer. https://doi.org/10.1007/978-94-007-6857-4

Dewi, S. Z., & Ibrahim, H. T. (2019). Pentingnya pemahaman konsep untuk mengatasi miskonsepsi dalam materi belajar ipa di sekolah dasar [The importance of understanding concepts to overcome misconceptions in Science Learning materials in Elementary Schools]. Jurnal Pendidikan UNIGA, 13(1), 130–136. https://doi.org/10.52434/JP.V13I1.823

Dwinata, A. (2019). Analisis kemampuan pemecahan masalah menggunakan pemodelan rasch pada materi permutasi dan kombinasi [Analysis of problem solving abilities using Rasch modeling on permutations and combinations materials]. PRISMA, Prosiding Seminar Nasional Matematika, 2, 124–131. https://journal.unnes.ac.id/sju/index.php/prisma/article/view/28899

Englehard, G. (2013). Invariant measurement, using rasch models in the social, behavioral and health sciences. Routledge.

Erfan, M., Archi Maulyda, M., Hidayati, V. R., Astria, F. P., & Ratu, T. (2020). Analisis kualitas soal kemampuan membedakan rangkaian seri dan paralel melalui teori tes klasik dan model rasch [Quality analysis of the ability to distinguish series and parallel circuits through classical test theory and the Rasch model]. Indonesian Journal Of Educational Research and Review, 3(1), 11–19. https://doi.org/10.23887/IJERR.V3I1.24080

Fatmawati, L. (2016). Peningkatan keaktifan dan pemahaman konsep IPS melalui model learning cycle 5E. Jurnal Prima Edukasia, 4(2), 148-162. doi:http://dx.doi.org/10.21831/jpe.v4i2.9488

Fisher Jr., W. P. (2007). Rating scale instrument quality criteria. Rasch Measurement Transaction, 21, 1095. http://www.rasch.org/rmt/rmt211a.htm

Ghozali, I. (2006). Aplikasi analisis multivariat dengan program spss [Multivariate analysis application with SPSS program]. Badan Penerbit UNDIP.

Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. SAGE Publications Inc.

Hartono, W., Hadi, S., Rosnawati, R., & Retnawati, H. (2022). Uji kecocokan model parameter logistik soal diagnosa kemampuan matematika dasar [Test the fit of the logistic parameter model for diagnosing basic mathematical abilities]. JNPM (Jurnal Nasional Pendidikan Matematika), 6(1), 125–144. https://doi.org/10.33603/JNPM.V6I1.5899

Herwin, H., Tenriawaru, A., & Fane, A. (2019). Math elementary school exam analysis based on the rasch model. Jurnal Prima Edukasia, 7(2), 106-113. doi:https://doi.org/10.21831/jpe.v7i2.24450

IAIN Ambon. (2018). Prosedur mutu: standar operasional prosedur [Quality procedures: standard operating procedures]. Lembaga Penjaminan Mutu Institut Agama Islam Negeri Ambon.

Ilfiandra., Nadhirah, N. A., Suryana, D., & binti Ahmad, A. (2022). Development and validation peaceful classroom scale: Rasch model analysis. International Journal of Instruction, 15(4), 497-514. https://doi.org/10.29333/iji.2022.15427a

Jackson, T. R., Draugalis, J. R., Slack, M. K., Zachry, W. M., & Agostino, J. D. (2002). Validation of authentic performance assessment: A process suited for rasch modeling. American Journal of Pharmaceutical Education, 66, 233–243.

Jusuf, R. (2015). Analisis kemampuan mahasiswa pgsd semester i dalam menyelesaikan soal-soal mata kuliah konsep dasar ipa i pokok bahasan sistem pernapasan dengan menggunakan metode demonstrasi [Analysis of the ability of first semester Elementary Teacher Education students in solving questions in the basic science concept course on the subject of respiratory system using the demonstration method]. Primary: Jurnal Pendidikan Guru Sekolah Dasar, 4(1), 46–53. https://doi.org/10.33578/jpfkip.v4i1.2722

Jusuf, R., Sopandi, W., Ratnawulan, A., & Sa’ud, U. S. (2018). Profil karakteristik soal ujian nasional ipa berdasarkan taksonomi bloom revisi [Characteristic profile of science national exam questions based on revised bloom taxonomy]. Visipena, 9(1), 115–127. https://doi.org/10.46244/VISIPENA.V9I1.436

Kasmo, S. (2013, August 27). Manfaat hasil penilaian (hasil belajar) [Benefits of assessment results (learning outcomes)]. Kompasiana. https://www.kompasiana.com/sukasmo/552bac716ea834bf5b8b4568/manfaat-hasil-penilaian-hasil-belajar

Khong, W. S., & Lim, H. L. (2019). Penggunaan model rasch untuk menganalisis miskonsepsi bagi topik nombor integer [The use of the Rasch model to analyze misconceptions for the topic of integer numbers]. Asia Pacific Journal of Educators and Education, 34, 105–128. https://doi.org/10.21315/apjee2019.34.6

Kumaidi. (1999). Aplikasi teori rasch untuk penyekalaan vertikal tes catur wulan [Application of rasch theory to vertical scaling of quarterly tests]. Jurnal Ilmu Pendidikan, 6(2), 89–102. https://doi.org/10.17977/JIP.V6I2.705

Lestari, W. T., Saputro, S., Masykuri, M., Hastuti, B., Ulfa, M., Mulyani, S., & Yamtinah, S. (2020). Item analysis of teachnological pedagogical content knowledge (TPACK) in pre-service chemistry teachers using the Rasch Model application. Journal of Physics: Conference Series, 1511(1), 012043. https://doi.org/10.1088/1742-6596/1511/1/012043

Ma’rifah, D. R. (2017). Diagnosis kesulitan belajar mahasiswa pada mata kuliah perkembang peserta didik [Diagnosis of student learning difficulties in student development courses]. Jurnal Pendidikan Biologi Indonesia, 3(1), 88–94. http://download.garuda.kemdikbud.go.id/article.php?article=640463&val=7984&title=Diagnosis of student learning difficulties on learner development studies

MacCann, R. G. & Stanley, G. (2006). The use of rasch modeling to improve standard setting. Practical Assessment, Research, and Evaluation: 11(2), 1-17. DOI: https://doi.org/10.7275/sbnk-w656

Mardapi, D. (2008). Teknik penyusunan instrumen tes dan nontes [Techniques for preparing test and nontes instruments]. Mitra Cendikia Press.

Meyer, J. P., & Hailey, E. (2012). A study of Rasch, partial credit, and rating scale model parameter recovery in WINSTEPS and jMetrik. Journal of Applied Measurement, 13(3), 248–258.

Muslihin, H. Y., Suryana, D., Ahman., Suherman, U., & Dahlan, T. H. (2022). Analysis of the reliability and validity of the self-determination questionnaire using rasch model. International Journal of Instruction, 15(2), 207-222. https://doi.org/10.29333/iji.2022.15212a

Natsir, N. A. (2010). Tingkat kemampuan dosen fakultas tarbiyah dalam mendesain pembelajaran sebagai peserta workshop desain pembelajaran pendidikan tinggi di iain ambon [The ability level of Tarbiyah Faculty Lecturers in designing instructions as participants in higher education instructional design workshops in IAIN Ambon].

Fikratuna-Jurnal Penelitian Sosial Keagamaan, 2(2), 21–40.

Nur, L., Nurani, L. A., Suryana, D., & Ahmad, A. (2020). Rasch model application on character development instrument for elementary school students. International Journal of Learning, Teaching and Educational Research, 19(3), 437-459. https://doi.org/10.26803/ijlter.19.3.24

Nurharyanto, D., & Retnawati, H. (2020). The difficulties of the elementary school students in solving the mathematical narrative test items. Jurnal Prima Edukasia, 8(1), 29-39.

doi:https://doi.org/10.21831/jpe.v8i1.29969

Prasetyo, T. (2017). Pengembangan perangkat penilaian hasil belajar dalam pembelajaran tematik integratif kelas V SD. Jurnal Prima Edukasia, 5(1), 102-111. doi:http://dx.doi.org/10.21831/jpe.v5i1.7528

Purba, S. E. D. (2018). Analisis model Rasch instrumen tes prestasi pada mata pelajaran dasar dan pengukuran listrik [Analysis of the Rasch model of achievement test instruments on subjects of basic and electricity measurements]. Wiyata Dharma: Jurnal Penelitian Dan Evaluasi Pendidikan, 6(2), 142–147. https://doi.org/10.30738/WD.V6I2.3393

Purwanto, M. N. (1992). Prinsip-prinsip dan teknik evaluasi pengajaran [Principles and techniques of teaching evaluation]. PT Remaja Rosdakarya.

Ramadhani, R., & Fitri, Y. (2020). Validitas e-modul matematika berbasis epub3 menggunakan analisis rasch model [The validity of the epub3-based mathematics e-module using the Rasch model analysis]. Jurnal Gantang, 5(2), 95–111. https://doi.org/10.31629/jg.v5i2.2535

Ramdani, R., Hanurawan, F., Ramli, M., Lasan, B. B., & Afdal, A. (2020). Development and validation of indonesian academic resilience scale using rasch models. International Journal of Instruction, 14(1), 105-120. https://doi.org/10.29333/iji.2021.1417a

Retnawati, H. (2014). Teori respons butir dan penerapannya: untuk peneliti, praktisi pengukuran dan pengujian, mahasiswa pascasarjana [Item response theory and its applications: for researchers, measurement and testing practitioners, graduate students]. Nuha Medika.

Rochman, S., & Hartoyo, Z. (2018). Analisis high order thinking skills (hots) taksonomi menganalisis permasalahan fisika [Analysis of high order thinking skills (hots) taxonomy analyzes physics problems]. SPEJ (Science and Physic Education Journal), 1(2), 78–88. https://doi.org/10.31539/SPEJ.V1I2.268

Safari. (2003). Evaluasi pembelajaran [Learning evaluation]. Departemen Pendidikan Nasional, Direktorat Jenderal Pendidikan Dasar dan Menengah, Direktorat Tenaga Kependidikan.

Setiawan, A., Fajaruddin, S., & Andini, D. (2019). Development an honesty and discipline assessment instrument in the integrated thematic learning at elementary school. Jurnal Prima Edukasia, 7(1), 9- 19. doi:https://doi.org/10.21831/jpe.v7i1.23117

Sudjana, N. (1991). Penilaian hasil proses belajar mengajar [Assessment of instructional process results]. PT Remaja Rosdakarya.

Sugiyono. (2013). Metode penelitian kuantitatif, kualitatif dan r&d [Quantitative, qualitative and R&D research methods]. Alfabeta.

Sulistiawati, Sulistyowati, R., & Lefudin. (2021). Upaya meningkatkan pemahaman konsep pada mata kuliah konsep dasar ipa i pada program studi pendidikan guru sekolah dasar (pgsd) menggunakan pengajaran remedial [Efforts to improve conceptual understanding in the basic science concepts course in the elementary school teacher education study program (PGSD) through remedial teaching]. PEDAGOGOS: Jurnal Pendidikan, 3(2), 1–10. https://doi.org/10.33627/GG.V3I2.507

Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan rasch pada assessment pendidikan [Rasch modeling application on educational assessment]. Trim Komunikata.

Surya, Y. F., & Marta, R. (2017). Analisis kesulitan belajar mahasiswa pgsd stkip pahlawan tuanku tambusai pada mata kuliah konsep dasar ipa sd tahun ajaran 2016/2017 [Analysis of learning difficulties of PGSD STKIP Pahlawan Tuanku Tambusai students in the subject of Elementary Basic Science Concepts in the 2016/2017 academic year]. Jurnal Basicedu, 1(2), 1–11. https://doi.org/10.31004/BASICEDU.V1I2.164

Syadiah, A.N. & Hamdu, G. (2020). Analisis rasch untuk soal tes berpikir kritis pada pembelajaran stem di sekolah dasar [Rasch analysis for critical thinking test questions on STEM learning in elementary schools]. Premiere Educandum: Jurnal Pendidikan Dasar dan Pembelajaran, 10(2), 138 – 148. Doi.org/10.25273/pe.v10i2.6524.

Tabatabaee-Yazdi, M., Motallebzadeh, K., Ashraf, H., & Baghaei, P. (2018). Development and validation of a teacher success questionnaire using the rasch model. International Journal of Instruction, 11(2), 129-144. https://doi.org/10.12973/iji.2018.11210a

Widhiarso, W. (2011). Aplikasi teori respon butir untuk menguji invariansi pengukuran psikologi guna keperluan survei dan seleksi pekerjaan [Application of item response theory to test the invariance of psychological measurements for survey and job selection purposes]. Psikobuana, 104–117. https://www.e-jurnal.com/2015/09/aplikasi-teori-respon-butir-untuk.html

Winarti, P. (2021). Analisis kesulitan belajar mahasiswa dalam perkuliahan konsep dasar ipa fisika secara daring di masa pandemi covid-19 [Analysis of students' learning difficulties in online lectures on the basic concepts of physics during the Covid-19 pandemic]. Jurnal Komunikasi Pendidikan, 5(1). https://doi.org/10.32585/jkp.v5i1.1076

Yusron, E., & Sudiyatno, S. (2021). How is the impact of Assessment for Learning (AfL) on mathematics learning in elementary schools?. Jurnal Prima Edukasia, 9(1), 75-84. doi:https://doi.org/10.21831/jpe.v9i1.34865




DOI: https://doi.org/10.21831/jpe.v11i1.53633

Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Jurnal Prima Edukasia

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Jurnal Prima Edukasia indexed by:

All rights reserved p-ISSN: 2338-4743 |e-ISSN: 2460-9927

Creative Commons LicenseJurnal Prima Edukasia by http://journal.uny.ac.id/index.php/jpe/index is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
View Prima Edukasia Journal Stats