Rasch model analysis of essay questions to measure literacy and numeracy skills in plant and animal bioprocess topics based on AKM
DOI:
https://doi.org/10.21831/reid.v11i1.85614Keywords:
Assessment Instrument, reading literacy test, Numeracy literacy, biology education, Rasch ModelAbstract
Literacy skills in reading and numeracy in Indonesia are classified as low, so the government has made new policies, one of which is the application of questions based on the Minimum Competency Assessment in the National Assessment (AN). The results of observations of several high schools in Pekanbaru, Riau have not shown the application of AKM questions to biology learning. This research aims to produce AKM-based reading and numeracy literacy instruments on high school plant and animal bioprocess materials. The type of research applied is Research and Development (R&D) where the subjects are students in grade XII of SMA Negeri 1, Negeri 3, and Negeri 4 Pekanbaru. Data collection instruments are test instruments that have been developed. Data analysis techniques using Rasch modeling assisted by Winstep software include, wright map analysis, person capability analysis, item capability analysis, scalogram analysis, and question item analysis. The results showed that most students had a logic score below 0.0, which means that reading and numeracy literacy skills, as well as understanding concepts are still low. There were four students who had inappropriate answer patterns, indicating that students did not work on the questions seriously. Then, the results of the analysis showed 14 fit questions; with a Cronbach alpha value of 0.84 with a very high interpretation, a person reability value of 0.77 with sufficient interpretation, and an item reability value of 0.92 in the very high category; the difficulty level of the question items was in accordance with the rules of development of the test instrument, because there was a spread of difficulty of the question items starting from very difficult, Hard, medium, easy, and very easy. Thus, it can be concluded that the results of the development and analysis of test instruments can be used to measure reading literacy and numeracy skills based on AKM on plant and animal bioprocess materials.
References
Aisah, H., Zaqiah, Q. Y., & Supiana, A. (2021). Implementation of the Minimum Capability Assessment (AKM) Policy: Analysis of the Implementation of the AKM Policy. Al-Affan Journal of Islamic Education, 1(2), 128–135. https://doi.org/10.69775/jpia.v1i2.25
Andrich, D., & Marais, I. (2019). A Course in Rasch Measurement Theory. Singapore: Spinger Singapore.
Bagiyono. (2017). Analysis of the Level of Difficulty and Differentiation of Level 1 Radiography Training Exam Questions. Journal of Widyanuklida, 16(1), 1–12.
Boone, W, J. (2016). Rasch Analysis for Instrument Development: Why, When, and How?. CBE—Life Sciences Education, 15(4), 1-7. https://doi:10.1187/cbe.16-04-0148
Cahyana, A. (2020). "AKM Prospects and Character Surveys: Strengthening the Preliteracy and Prenumeracy Base of Early Childhood". In Banpaudpnf Kemendiikbud, 1–4.
Chan, S, W., Ismail, z., & Sumintono, B. (2013). A Rasch Model Analysis on Secondary Students’ Statistical Reasoning Ability in Descriptive Statistics. Procedia - Social and Behavioral Sciences, 129, 133-139. https://doi:10.1016/j.sbspro.2014.03.658
Dwinata, A. (2019). Analysis of Problem-Solving Ability Using RASCH Modeling on Permutation and Combination Materials. PRISMA, Proceedings of the National Seminar on Mathematics, 2, 124–131.
Finbraten, H, S., Larsson, B., Nordstrom, G., Pettersen, K, S., Trollvik, A., & Guttersrud, O. (2018). Establishing the HLS-Q12 short version of the European Health Literacy Survey Questionnaire: latent trait analyses applying Rasch modelling and confirmatory factor analysis. BMC Health Services Research, 18(506), 1-17. https://doi:10.1186/s12913-018-3275-7
Hasanah, H., & Aini, F, Q. (2025). Development of Science Process Skills Test Instruments on Chemical Equilibrium Topics: Analysis with the Rasch Model. JagoMIPA: Journal of Mathematics and Science Education, 5(1), 68-82. https://doi:10.53299/jagomipa.v5i1.1043
Hikmah, F, N., Volunteer, M, I., Nurjannah, T., & Djumati, J. (2021). Elaboration of High School Student's Metacognition Awareness on Heat and Temperature Material: Wright Map in Rasch Model. Indonesian Journal of Science and Mathematics Education, 4(2), 172-182. https://doi.org/10.24042/ijsme.v4i2.9488
Jacob, E, R., Duffield, C., & Jacob, A, M. (2019). Validation of data using RASCH analysis in a tool measuring changes in critical thinking in nursing students. Nurse Education Today, 76, 196-199. https://doi:10.1016/j.nedt.2019.02.012
Jimam, N, S., Ismail, N, E., Dangiwa, D, A., Dapar, M, L, P., Sariem, C, N., Paul, L, A., Mohammed, S, G., Dayom, D, W. (2021). Use of Rasch Wright map to understand the quality of Healthcare Workers' Knowledge, Attitudes, and Practices for Uncomplicated Malaria (HKAPIUM). Journal of Pharmacy and Bioresources, 18(3), 237-244. https://doi:10.3389/fphar.2019.01521
Kurli, H., Haliqah, N., & Anekawati, A. (2021). Analysis of students' cognitive abilities in junior high school science subjects using the rasch model. Journal of Medical Entrepreneurs, 1(2), 74-79. https://doi.org/10.55748/bjel.v3i2.133
Leeming, P. (2016). Using dictation to measure language proficiency: A Rasch analysis. Language Testing and Assessment, 5(2), 1-25. https://doi.org/10.58379/mbsw8958
Lestari, A. M., & Samsudin, A. (2019). Using Rasch Model Analysis to Analyze Students’ Scientific Literacy on Heat and Temperature. Proceedings of the 9th Mathematics, Science, and Computer Science Education International Seminar, 1-8. https://DOI:10.4108/eai.12-10-2019.2296483
Mawaddah, Y. (2020). The use of the discovery learning model with the practicum method on increasing student participation and learning outcomes in cell materials at MAS Nurul Islam Blang Rakal. (Thesis). Graduate School, Ar-Raniry State Islamic University, Aceh.
Meriana, T., & Murniarti, E. (2021). Minimum Competency Assessment Training Analysis. Journal of Educational Dynamics, 14(2), 110-116. https://doi.org/10.51212/jdp.v14i2.7
Millah, E, S., Budipramana, L, S., & Isnawati, I. (2012). Development of Biotechnology Textbooks in Grade XII of Ipiemssurabaya High School Oriented to Science, Technology, Environment, and Society (SETS). Journal of Surabaya State University, 1(1), 19-24.
Minister of Education and Culture. (2020). Center for Assessment and Learning of the Research and Development Agency and Books of the Ministry of Education and Culture AKM and Its Implications on Learning.
Ministry of Education and Culture. (2020). AKM and Its Implications on Learning. Jakarta: Center for Assessment and Learning of the Research and Development Agency and Books of the Ministry of Education and Culture.
Ngadi, N. (2023). Rasch Model Analysis to Measure the Knowledge Competency of SMKN 1 Kalianget Students in the Subject of Motorcycle Electrical System Maintenance. Journal of Automotive Vocational Education, 6(1), 1-19. https://doi.org/10.21831/jpvo.v6i1.63479
Novita, N., Mellyzar, M., & Herizal, H. (2021). National Assessment (AN): Knowledge and Perception of Prospective Teachers. Journal of Social Sciences and Education, 5(1), 172–179.
Nurjanah, W, L., Sari, I, M., & Saepuzaman, D. (2024). Analysis of students' concept understanding on the topic of heat propagation using the Rasch model. Didactics: Journal of Education, 13(2), 1361-1374. http://dx.doi.org/10.58258/jisip.v5i1.1568
OECD. (2019). Programme for International Student Assessment (PISA) Results from PISA 2018. Paris: OECD.
Pereira, J., Tang, J., Soares, B., Prihandini, R, M., & Wijaya, T, T. (2022). Exploring the Accuracy of Mathematics Students on the Final Semester Assessment Based on Racsh Model Analysis in Timor-Leste. Proceedings of the 2nd International Conference on Emerging Technologies and Intelligent Systems, 416-425. https://doi.org/10.1007/978-3-031-20429-6_38
Purniasari, L., Masykuri, M., & Ariani, S. R. D. (2021). Analysis of School Exam Questions for Chemistry Subject SMA N 1 Kutowinangun Academic Year 2019/2020 Using the Iteman and Rasch Models. Journal of Chemistry Education, 10(2), 205–214. https://doi.org/10.20961/jpkim.v10i2.48244
Ridzuan M, F., Lian, L, H., Fozee, F, A, A., & Nasser, S, N. (2020). Rasch Analysis Model: Reliability and Validity of Superitem Test Instrument. International Journal of Academic Research in Progressive Education and Development, 9(4), 1-11. https://doi:10.6007/IJARPED/v9-i4/8166
Rigianti, H, A., & Utomo, A, C. (2023). Minimum Competency Assessment in the Realm of Reading Literacy and Its Implications in Elementary Schools. Journal of Education and Development, 11(1), 133-137. https://doi.org/10.37081/ed.v11i1.4254
Rusiqoh, R., & Suhendi, E. (2021). Using Rasch model analysis to analyse students’ mastery of concept on newton law. Journal of Physics: Conference Series, 1731, 1-6. https://doi:10.1088/1742-6596/1731/1/012077
Rusiyah, R., Eraku, S., & Supadmi, S. (2020). Analysis of Geography Subject Final Semester Exam Questions Using Rasch Modeling. Swarnabhumi Journal, 5(1), 11-18. https://doi:10.31851/swarnabhumi.v5i1.4136
Sari, E. D. K., & Mahmudi, I. (2019). Analysis of Rasch modeling on educational assessment (Analysis using the Winstep application). Purwokerto: PT. Persada Kerta Utama Pen.
Sartika, S., & Mukhlis, M. (2023). Higher Order Thinking Skills in Reading Literacy Akm Questions at Vocational School of Agriculture Pekanbaru. Journal of Education, Language, and Literature, 11(1), 39–47. https://doi.org/10.25299/geram.2023.vol11(1).12151
Sudihartinih, E., & Wahyudin, W. (2019). Analysis of Students’ Self Efficacy Reviewed by Geometric Thinking Levels and Gender Using Rasch Model. Journal of Engineering Science and Technology, 14(1), 509-519.
Sumintono, B. (2018). Rasch Model Measurements as Tools in Assessment for Learning. Advances in Social Science, Education and Humanities Research, 173, 38-41. https://doi:10.2991/icei-17.2018.11
Sumintono, B., & Widhiarso, W. (2015). Application of Rasch Modeling in Educational Assessment. Bandung: Trim Komunikata.
Susilowati, N. I., Liliawati, W., & Rusdiana, D. (2023). Science Process Skills Test Instruments in The New Indonesian Curriculum (Merdeka): Physics Subject in Renewable Energy Topic. Indonesian Journal of Teaching in Science, 3(2), 121–132. https://doi.org/10.17509/ijotis.v3i2.60112
Syadiah, A, N., & Hamdu, G. (2020). Rasch's Analysis for Critical Thinking Test Questions on STEM Learning in Elementary School. Journal of Basic Education and Learning, 10(2), 138-148. https://doi:10.25273/pe.v10i2.6524
Tesio, L., Caronni, A., Kumbhare, D., & Scarano, S. (2024). Interpreting results from Rasch analysis 1. The “most likely” measures comingfrom the model. Disability And Rehabilitation, 46(3), 591-603. https://doi.org/10.1080/09638288.2023.2169771
Tyas, E, H., Hamdu, G., & Pranata, O, H. (2020). Analysis of Multiple-Choice Questions Using Rasch Modeling to Measure Students' Ability to Sort Fractional Numbers in Elementary School. Scientific Journal of Elementary School Teacher Education, 7(2), 1-12. https://doi.org/10.17509/pedadidaktika.v7i2.24773
Uba, A, R., & Khairani, A, Z. (2024). Assessing Item Reliability, Differential Item Functioning, and Wright Map Analysis of the GSP122 Test at a Public University in Nigeria. Journal Of Education for Sustainable Innovation, 2(2), 107-120.
Yulianto, A., & Widodo, A. (2020). Disclosure of Difficulty Distribution of HOTS-Based Test Questions through Rasch Modeling. Indonesian Journal of Primary Education, 4(2), 197–203. https://doi.org/10.17509/ijpe.v4i2.29318
Published
How to Cite
Issue
Section
Citation Check
License
Copyright (c) 2025 REID (Research and Evaluation in Education)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
The authors submitting a manuscript to this journal agree that, if accepted for publication, copyright publishing of the submission shall be assigned to REID (Research and Evaluation in Education). However, even though the journal asks for a copyright transfer, the authors retain (or are granted back) significant scholarly rights.
The copyright transfer agreement form can be downloaded here: [REID Copyright Transfer Agreement Form]
The copyright form should be signed originally and sent to the Editorial Office through email to reid.ppsuny@uny.ac.id
REID (Research and Evaluation in Education) by http://journal.uny.ac.id/index.php/reid is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
.png)
