An analysis of Javanese language test characteristic using the Rasch model in R program

Muchlisin Muchlisin; Djemari Mardapi; Farida Agus Setiawati

doi:10.21831/reid.v5i1.23773

An analysis of Javanese language test characteristic using the Rasch model in R program

Muchlisin Muchlisin, Department of Educational Research and Evaluation, Graduate School of Universitas Negeri Yogyakarta, Indonesia
Djemari Mardapi, Department of Educational Research and Evaluation, Graduate School of Universitas Negeri Yogyakarta, Indonesia
Farida Agus Setiawati, Department of Educational Research and Evaluation, Graduate School of Universitas Negeri Yogyakarta, Indonesia

10.21831/reid.v5i1.23773

Abstract

One skill required to solve a problem in the 21st century is communication. Two international languages that are important in communication and thought at school are English and German language. However, beside international language, the local language, such as the Javanese language, is also essential and need to be maintained. The purpose of this study is to analyze the Javanese language test characteristics. This study was explorative research with secondary data collected by documentation of 220 students responses to the 50 multiple choice item of Javanese language test in the 11th grade of vocational high school. Data were analyzed using the Rasch model assisted by R program. Rasch model fits the data with 42 items after three times calibration. Based on difficulty level, ICC, and items reliability, there were 28 of 42 items (66.67%) that were good. This study finds out that generally, the Javanese language test is in the moderate category of difficulty. Hence, the need of evaluating the Javanese language test to make a better test that gives more accurate information about examinees' ability is crucial. The evaluation of the Javanese language test can be used to plan the next learning to get better Javanese language learning.

Keywords

Javanese language test; Rasch model; R program

Full Text:

PDF

References

Allen, M. J., & Yen, W. M. (1979). Introduction to measurement theory. Montery, CA: Cole Publishing.

Arikunto, S. (2010). Prosedur penelitian: Suatu pendekatan praktik (Revised ed). Jakarta: Rineka Cipta. Retrieved from https://doi.org/10.1017/CBO9781107415324.004

Baker, F. B. (2001). The basics of item response theory (2nd ed.). College Park, MD: ERIC Clearinghouse on Assessment and Evaluation.

Cohen, L., Manion, L., & Morrison, K. (2007). Research methods in education (6th ed.). London and New York, NY: Routledge Falmer.

Dede, C. (2010). Comparing frameworks for 21st century skills. In J. Bellance & R. Brandt (Eds.), 21st century skills: Rethinking how students learn (pp. 51–76). Bloomington, IN: Solution Tree Press.

Downing, S. M. (2003). Item response theory: Applications of modern test theory in medical education. Medical Education, 37(8), 739–745. https://doi.org/10.1046/j.1365-2923.2003.01587.x

Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists: Multivariate applications book series. London: Lawrence Erlbaum Associates.

Essen, C. B., Idaka, I. E., & Metibemu, M. A. (2017). Item level diagnostics and model - data fit in item response theory (IRT) using BILOG - MG v3.0 and IRTPRO v3.0 programmes. Global Journal of Educational Research, 16(2), 87–94. https://doi.org/10.4314/gjedr.v16i2.2

Finch, W. H., & French, B. F. (2015). Latent variable modeling with R. New York, NY: Taylor & Francis.

Gregory, R. J. (2015). Psychological testing: History, principles, and applications (7th ed.). New York, NY: Pearson Education.

Gruijter, D. N. M., & van der Kamp, L. J. T. (2008). Statistical test theory for the behavioral sciences. New York, NY: Taylor & Francis Group.

Hailaya, W., Alagumalai, S., & Ben, F. (2014). Examining the utility of Assessment Literacy Inventory and its portability to education systems in the Asia Pacific region. Australian Journal of Education, 58(3), 297–317. https://doi.org/10.1177/0004944114542984

Hambleton, R K, & Swaminathan, H. (1985). Item response theory: Principles and applications. Boston, MA: Kluwer-Nijhoff.

Hambleton, Ronald K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of item response theory. Newbury Park, CA: Sage Publications.

Hambleton, Ronald K, & Swaminathan, H. (1985). Item response theory: Principles and applications. Boston, MA: Kluwer Nijhoff.

Harrison, P. M. C., Collins, T., & Müllensiefen, D. (2017). Applying modern psychometric techniques to melodic discrimination testing: Item response theory, computerised adaptive testing, and automatic item generation. Scientific Reports, 7(1), 1–19. https://doi.org/10.1038/s41598-017-03586-z

Iskandar, A., & Rizal, M. (2018). Analisis kualitas soal di perguruan tinggi berbasis aplikasi TAP. Jurnal Penelitian Dan Evaluasi Pendidikan, 22(1), 12–23. https://doi.org/10.21831/pep.v22i1.15609

Jambulingam, T., Schellhorn, C., & Sharma, R. (2016). Using a Rasch model to rank big pharmaceutical firms by financial performance. Journal of Commercial Biotechnology, 22(1), 49–60. https://doi.org/10.5912/jcb734

Lord, F. M., & Novick, M. R. (2008). Statistical theories of mental test scores. (F. Mosteller, Ed.). Reading, MA: Addison-Wesley.

Mallinson. (2007). Rehabilitation institute of Chicago in rehabilitation research provides new insights. Atlanta, pp. 1–3.

Mardapi, D. (2017). Pengukuran, penilaian, dan evaluasi pendidikan (2nd ed.). Yogyakarta: Parama Publishing.

Ostini, R., & Nering, M. L. (2006). Polytomous item response theory models. Thousand Oaks, CA: SAGE Publications.

Purnama, D. N. (2017). Characteristics and equation of accounting vocational theory trial test items for vocational high schools by subject-matter teachers’ forum. REiD (Research and Evaluation in Education), 3(2), 152–162. https://doi.org/10.21831/reid.v3i2.18121

Reckase, M. D. (2009). Multidimensional item response theory (Statistics for social and behavioral sciences). New York, NY: Springer.

Setiawati, F. A., Izzaty, R. E., & Hidayat, V. (2018a). Analisis respons butir pada tes bakat skolastik. Jurnal Psikologi, 17(1), 1–17. https://doi.org/10.14710/jp.17.1.1-17

Setiawati, F. A., Izzaty, R. E., & Hidayat, V. (2018b). Items parameters of the space-relations subtest using item response theory. Data in Brief, 19, 1785–1793. https://doi.org/10.1016/j.dib.2018.06.061

Sumintono, B., & Widhiarso, W. (2015). Aplikasi pemodelan Rasch pada asesmen pendidikan. Bandung: Trim Komunikata. Retrieved from https://umexpert.um.edu.my/file/publication/00013268_127390.pdf

Trilling, B., & Fadel, C. (2009). 21st century skills: Learning for life in our times. San Francisco, CA: Jossey-Bass.

van der Linden, W. J., & Hambleton, R. K. (1996). Handbook of modern item response theory. New York, NY: Springer Science+Business Media. https://doi.org/10.1007/978-1-4757-2691-6 I

Young, D. J., Levy, F., Martin, N. C., & Hay, D. A. (2009). Attention deficit hyperactivity disorder: A Rasch analysis of the SWAN rating scale. Child Psychiatry and Human Development, 40(4), 543–559. https://doi.org/10.1007/s10578-009-0143-z

Zubaidah, S. (2017). Keterampilan abad ke-21: Keterampilan yang diajarkan melalui pembelajaran. In Isu-Isu Strategis Pembelajaran MIPA Abad 21. Sintang, West Kalimantan: Program Studi Pendidikan Biologi STKIP Persada Khatulistiwa Sintang. Retrieved from https://www.researchgate.net/publication/318013627_keterampilan_abad_ke-21_keterampilan_yang_diajarkan_melalui_pembelajaran

DOI: https://doi.org/10.21831/reid.v5i1.23773