Students' competence in making language skill assessment rubric

Memet Sudaryanto; Habib Safillah Akbariski

doi:10.21831/reid.v7i2.44005

Students' competence in making language skill assessment rubric

Memet Sudaryanto, Universitas Jenderal Soedirman, Indonesia
Habib Safillah Akbariski, Universitas Sebelas Maret, Indonesia

10.21831/reid.v7i2.44005

Abstract

This study aims to describe (1) the need for an assessment of language skills rubrics; (2) students' abilities in creating holistic and analytic rubrics; (3) the potential and relevance of the application of the rubric in the micro-teaching class; (4) the obstacles faced by students in compiling the rubric. This research used mix method to answer the research questions and a quantitative approach to measure students' understanding of the rubric. Basic competence was assessed using the rubric and mapped students' competencies in designing the rubric. The qualitative rubric was used to describe students' difficulties in applying the rubrics produced in the learning process at school. The population of this study was 250 students of Indonesian Language Education in Central Java selected using a random sampling technique. The study shows that (1) students' knowledge of the components presented in the language skill assessment rubric is still low: most students know that the assessment rubric can be done analytically and holistically, but they cannot explain the differences and how to design the language skill assessment rubric. (2) The rubric produced by students in assessing reading and writing skills is good enough and relevant to be applied in the school: 76% for reading skills and 83% for writing skills. (3) The rubric produced in assessing speaking and writing skills is less optimal and not relevant enough: 78% of students are unable to make good rubrics for listening skills, and 49% are unable to make a rubric for speaking skills.

Keywords

assessment rubric; language skill; language education

Full Text:

PDF

References

Al-Rabai, A. (2014). Rubrics revisited. International Journal of Education and Research Rubrics, 2(5), 473–484. https://www.ijern.com/journal/May-2014/39.pdf

Al Zumor, A. (2015). Quality matters rubric potential for enhancing online foreign language education. International Education Studies, 8(4), 173–178. http://dx.doi.org/10.5539/ies.v8n4p173

Anisa, A. A. (2017). Students’ literature achievement: Predictors investigation research. REID (Research and Evaluation in Education), 3(2), 144-151. https://journal.uny.ac.id/index.php/reid/article/view/17498

Ayhan, Ü., & Türkyılmaz, M. (2015). Key of language assessment: Rubrics and rubric design. International Journal of Language and Linguistics, 2(2), 82–92. https://ijllnet.com/journals/Vol_2_No_2_June_2015/12.pdf

Barkaoui, K. (2016). What changes and what doesn’t? An examination of changes in the linguistic characteristics of IELTS repeaters’ Writing Task 2 scripts. IELTS Research Reports Online Series, 3, 1-55. https://www.ielts.org/for-researchers/research-reports/online-series-2016-3

Bukhari, S. (2016). Mind mapping techniques to enhance EFL writing skill. International Journal of Linguistics and Communication, 4(1), 58-77. https://doi.org/10.15640/ijlc.v4n1a7

Endrayanto, H., & Harumurti, Y. (2014). Aplikasi rubrik untuk penilaian belajar siswa. Kanisius.

Greenstein, L. (2012). Assessing 21st-century skills: A guide to evaluating mastery and authentic learning. Corwin. https://us.corwin.com/en-us/nam/book/assessing-21st-century-skills

Griffin, P. (1991). Literacy assessment: Merging teaching, learning, and assessment. In The Annual Meeting of the International Reading Association, Las Vegas, NV. https://eric.ed.gov/?id=ED337746

Kennedy, J. A., Anderson, C., & Moore, D. A. (2013). When overconfidence is revealed to others: Testing the status-enhancement theory of overconfidence. Organizational Behavior and Human Decision Processes, 122(2), 266-279. https://doi.org/10.1016/j.obhdp.2013.08.005

Mardapi, D., & Kartowagiran, B. (2019). Pengembangan instrumen pengukur hasil belajar nirbias dan terskala baku. Jurnal Penelitian dan Evaluasi Pendidikan, 15(2), 326-341. https://doi.org/10.21831/pep.v15i2.1100

Mertler, C. (2000). Designing scoring rubrics for your classroom. Practical Assessment, Research, and Evaluation, 7, 25. https://doi.org/10.7275/gcy8-0w24

Miles, M., & Huberman, M. (2012). Analisis data kualitatif: Buku sumber tentang metode-metode baru (T. Rohendi, trans.). Universitas Indonesia Press.

Miller, N. (2013). Measuring up to speech intelligibility. In International Journal of Language and Communication Disorders, 48(6), 601-612. https://doi.org/10.1111/1460-6984.12061

Pearce, J., Mulder, R., & Baik, C. (2009). Involving students in peer review: Case studies and practical strategies for university teaching. Centre of the Study of Higher Education, The University of Melbourne. https://melbourne-cshe.unimelb.edu.au/__data/assets/pdf_file/0006/3590943/Involving-students-in-peer-review.pdf

Ratnaningsih, E. (2016). Improving students' writing ability through the use of dictogloss technique. Transformation, 12(2), 1-14. https://jurnal.untidar.ac.id/index.php/transformatika/article/view/186

Reddy, Y., & Andrade, H. (2010). A review of rubric use in higher education. Assessment & evaluation in higher education, 35(4), 435–448. https://doi.org/10.1080/02602930902862859

Retnawati, H. (2015). The comparison of accuracy scores on the paper and pencil testing vs. computer-based testing. Turkish Online Journal of Educational Technology, 14(4), 135–142. http://www.tojet.net/articles/v14i4/14413.pdf

Rimmer, W. (2006). Measuring grammatical complexity: The Gordian knot. Language Testing, 23(4), 497–519. https://doi.org/10.1191/0265532206lt339oa

Rukmini, D., & Saputri, L. (2017). The authentic assessment to measure students' English productive skills based on 2013 Curriculum. Indonesian Journal of Applied Linguistics, 7(2), 263–273. https://doi.org/10.17509/ijal.v7i2.8128

Stevens, D., & Levi, A. (2013). Introduction to rubrics: An assessment tool to save grading time, convey effective feedback, and promote student learning. Stylus Publishing, LLC.

Sudaryanto, M., Mardapi, D., & Hadi, S. (2019a). Multimedia-based online test on Indonesian language receptive skills development. Journal of Physics: Conference Series, 1339(1). https://doi.org/10.1088/1742-6596/1339/1/012120

Sudaryanto, M., Mardapi, D., & Hadi, S. (2019b). How foreign speakers implement their strategies to listen indonesian language? Journal of Advanced Research in Dynamical and Control Systems, 11(7), 355–361. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3567681

Sudaryanto, M., Ulya, C., Rohmadi, M., & Kuhafeesah, K. (2020). Inter-rater assessment on listening media for foreign language speakers. In Proceedings of the 2nd Konferensi BIPA Tahunan by Postgraduate Program of Javanese Literature and Language Education in Collaboration with Association of Indonesian Language and Literature Lecturers, KEBIPAAN, Surakarta, Central Java, Indonesia. https://doi.org/10.4108/eai.9-11-2019.2295064

Suwandi, S., & Sudaryanto, M. (2021). Benefits and challenges of learning Indonesian language with an environmental system: An action research at high school in Surakarta. Psychology and Education Journal, 58(2), 4403–4413. http://psychologyandeducation.net/pae/index.php/pae/article/view/2829

Suwandi, S., Sudaryanto, M., Wardani, N., Zulianto, S., Ulya, C., & Setiyoningsih, T. (2021). Higher order thinking skills in Indonesian language national exam in junior high school. Jurnal Kependidikan: Penelitian Inovasi Pembelajaran, 5(1), 31-44. https://doi.org/10.21831/jk.v5i1.35457

Widiastuti, I. (2021). Assessment and feedback practices in the EFL classroom. REID (Research and Evaluation in Education), 7(1), 13-22. https://doi.org/10.21831/reid.v7i1.37741

Zubairu, U. M., Dauda, C. K., Sakariyau, O. B., & Paiko, I. I. (2016). Academic performance and moral competence: A match made in heaven? REID (Research and Evaluation in Education), 2(2), 206-219. https://journal.uny.ac.id/index.php/reid/article/view/8956

DOI: https://doi.org/10.21831/reid.v7i2.44005