The use of intellectual standards to assess the quality of students’ argumentative writings

Zain Syaifudin Nakrowi; Dadang S. Ansori; Yeti Mulyati; Yuliana Setyaningsih

doi:10.21831/ltr.v22i2.60465

The use of intellectual standards to assess the quality of students’ argumentative writings

Zain Syaifudin Nakrowi, Universitas Pendidikan Indonesia, Indonesia
Dadang S. Ansori, Universitas Pendidikan Indonesia, Indonesia
Yeti Mulyati, Universitas Pendidikan Indonesia, Indonesia
Yuliana Setyaningsih, Universitas Sanata Dharma, Indonesia

10.21831/ltr.v22i2.60465

Abstract

To comprehensively examine the quality of argumentative writing, it is important to integrate the aspects of structure and substance. This study seeks to foreground the application of Intellectual Standards (IS) as a core component of the argumentative writing process. The research aims to determine the quality of argumentation in terms of structure using the TAP Toulmin concept and substance using IS. The research participants were 80 high school students in Central Java, Indonesia. A mixed method approach with an exploratory sequential QUAL-quan design is adopted. The results show that the quality of the arguments in terms of structure and substance is in the low category. Structurally, 97.5% of students' written arguments ranged from 1.1 to 2.0 on a scale of 0.0-5.0. In substance, 81.25% of students' argumentation ability scores are in the range of 04.9 - 09.6 on a scale of 0.00-24.00. In addition, the findings show that the completeness of the structure influences the substance score. Furthermore, the results of this study can be used as a reference for teachers in teaching argument texts. Elements of warrant, backing, modal qualifier, and rebuttal must be emphasized in preparing argumentative texts.

Keywords: Argumentative Texts, Structure and Substance of Arguments, Toulmin, Intellectual Standards

Keywords

Argumentative Texts, Structure and Substance of Arguments, Toulmin Models, Intellectual Standards

Full Text:

PDF

References

Allagui, B. (2018). Investigating the quality of argument structure in first-year university writing. In English Language Teaching Research in the Middle East and North Africa: Multiple Perspectives. https://doi.org/10.1007/978-3-319-98533-6_9

Altintaş, İ. N., & Schoville, M. Ç. (2021). Proposal to Structure Social Studies Course According to Toulmin’s Argumentation Model. Journal of Education and Learning. https://doi.org/10.5539/jel.v10n4p118

Amielia, S. D., Suciati, S., & Maridi, M. (2018). Enhancing Students’ Argumentation Skill Using an Argument Driven Inquiry-Based Module. Journal of Education and Learning (EduLearn). https://doi.org/10.11591/edulearn.v12i3.8042

Atkinson, D. (1997). A Critical Approach to Critical Thinking in TESOL. TESOL Quarterly. https://doi.org/10.2307/3587975

Brem, S. (2000). Explanation and evidence in informal argument. Cognitive Science. https://doi.org/10.1016/s0364-0213(00)00033-1

Creswell, J. (2013). Qualitative, quantitative, and mixed methods approaches. In Research design.

Deane, P., & Song, Y. (2014). A case study in principled assessment design: Designing assessments to measure and support the development of argumentative reading and writing skills. Psicologia Educativa. https://doi.org/10.1016/j.pse.2014.10.001

Denzin, N. K., & Lincoln, Y. (2011). Disciplining the Practice of Qualitative Research. In The SAGE Handbook of Qualitative Research.

Franqueira, V. N. L., & Horsman, G. (2020). Towards Sound Forensic Arguments: Structured Argumentation Applied to Digital Forensics Practice. Forensic Science International: Digital Investigation. https://doi.org/10.1016/j.fsidi.2020.300923

Graff, G., Birkenstein, C., & Durst, R. (2017). “They Say / I Say”: The Moves That Matter in Academic Writing, with 2016 MLA Update. In The moves that matter in.

Hidri, S. (2018). Assessing spoken language ability: A many-facet Rasch analysis. In Second Language Learning and Teaching. https://doi.org/10.1007/978-3-319-62884-4_2

Hillocks, G. (2002). The testing trap: how state writing assessments control learning. Teachers College Press. https://doi.org/10.5860/choice.40-2300

Katchevich, D., Hofstein, A., & Mamlok-Naaman, R. (2011). Argumentation in the Chemistry Laboratory: Inquiry and Confirmatory Experiments. Research in Science Education, 43(1), 317–345. https://doi.org/10.1007/s11165-011-9267-9

Kemendikbud, Solihin, L., Utama, B., Pratiwi, I., Novirina, Widjaja, I., Hijriani, I., Raziqiin, K., & Zaenuri, M. (2019). Indeks Aktivitas Literasi Membaca 34. In Mobile Devices: Tools and Technologies.

Knudson, R. E. (1992). Analysis of Argumentative Writing at Two Grade Levels. Journal of Educational Research. https://doi.org/10.1080/00220671.1992.9944434

Liu, F., & Stapleton, P. (2014). Counterargumentation and the cultivation of critical thinking in argumentative writing: Investigating washback from a high-stakes test. System. https://doi.org/10.1016/j.system.2014.05.005

Liu, F., & Stapleton, P. (2020). Counterargumentation at the primary level: An intervention study investigating the argumentative writing of second language learners. System. https://doi.org/10.1016/j.system.2019.102198

Luo, X., Wei, B., Shi, M., & Xiao, X. (2020). Exploring the impact of the reasoning flow scaffold (RFS) on students’ scientific argumentation: Based on the structure of observed learning outcomes (SOLO) taxonomy. Chemistry Education Research and Practice. https://doi.org/10.1039/c9rp00269c

Marni, S., Suyono, Roekhan, & Harsiati, T. (2019). Critical thinking patterns of first-year students in argumentative essay. Journal for the Education of Gifted Young Scientists. https://doi.org/10.17478/jegys.605324

McCann, T. M. (1989). Student Argumentative Writing Knowledge and Ability at Three Grade Levels. Research in the Teaching of English.

Miles, M. A. (1994). Miles and Huberman (1994)- Chapter 4.pdf. In Qualitative Data Analysis: An Expanded Sourcebook.

Mozaffari, Z., Abdollahi, M. H., Farzad, V., & ... (2021). The effectiveness of critical thinking training based on the Paul-Elder model on students’ critical thinking skills. Educational …, 18, 20–29. https://doi.org/10.22111/JEPS.2021.6536

Nakrowi, Z. S., & Mulyati, Y. (2021). Evaluasi Kualitas Argumen pada Artikel Jurnal. LITERA. https://doi.org/10.21831/ltr.v20i1.34287

Paul, R., & Elder, L. (2014). Critical Thinking Tools for Taking Charge of Your Professional and Personal Life (Second Edition).

Paul, R., & Elder, L. & F. for C. T. (2012). The miniature guide to critical thinking: Concepts and tools. 27th International Conference on Critical Thinking.

Ramage, J. D., Bean, J. C., & Johnson, J. (2019). Writing Arguments: A Rhetoric with readings. In Pearson.

Rybacki, K. C., & Rybacki, D. J. (2014). Advocacy and Opposition: An Introduction to Argumentation. In British Library Cataloguing-in-Publication Data. Pearson Education Limited.

Sampson, V., & Clark, D. B. (2008). Assessment of the ways students generate arguments in science education: Current perspectives and recommendations for future directions. Science Education. https://doi.org/10.1002/sce.20276

Setyaningsih, Y, & Rahardi, R. (2019). Argumentative Essay in the Perspective of Toulmin’s Model: Needs of Evoluting Indonesian Society from Spoken Culture to Written Culture. https://doi.org/10.4108/eai.21-12-2018.2282774

Setyaningsih, Yuliana, Rahardi, R. K., & Tiawati, R. L. (2023). Modal Qualifiers as Booster in Argumentative Writing of the Thesis Discussion Section. 1(1), 75–93. https://doi.org/10.22202/jg.v9i1.6316

Shao, X., & Purpur, G. (2016). Effects of Information Literacy Skills on Student Writing and Course Performance. Journal of Academic Librarianship. https://doi.org/10.1016/j.acalib.2016.08.006

Shinta, D. K., & Filia, F. (2020). Improving students’ arguments through collaborative learning. Indonesian Journal of Applied Linguistics. https://doi.org/10.17509/ijal.v10i2.28602

Shurter, R. L., & Pierce, J. R. (1966). Critical thinking: Its Expression in Argument. New York: McGraw-Hill.

Smolkowski, K., Strycker, L. A., Anderson, L., Marconi, P., & Abia-Smith, L. (2020). The Visual Thinking Strategies Approach to Teaching Argument Writing. The Elementary School Journal. https://doi.org/10.1086/709984

Solopos. (2021). Indeks Baca Jateng Rendah? Arpusda Solo : Minat Baca Di Solo Masih Tinggi! https://www.soloposfm.com/indeks-baca-jateng-rendah-arpusda-solo-minat-baca-di-solo-masih-tinggi/19533/

Stapleton, P., & Wu, Y. (Amy). (2015). Assessing the quality of arguments in students’ persuasive writing: A case study analyzing the relationship between surface structure and substance. Journal of English for Academic Purposes. https://doi.org/10.1016/j.jeap.2014.11.006

Stavans, A., Seroussi, B., & Zadunaisky Ehrlich, S. (2019). Literacy-Related Abilities’ Effects on Argumentative Text Quality Structure. Journal of Literacy Research. https://doi.org/10.1177/1086296X19859515

Suseno, M. (1984). Etika Jawa Sebuah Analisa Falsafi tentang Kebijaksanaan Hidup Orang Jawa. In PT Gramedia Pustaka Utama.

Syerliana, L., Muslim, & Setiawan, W. (2018). Argumentation skill profile using “toulmin Argumentation Pattern” analysis of high school student at Subang on topic hydrostatic pressure. Journal of Physics: Conference Series. https://doi.org/10.1088/1742-6596/1013/1/012031

Tarvin, W. L., & Al-Arishi, A. Y. (1991). Rethinking Communicative Language Teaching: Reflection and the EFL Classroom. TESOL Quarterly. https://doi.org/10.2307/3587026

Toulmin, S. E. (2003). The uses of argument: Updated edition. In The Uses of Argument: Updated Edition. https://doi.org/10.1017/CBO9780511840005

Utomo, Y. S., Ashadi, & Sarwanto. (2019). Argumentation Skills Profile on 8th Grade Students using Toulmin’s Argument Pattern on Controversial Topic. Journal of Physics: Conference Series. https://doi.org/10.1088/1742-6596/1233/1/012095

Widyastuti, S. (2018). Fostering critical thinking skills through argumentative writing. Cakrawala Pendidikan. https://doi.org/10.21831/cp.v37i2.20157

Wingate, U. (2012). “Argument!” helping students understand what essay writing is about. Journal of English for Academic Purposes. https://doi.org/10.1016/j.jeap.2011.11.001

Wolfe, C. R., Britt, M. A., & Butler, J. A. (2009). Argumentation schema and the myside bias in written argumentation. Written Communication. https://doi.org/10.1177/0741088309333019

Zhang, L., Spoelstra, H., & Kalz, M. (2021). Annotation of a Dutch Essay Corpus with Argument Structures and Quality Indicators. Computational Linguistics in the Netherlands Journal, 11, 257–279.

DOI: https://doi.org/10.21831/ltr.v22i2.60465