The use of intellectual standards to assess the quality of students' argumentative writings
Downloads
To comprehensively examine the quality of argumentative writing, it is important to integrate the aspects of structure and substance. This study seeks to foreground the application of Intellectual Standards (IS) as a core component of the argumentative writing process. The research aims to determine the quality of argumentation in terms of structure using the TAP Toulmin concept and substance using IS. The research participants were 80 high school students in Central Java, Indonesia. A mixed method approach with an exploratory sequential QUAL-quan design is adopted. The results show that the quality of the arguments in terms of structure and substance is in the low category. Structurally, 97.5% of students' written arguments ranged from 1.1 to 2.0 on a scale of 0.0-5.0. In substance, 81.25% of students' argumentation ability scores are in the range of 04.9 - 09.6 on a scale of 0.00-24.00. In addition, the findings show that the completeness of the structure influences the substance score. Furthermore, the results of this study can be used as a reference for teachers in teaching argument texts. Elements of warrant, backing, modal qualifier, and rebuttal must be emphasized in preparing argumentative texts.
Keywords: Argumentative Texts, Structure and Substance of Arguments, Toulmin, Intellectual Standards
Allagui, B. (2018). Investigating the quality of argument structure in first-year university writing. In English Language Teaching Research in the Middle East and North Africa: Multiple Perspectives. https://doi.org/10.1007/978-3-319-98533-6_9
AltintaÅŸ, Ä°. N., & Schoville, M. í‡. (2021). Proposal to Structure Social Studies Course According to Toulmin's Argumentation Model. Journal of Education and Learning. https://doi.org/10.5539/jel.v10n4p118
Amielia, S. D., Suciati, S., & Maridi, M. (2018). Enhancing Students' Argumentation Skill Using an Argument Driven Inquiry-Based Module. Journal of Education and Learning (EduLearn). https://doi.org/10.11591/edulearn.v12i3.8042
Atkinson, D. (1997). A Critical Approach to Critical Thinking in TESOL. TESOL Quarterly. https://doi.org/10.2307/3587975
Brem, S. (2000). Explanation and evidence in informal argument. Cognitive Science. https://doi.org/10.1016/s0364-0213(00)00033-1
Creswell, J. (2013). Qualitative, quantitative, and mixed methods approaches. In Research design.
Deane, P., & Song, Y. (2014). A case study in principled assessment design: Designing assessments to measure and support the development of argumentative reading and writing skills. Psicologia Educativa. https://doi.org/10.1016/j.pse.2014.10.001
Denzin, N. K., & Lincoln, Y. (2011). Disciplining the Practice of Qualitative Research. In The SAGE Handbook of Qualitative Research.
Franqueira, V. N. L., & Horsman, G. (2020). Towards Sound Forensic Arguments: Structured Argumentation Applied to Digital Forensics Practice. Forensic Science International: Digital Investigation. https://doi.org/10.1016/j.fsidi.2020.300923
Graff, G., Birkenstein, C., & Durst, R. (2017). "They Say / I Say": The Moves That Matter in Academic Writing, with 2016 MLA Update. In The moves that matter in.
Hidri, S. (2018). Assessing spoken language ability: A many-facet Rasch analysis. In Second Language Learning and Teaching. https://doi.org/10.1007/978-3-319-62884-4_2
Hillocks, G. (2002). The testing trap: how state writing assessments control learning. Teachers College Press. https://doi.org/10.5860/choice.40-2300
Katchevich, D., Hofstein, A., & Mamlok-Naaman, R. (2011). Argumentation in the Chemistry Laboratory: Inquiry and Confirmatory Experiments. Research in Science Education, 43(1), 317–345. https://doi.org/10.1007/s11165-011-9267-9
Kemendikbud, Solihin, L., Utama, B., Pratiwi, I., Novirina, Widjaja, I., Hijriani, I., Raziqiin, K., & Zaenuri, M. (2019). Indeks Aktivitas Literasi Membaca 34. In Mobile Devices: Tools and Technologies.
Knudson, R. E. (1992). Analysis of Argumentative Writing at Two Grade Levels. Journal of Educational Research. https://doi.org/10.1080/00220671.1992.9944434
Liu, F., & Stapleton, P. (2014). Counterargumentation and the cultivation of critical thinking in argumentative writing: Investigating washback from a high-stakes test. System. https://doi.org/10.1016/j.system.2014.05.005
Liu, F., & Stapleton, P. (2020). Counterargumentation at the primary level: An intervention study investigating the argumentative writing of second language learners. System. https://doi.org/10.1016/j.system.2019.102198
Luo, X., Wei, B., Shi, M., & Xiao, X. (2020). Exploring the impact of the reasoning flow scaffold (RFS) on students' scientific argumentation: Based on the structure of observed learning outcomes (SOLO) taxonomy. Chemistry Education Research and Practice. https://doi.org/10.1039/c9rp00269c
Marni, S., Suyono, Roekhan, & Harsiati, T. (2019). Critical thinking patterns of first-year students in argumentative essay. Journal for the Education of Gifted Young Scientists. https://doi.org/10.17478/jegys.605324
McCann, T. M. (1989). Student Argumentative Writing Knowledge and Ability at Three Grade Levels. Research in the Teaching of English.
Miles, M. A. (1994). Miles and Huberman (1994)- Chapter 4.pdf. In Qualitative Data Analysis: An Expanded Sourcebook.
Mozaffari, Z., Abdollahi, M. H., Farzad, V., & ... (2021). The effectiveness of critical thinking training based on the Paul-Elder model on students' critical thinking skills. Educational ..., 18, 20–29. https://doi.org/10.22111/JEPS.2021.6536
Nakrowi, Z. S., & Mulyati, Y. (2021). Evaluasi Kualitas Argumen pada Artikel Jurnal. LITERA. https://doi.org/10.21831/ltr.v20i1.34287
Paul, R., & Elder, L. (2014). Critical Thinking Tools for Taking Charge of Your Professional and Personal Life (Second Edition).
Paul, R., & Elder, L. & F. for C. T. (2012). The miniature guide to critical thinking: Concepts and tools. 27th International Conference on Critical Thinking.
Ramage, J. D., Bean, J. C., & Johnson, J. (2019). Writing Arguments: A Rhetoric with readings. In Pearson.
Rybacki, K. C., & Rybacki, D. J. (2014). Advocacy and Opposition: An Introduction to Argumentation. In British Library Cataloguing-in-Publication Data. Pearson Education Limited.
Sampson, V., & Clark, D. B. (2008). Assessment of the ways students generate arguments in science education: Current perspectives and recommendations for future directions. Science Education. https://doi.org/10.1002/sce.20276
Setyaningsih, Y, & Rahardi, R. (2019). Argumentative Essay in the Perspective of Toulmin's Model: Needs of Evoluting Indonesian Society from Spoken Culture to Written Culture. https://doi.org/10.4108/eai.21-12-2018.2282774
Setyaningsih, Yuliana, Rahardi, R. K., & Tiawati, R. L. (2023). Modal Qualifiers as Booster in Argumentative Writing of the Thesis Discussion Section. 1(1), 75–93. https://doi.org/10.22202/jg.v9i1.6316
Shao, X., & Purpur, G. (2016). Effects of Information Literacy Skills on Student Writing and Course Performance. Journal of Academic Librarianship. https://doi.org/10.1016/j.acalib.2016.08.006
Shinta, D. K., & Filia, F. (2020). Improving students' arguments through collaborative learning. Indonesian Journal of Applied Linguistics. https://doi.org/10.17509/ijal.v10i2.28602
Shurter, R. L., & Pierce, J. R. (1966). Critical thinking: Its Expression in Argument. New York: McGraw-Hill.
Smolkowski, K., Strycker, L. A., Anderson, L., Marconi, P., & Abia-Smith, L. (2020). The Visual Thinking Strategies Approach to Teaching Argument Writing. The Elementary School Journal. https://doi.org/10.1086/709984
Solopos. (2021). Indeks Baca Jateng Rendah? Arpusda Solo : Minat Baca Di Solo Masih Tinggi! https://www.soloposfm.com/indeks-baca-jateng-rendah-arpusda-solo-minat-baca-di-solo-masih-tinggi/19533/
Stapleton, P., & Wu, Y. (Amy). (2015). Assessing the quality of arguments in students' persuasive writing: A case study analyzing the relationship between surface structure and substance. Journal of English for Academic Purposes. https://doi.org/10.1016/j.jeap.2014.11.006
Stavans, A., Seroussi, B., & Zadunaisky Ehrlich, S. (2019). Literacy-Related Abilities' Effects on Argumentative Text Quality Structure. Journal of Literacy Research. https://doi.org/10.1177/1086296X19859515
Suseno, M. (1984). Etika Jawa Sebuah Analisa Falsafi tentang Kebijaksanaan Hidup Orang Jawa. In PT Gramedia Pustaka Utama.
Syerliana, L., Muslim, & Setiawan, W. (2018). Argumentation skill profile using "toulmin Argumentation Pattern" analysis of high school student at Subang on topic hydrostatic pressure. Journal of Physics: Conference Series. https://doi.org/10.1088/1742-6596/1013/1/012031
Tarvin, W. L., & Al-Arishi, A. Y. (1991). Rethinking Communicative Language Teaching: Reflection and the EFL Classroom. TESOL Quarterly. https://doi.org/10.2307/3587026
Toulmin, S. E. (2003). The uses of argument: Updated edition. In The Uses of Argument: Updated Edition. https://doi.org/10.1017/CBO9780511840005
Utomo, Y. S., Ashadi, & Sarwanto. (2019). Argumentation Skills Profile on 8th Grade Students using Toulmin's Argument Pattern on Controversial Topic. Journal of Physics: Conference Series. https://doi.org/10.1088/1742-6596/1233/1/012095
Widyastuti, S. (2018). Fostering critical thinking skills through argumentative writing. Cakrawala Pendidikan. https://doi.org/10.21831/cp.v37i2.20157
Wingate, U. (2012). "Argument!" helping students understand what essay writing is about. Journal of English for Academic Purposes. https://doi.org/10.1016/j.jeap.2011.11.001
Wolfe, C. R., Britt, M. A., & Butler, J. A. (2009). Argumentation schema and the myside bias in written argumentation. Written Communication. https://doi.org/10.1177/0741088309333019
Zhang, L., Spoelstra, H., & Kalz, M. (2021). Annotation of a Dutch Essay Corpus with Argument Structures and Quality Indicators. Computational Linguistics in the Netherlands Journal, 11, 257–279.
