The use of intellectual standards to assess the quality of students’ argumentative writings

Zain Syaifudin Nakrowi, Universitas Pendidikan Indonesia, Indonesia
Dadang S. Ansori, Universitas Pendidikan Indonesia, Indonesia
Yeti Mulyati, Universitas Pendidikan Indonesia, Indonesia
Yuliana Setyaningsih, Universitas Sanata Dharma, Indonesia


To comprehensively examine the quality of argumentative writing, it is important to integrate the aspects of structure and substance. This study seeks to foreground the application of Intellectual Standards (IS) as a core component of the argumentative writing process. The research aims to determine the quality of argumentation in terms of structure using the TAP Toulmin concept and substance using IS. The research participants were 80 high school students in Central Java, Indonesia. A mixed method approach with an exploratory sequential QUAL-quan design is adopted. The results show that the quality of the arguments in terms of structure and substance is in the low category. Structurally, 97.5% of students' written arguments ranged from 1.1 to 2.0 on a scale of 0.0-5.0. In substance, 81.25% of students' argumentation ability scores are in the range of 04.9 - 09.6 on a scale of 0.00-24.00. In addition, the findings show that the completeness of the structure influences the substance score. Furthermore, the results of this study can be used as a reference for teachers in teaching argument texts. Elements of warrant, backing, modal qualifier, and rebuttal must be emphasized in preparing argumentative texts.

Keywords: Argumentative Texts, Structure and Substance of Arguments, Toulmin, Intellectual Standards


Argumentative Texts, Structure and Substance of Arguments, Toulmin Models, Intellectual Standards

Full Text:



Allagui, B. (2018). Investigating the quality of argument structure in first-year university writing. In English Language Teaching Research in the Middle East and North Africa: Multiple Perspectives.

Altintaş, İ. N., & Schoville, M. Ç. (2021). Proposal to Structure Social Studies Course According to Toulmin’s Argumentation Model. Journal of Education and Learning.

Amielia, S. D., Suciati, S., & Maridi, M. (2018). Enhancing Students’ Argumentation Skill Using an Argument Driven Inquiry-Based Module. Journal of Education and Learning (EduLearn).

Atkinson, D. (1997). A Critical Approach to Critical Thinking in TESOL. TESOL Quarterly.

Brem, S. (2000). Explanation and evidence in informal argument. Cognitive Science.

Creswell, J. (2013). Qualitative, quantitative, and mixed methods approaches. In Research design.

Deane, P., & Song, Y. (2014). A case study in principled assessment design: Designing assessments to measure and support the development of argumentative reading and writing skills. Psicologia Educativa.

Denzin, N. K., & Lincoln, Y. (2011). Disciplining the Practice of Qualitative Research. In The SAGE Handbook of Qualitative Research.

Franqueira, V. N. L., & Horsman, G. (2020). Towards Sound Forensic Arguments: Structured Argumentation Applied to Digital Forensics Practice. Forensic Science International: Digital Investigation.

Graff, G., Birkenstein, C., & Durst, R. (2017). “They Say / I Say”: The Moves That Matter in Academic Writing, with 2016 MLA Update. In The moves that matter in.

Hidri, S. (2018). Assessing spoken language ability: A many-facet Rasch analysis. In Second Language Learning and Teaching.

Hillocks, G. (2002). The testing trap: how state writing assessments control learning. Teachers College Press.

Katchevich, D., Hofstein, A., & Mamlok-Naaman, R. (2011). Argumentation in the Chemistry Laboratory: Inquiry and Confirmatory Experiments. Research in Science Education, 43(1), 317–345.

Kemendikbud, Solihin, L., Utama, B., Pratiwi, I., Novirina, Widjaja, I., Hijriani, I., Raziqiin, K., & Zaenuri, M. (2019). Indeks Aktivitas Literasi Membaca 34. In Mobile Devices: Tools and Technologies.

Knudson, R. E. (1992). Analysis of Argumentative Writing at Two Grade Levels. Journal of Educational Research.

Liu, F., & Stapleton, P. (2014). Counterargumentation and the cultivation of critical thinking in argumentative writing: Investigating washback from a high-stakes test. System.

Liu, F., & Stapleton, P. (2020). Counterargumentation at the primary level: An intervention study investigating the argumentative writing of second language learners. System.

Luo, X., Wei, B., Shi, M., & Xiao, X. (2020). Exploring the impact of the reasoning flow scaffold (RFS) on students’ scientific argumentation: Based on the structure of observed learning outcomes (SOLO) taxonomy. Chemistry Education Research and Practice.

Marni, S., Suyono, Roekhan, & Harsiati, T. (2019). Critical thinking patterns of first-year students in argumentative essay. Journal for the Education of Gifted Young Scientists.

McCann, T. M. (1989). Student Argumentative Writing Knowledge and Ability at Three Grade Levels. Research in the Teaching of English.

Miles, M. A. (1994). Miles and Huberman (1994)- Chapter 4.pdf. In Qualitative Data Analysis: An Expanded Sourcebook.

Mozaffari, Z., Abdollahi, M. H., Farzad, V., & ... (2021). The effectiveness of critical thinking training based on the Paul-Elder model on students’ critical thinking skills. Educational …, 18, 20–29.

Nakrowi, Z. S., & Mulyati, Y. (2021). Evaluasi Kualitas Argumen pada Artikel Jurnal. LITERA.

Paul, R., & Elder, L. (2014). Critical Thinking Tools for Taking Charge of Your Professional and Personal Life (Second Edition).

Paul, R., & Elder, L. & F. for C. T. (2012). The miniature guide to critical thinking: Concepts and tools. 27th International Conference on Critical Thinking.

Ramage, J. D., Bean, J. C., & Johnson, J. (2019). Writing Arguments: A Rhetoric with readings. In Pearson.

Rybacki, K. C., & Rybacki, D. J. (2014). Advocacy and Opposition: An Introduction to Argumentation. In British Library Cataloguing-in-Publication Data. Pearson Education Limited.

Sampson, V., & Clark, D. B. (2008). Assessment of the ways students generate arguments in science education: Current perspectives and recommendations for future directions. Science Education.

Setyaningsih, Y, & Rahardi, R. (2019). Argumentative Essay in the Perspective of Toulmin’s Model: Needs of Evoluting Indonesian Society from Spoken Culture to Written Culture.

Setyaningsih, Yuliana, Rahardi, R. K., & Tiawati, R. L. (2023). Modal Qualifiers as Booster in Argumentative Writing of the Thesis Discussion Section. 1(1), 75–93.

Shao, X., & Purpur, G. (2016). Effects of Information Literacy Skills on Student Writing and Course Performance. Journal of Academic Librarianship.

Shinta, D. K., & Filia, F. (2020). Improving students’ arguments through collaborative learning. Indonesian Journal of Applied Linguistics.

Shurter, R. L., & Pierce, J. R. (1966). Critical thinking: Its Expression in Argument. New York: McGraw-Hill.

Smolkowski, K., Strycker, L. A., Anderson, L., Marconi, P., & Abia-Smith, L. (2020). The Visual Thinking Strategies Approach to Teaching Argument Writing. The Elementary School Journal.

Solopos. (2021). Indeks Baca Jateng Rendah? Arpusda Solo : Minat Baca Di Solo Masih Tinggi!

Stapleton, P., & Wu, Y. (Amy). (2015). Assessing the quality of arguments in students’ persuasive writing: A case study analyzing the relationship between surface structure and substance. Journal of English for Academic Purposes.

Stavans, A., Seroussi, B., & Zadunaisky Ehrlich, S. (2019). Literacy-Related Abilities’ Effects on Argumentative Text Quality Structure. Journal of Literacy Research.

Suseno, M. (1984). Etika Jawa Sebuah Analisa Falsafi tentang Kebijaksanaan Hidup Orang Jawa. In PT Gramedia Pustaka Utama.

Syerliana, L., Muslim, & Setiawan, W. (2018). Argumentation skill profile using “toulmin Argumentation Pattern” analysis of high school student at Subang on topic hydrostatic pressure. Journal of Physics: Conference Series.

Tarvin, W. L., & Al-Arishi, A. Y. (1991). Rethinking Communicative Language Teaching: Reflection and the EFL Classroom. TESOL Quarterly.

Toulmin, S. E. (2003). The uses of argument: Updated edition. In The Uses of Argument: Updated Edition.

Utomo, Y. S., Ashadi, & Sarwanto. (2019). Argumentation Skills Profile on 8th Grade Students using Toulmin’s Argument Pattern on Controversial Topic. Journal of Physics: Conference Series.

Widyastuti, S. (2018). Fostering critical thinking skills through argumentative writing. Cakrawala Pendidikan.

Wingate, U. (2012). “Argument!” helping students understand what essay writing is about. Journal of English for Academic Purposes.

Wolfe, C. R., Britt, M. A., & Butler, J. A. (2009). Argumentation schema and the myside bias in written argumentation. Written Communication.

Zhang, L., Spoelstra, H., & Kalz, M. (2021). Annotation of a Dutch Essay Corpus with Argument Structures and Quality Indicators. Computational Linguistics in the Netherlands Journal, 11, 257–279.



  • There are currently no refbacks.








RJI Main logo



The International Journal of Linguistic, Literature, and Its Teaching at http:// is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License



Flag Counter