Exploring the perceptions of literacy in assessment for learning among high school English teachers

Sukarno Sukarno; Nur Hidayanto Pancoro Setyo Putro; Ihtiara Fitrianingsih; Yasir Ayed Alsamiri; Fadhl Mohammed Awadh Gharamah; Ingrid A. Gavilan Tatin

doi:10.21831/reid.v10i2.71324

Exploring the perceptions of literacy in assessment for learning among high school English teachers

Sukarno Sukarno, Universitas Negeri Yogyakarta, Indonesia
Nur Hidayanto Pancoro Setyo Putro, Universitas Negeri Yogyakarta, Indonesia
Ihtiara Fitrianingsih, Universitas Negeri Yogyakarta, Indonesia
Yasir Ayed Alsamiri, Islamic University of Madinah, Saudi Arabia
Fadhl Mohammed Awadh Gharamah, English language Department, Yofea University College, Lahej University, Yemen
Ingrid A. Gavilan Tatin, Universidad Católica de Temuco, Chile

10.21831/reid.v10i2.71324

Abstract

In the field of English language education, the crucial role of assessment for learning (AfL) requires teachers to possess robust assessment literacy. This study explores AfL literacy among high school English teachers in Yogyakarta, Indonesia by utilizing Alonzo's validated AfL survey that establishes a comprehensive six-factor model, delineating teachers as assessors, pedagogists, student partners, motivators, learners, and stakeholder partners. Exploiting confirmatory factor analysis and examining demographic variations, this quantitative research invited 202 English teachers in the Special Region of Yogyakarta, Indonesia selected purposively based on the geographical service area. Data were collected through an online questionnaire adopting Alonzo's 42-questions AfL and were analyzed quantitatively via Confirmatory Factor Analysis (CFA) with four indices, namely comparative fit index (CFI), Tucker-Lewis index (TLI), root mean square error of approximation (RMSEA), and standard root mean square residual (SRMR).The findings substantiate the efficacy of the six-factor AfL model, underscoring educators' roles extending beyond traditional frameworks. The investigation also introduces a tool featuring detailed performance descriptors, addressing deficiencies, and harmonizing with AfL principles. It deduces that heightened foundational comprehension among English educators cultivates enhancements in AfL literacy and propels the refinement of professional evaluative competencies, thereby enriching the nuanced discourse surrounding AfL within language pedagogy. While the study's scope is confined to a specific geographical area and a limited cohort of participating instructors, it significantly enriches our comprehension of AfL literacy among English pedagogies. This research, therefore, provides a foundation for professional growth initiatives and facilitates enhancements in pedagogical approaches and academic achievement.

Keywords

assessment for learning; English language teacher; literacy

Full Text:

PDF

References

Alonzo, D. (2016). Development and application of a teacher assessment for learning (AfL) literacy tool. Doctoral dissertation, University of New South Wales. https://doi.org/10.26190/unsworks/18809

Andrade, H. L., & Brookhart, S. M. (2016). The role of classroom assessment in supporting self-regulated learning. In D. Laveault & L. Allal (Eds.), Assessment for learning: Meeting the challenge of implementation. The enabling power of assessment, vol 4. Springer, https://doi.org/10.1007/978-3-319-39211-0_17

Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness-of-fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588-606. https://psycnet.apa.org/doi/10.1037/0033-2909.88.3.588

Birenbaum, M., & Rosenau, S. (2006). Assessment preferences, learning orientations, and learning strategies of pre‐service and in‐service teachers. Journal of Education for Teaching: International Research and Pedagogy, 32(2), 213-225. https://doi.org/10.1080/02607470600655300

Black, P., McCormick, R., James, M., & Pedder, D. (2006). Learning how to learn and assessment for learning: A theoretical inquiry. Research Papers in Education, 21(2), 119–132. https://doi.org/10.1080/02671520600615612

Black, P., & Wiliam, D. (2009). Developing the theory of formative assessment. Educational Assessment, Evaluation and Accountability, 21(1), 5-31. https://doi.org/10.1007/s11092-008-9068-5

Brookhart, S. M., & Chen, F. (2020). Formative assessment revisited. In Handbook of educational assessment and evaluation (pp. 123-136). Springer.

Brown, D. J., & Bailey, K. M. (2008). Language testing courses: What are they in 2007? Language Testing, 25(3). https://doi.org/10.1177/0265532208090157

Byrne, B. M. (2010). Structural equation modeling with Amos: Basic concepts, applications, and programming (2nd ed.). Taylor and Francis Group.

Chappuis, S., & Stiggins, R. J. (2002). Classroom assessment for learning. Educational Leadership, 60(1), 40–44.

Cowie, B. (2005). Student commentary on classroom assessment in science: A sociocultural interpretation. International Journal of Science Education, 27(2), 199–214. https://doi.org/10.1080/0950069042000276721

Davison, C., & Michell, M. (2014). EAL assessment: What do Australian teachers want? TESOL in Context, 24(2), 51–72. https://search.informit.org/doi/pdf/10.3316/ielapa.949508765515560

Earl, L. M. (2013). Assessment as learning: Using classroom assessment to maximize student learning (2nd ed.). Corwin, A Sage Company. https://us.sagepub.com/en-us/nam/book/assessment-learning-1

Ferguson, R. F., & Brown, J. (2000). Certification test scores, teacher quality, and student achievement. In D. W. Grissmer & J. M. Ross (Eds.), Analytic issues in the assessment of student achievement, 133–156. https://nces.ed.gov/pubs2000/2000050a.pdf

Fulcher, G. (2012). Assessment literacy for the language classroom. Language Assessment Quarterly, 9(2), 113–132. https://doi.org/10.1080/15434303.2011.642041

Gallik, J. D. (1999). Do they read for pleasure? Recreational reading habits of college students. Journal of Adolescent & Adult Literacy, 42(6), 480–488.

Gilbert, J., & Fister, B. (2011). Reading, risk, and reality: College students and reading for pleasure. College and Research Libraries, 72(5), 474–495. https://doi.org/10.5860/crl-148

Gob, C. C. M. (2007). Teaching speaking in the language classroom. SEAMEO Regional Language Centre, 1–23.

Hattie, J., & Timperley, H. (2018). The power of feedback. Review of Educational Research, 77(1), 81-112. https://doi.org/10.3102/003465430298487

Inbar-Lourie, O. (2008). Constructing a language assessment knowledge base: A focus on language assessment courses. Language Testing, 25(3), 385–402. https://doi.org/10.1177/0265532208090158

Keppell, M., & Carless, D. (2006). Learning-oriented assessment: A technology-based case study. Assessment in Education: Principles, Policy and Practice, 13(2), 179–191. https://doi.org/10.1080/09695940600703944

Kline, R. B.(2005). Principles and practice of structural equation modelling. Guilford Press. https://www.guilford.com/books/Principles-and-Practice-of-Structural-Equation-Modeling/Rex-Kline/9781462551910

Kirby, M. M., & DiPaola, M. F. (2011). Academic optimism and community engagement in urban schools. Journal of Educational Administration, 49(5), 542–562. https://doi.org/10.1108/09578231111159539

Kuh, G. D. (2007). What student engagement data tell us about college readiness. PeerReview, 9(1), 4–8. http://www.aacu.org/peerreview/pr-wi07/pr-wi07_analysis1.cfm

Lira, M. R. d., Oliveira, A. S. d., França, R. A., Pereira, A. C. H., Godfrey, E., & Chaves, T. C. (2020). The Brazilian portuguese version of the exercise adherence rating scale (ears-br) showed acceptable reliability, validity and responsiveness in chronic low back pain. BMC Musculoskeletal Disorders, 21(1). https://doi.org/10.1186/s12891-020-03308-z

Maclellan, E. (2010). Assessment for Learning : The differing perceptions of tutors and students Assessment for Learning: The differing perceptions of tutors and students. Evaluation, 903268926, 37–41. https://doi.org/10.1080/0260293012006346

Marshall, B., & Drummond, M. J. (2006). How teachers engage with assessment for learning: Lessons from the classroom. Research Papers in Education, 21(2), 133–149. https://doi.org/10.1080/02671520600615638

Marshall, B., & William, D. (2006). English inside the black box: Assessment for learning in the English classroom. Granada Learning.

McDougal, J. L., Bardos, A., & Meier, S. T. (2011). Behavior intervention monitoring assessment system: Technical manual. Multi-Health Systems Incorporated.

Jin, J. (2021). Measuring teachers’ knowledge and application of classroom assessment concepts: Development of assessment literacy inventory for Korean teachers. In Classroom assessment SIG posters: On assessing collaborative learning and oral participation, designing assessments, formative assessment. https://doi.org/10.3102/1686516

Millsap, R. E. (2019). Statistical approaches to measurement invariance. Routledge.

Munns, G., & Woodward, H. (2006). Student engagement and student self-assessment: The REAL framework. Assessment in Education: Principles, Policy and Practice, 13(2), 193–213. https://doi.org/10.1080/09695940600703969

Muthén, L., & Muthén, B. (2012). Mplus Version 7 user’s guide. Muthén & Muthén. https://doi.org/10.1111/j.1532-5415.2004.52225.x

OECD. (2020). Education at a Glance 2020: OECD indicators. OECD Publishing. https://doi.org/10.1787/69096873-en

Panadero, E., Andrade, H., & Brookhart, S. M. (2018). Fusing self-regulation and formative assessment: A road map of where we are, where we need to go, and how to get there. Educational Psychology Review, 30(3), 681–711. https://doi.org/10.1007/s10648-018-9411-8

Popham, W. J. (2009). Assessment literacy for teachers: Faddish or fundamental? Theory into Practice, 48(1), 4–11. https://doi.org/10.1080/00405840802577536

Samson, J. F., & Collins, B. A. (2012). Preparing all teachers to meet the needs of English language learners applying research to policy and practice for teacher effectiveness. Center for American Progress. https://www.americanprogress.org/article/preparing-all-teachers-to-meet-the-needs-of-english-language-learners/

Sanders, W. L., & Rivers, J. C. (1996). Cumulative and residual effects of teachers on future student academic achievement. University of Tennessee Value-Added Research and Assessment Center. https://www.beteronderwijsnederland.nl/files/cumulative%20and%20residual%20effects%20of%20teachers.pdf

Schildkamp, K., van der Kleij, F. M., Heitink, M. C., & Veldhuis, M. (2020). Developing data use expertise in schools: Refining and validating a self-assessment instrument for teachers. Studies in Educational Evaluation, 65, 100835. https://doi.org/10.1016/j.stueduc.2020.100835

Shepard, L. A. (2019). Classroom assessment to support teaching and learning. The ANNALS of the American Academy of Political and Social Science, 683(1), 183-200. https://doi.org/10.1177/0002716219843818

Sathyanarayana, S., & Mohanasundaram, T. (2024). Fit indices in structural equation modeling and confirmatory factor analysis: Reporting guidelines. Asian Journal of Economics, Business and Accounting, 24(7), 561-77. https://doi.org/10.9734/ajeba/2024/v24i71430

Swaffield, S. (2011). Getting to the heart of authentic Assessment for Learning. Assessment in Education: Principles, Policy and Practice, 18(4), 433–449. https://doi.org/10.1080/0969594X.2011.582838

Wang, J., & Wang, X. (2020). Structural equation modeling: Applications using Mplus. Wiley. https://doi.org/10.1002/9781119422730

Willingham, W. W., & Cole, N. S. (2013). Gender and fair assessment. Routledge.

DOI: https://doi.org/10.21831/reid.v10i2.71324