Email this article 
IMAGE-TEXT RELATION INTERPRETATION: TEACHERS’ VISUAL-VERBAL COMPETENCE IN TEACHING TEXTS
Fuad Abdul Hamied, Universitas Pendidikan Indonesia, Indonesia
Wawan Gunawan, Universitas Pendidikan Indonesia, Indonesia
Abstract
Multimodal literacy instruction is such a new shift of the literacy in which the construction of knowledge is led to be more socially and contextually bounded. Due to the urgency that teachers have to own multimodal competencies, this study aimed to investigate EFL teachers’ competence in interpreting visual-verbal relations to teach multimodal texts. To collect the data, an online test through the Google form platform was distributed. As many as 43 responses were collected from junior and senior high school teachers in one of the cities in Indonesia. A semi-structured interview was also conducted with six purposive participants. The data in this research were then analysed based on Royce’s criteria of image-text relation. The analysis found that the teachers only partially possessed multimodal competencies. It means that that they had used images to help them teach the texts but had insufficient knowledge on how to utilize the images as meaning-making sources. Then, based on the finding, it is suggested that the teachers should improve their competences in interpreting multimodal meanings in texts, so images are used not only for making learning materials interesting but also for making more meanings from the texts.
Keywords
Full Text:
PDFReferences
Ajayi, L. (2011). A multiliteracies pedagogy: Exploring semiotic possibilities of a disney video in a third grade diverse classroom. The Urban Review, 43(3), 396–413. https://doi.org/10.1007/s11256-010-0151-0.
Bailey, N. M., & van Harken, E. M. (2014). Visual images as tools of teacher inquiry. Journal of Teacher Education, 65(3), 241–260. https://doi.org/10.1177/0022487113519130.
Bearne, E. (2009). Multimodality, literacy and texts: Developing a discourse. Journal of Early Childhood Literacy, 9(2), 156–187. https://doi.org/10.1177/1468798409105585.
Brailas, A. (2017). Digital storytelling in the classroom : How to tell students to tell a story. International Journal of Teaching and Case Studies, 8(1), 16–28. https://doi.org/10.1504/IJTCS.2017.084407.
Çıralı, H., & Usluel, Y. K. (2015, 6-8 July). A descriptive review study about digital storytelling in a descriptive review study about digital storytelling in educational context. Paper presented at the 7th International Conference on Education and New Learning Technologies (EDULEARN15). Barcelona, Spain.
Da Costa, E. P. M., & de Barros, C. G. P. (2012). Multimodal genres in textbooks: Are students being schooled for visual literacy? Bakhtiniana: Revista de Estudos do Discurso, 7(2), 38–56. https://doi.org/10.1590/S2176-45732012000200004.
Danielsson, K., & Selander, S. (2016). Reading multimodal texts for learning – a model for cultivating multimodal literacy. Designs for Learning, 8(1), 25–36. https://doi.org/10.16993/dfl.72.
Duchak, O. (2014). Visual literacy in educational practice. Czech-Polish Historical and Pedagogical Journal, 6(2), 41–48. https://doi.org/10.2478/cphpj-2014-0017.
Emilia, E. (2014). Introducing functional grammar. Bandung: Pustaka Jaya.
Gabinete, M. K. L. (2017). Teachers’ beliefs and practices in assessing the viewing skill of ESL learners. Indonesian Journal of Applied Linguistics, 7(1), 19–28. https://doi.org/10.17509/ijal.v7i1.6854.
Gibbons, P. (2015). Scaffolding language, scaffolding learning: Teaching second language learners in the mainstream classroom. Portsmouth, NH: Heinemann.
Halliday, M. A. K., & Matthiessen, C. (2004). An introduction to functional grammar. New York, NY: Hodder Arnold.
Hermawan, B., & Rahyono, F. X. (2019). Ideational meanings of science and interpersonal position of readers in science textbooks for basic level in Indonesia. Indonesian Journal of Applied Linguistics, 9(1), 38–47. https://doi.org/10.17509/ijal.v9i1.15932.
Hermawan, B., & Sukyadi, D. (2017). Ideational and interpersonal meanings of children narratives in Indonesian picturebooks. Indonesian Journal of Applied Linguistics, 7(2), 404–412. https://doi.org/10.17509/ijal.v7i2.8139.
Howell, E., Butler, T., & Reinking, D. (2017). Integrating multimodal arguments into high school writing instruction. Journal of Literacy Research, 49(2), 181–209. https://doi.org/10.1177/1086296X17700456.
Hundley, M., & Holbrook, T. (2013). Set in stone or set in motion: Multimodal and digital writing with preservice English teachers. Journal of Adolescent & Adult Literacy, 56(6), 500-509. https://doi.org/10.1002/JAAL.171.
Jacobs, G. E. (2006). Developing multimodal academic literacies among college freshmen. Journal of Media Literacy Education, 4(3), 244–255. https://digitalcommons.uri.edu/jmle/vol4/iss3/5/.
Jaksic, V. (2017). Teachers’ perception of the application of gestures in TEFL classroom (Thesis, University of Zagreb). http://darhiv.ffzg.unizg.hr/id/eprint/9016.
Jewitt, C. (2008). Multimodality and literacy in school classrooms. Review of Research in Education, 32(1), 241–267. https://doi.org/10.3102/0091732X07310586.
Kedra, J., & Zakeviciute, R. (2019). Visual literacy practices in higher education: What, why, and how? Journal of Visual Literacy, 38(1-2), 1-7. https://doi.org/10.1080/1051144X.2019.1580438.
Kress, G., & van Leeuwen, T. (2006). Reading images: The grammar of visual design. New York, NY: Routledge.
Lim-Fei, V., & Yin, S. T. K. (2017). Multimodal translational research: Teaching visual texts. In O. Seizov & J. Wildfeuer (Eds.). New Studies in Multimodality: Conceptual and Methodological Elaborations. London: Bloomsbury Academic, pp. 175–199. https://doi.org/10.5040/9781350026544.0014.
Lim-Fei, V., O’Halloran, K. L., Tan, S., & E, M. K. L. (2015). Teaching visual texts with the multimodal analysis software. Educational Technology Research and Development, 63(6), 915–935. https://doi.org/10.1007/s11423-015-9395-4.
Liu, X., & Qu, D. (2014). Exploring the multimodality of EFL textbooks for Chinese college students: A comparative study. RELC Journal, 45(2), 135–150. https://doi.org/10.1177/0033688214533865.
Lundy, A. D., & Stephen, A. E. (2015). Beyond the literal: Teaching visual literacy in the 21st century classroom. Procedia - Social and Behavioral Sciences, 174, 1057-1060. https://doi.org/10.1016/j.sbspro.2015.01.794.
Martinec, R., & Salway, A. (2005). A system for image–text relations in new (and old) media. Visual Communication, 4(3), 337–371. https://doi.org/10.1177/1470357205055928.
McKee, L. L., & Heydon, R. M. (2015). Orchestrating literacies: Print literacy learning opportunities within multimodal intergenerational ensembles. Journal of Early Childhood Literacy, 15(2), 227–255. https://doi.org/10.1177/1468798414533562.
Murcia, K. (2014). Interactive and multimodal pedagogy: A case study of how teachers and students use interactive whiteboard technology in primary science. Australian Journal of Education, 58(1), 74–88. https://doi.org/10.1177/0004944113517834.
Rakhmawati, S. S. (2016). The role of moving images in the conference interpreting classroom. Indonesian Journal of Applied Linguistics, 5(2), 262–271. https://doi.org/10.17509/ijal.v5i2.1350.
Robin, B. (2006). The educational uses of digital storytelling. In C. Crawford, R. Carlsen, K. McFerrin, J. Price, R. Weber & D. Willis (Eds.), Proceedings of SITE 2006--Society for Information Technology & Teacher Education International Conference. Orlando, Florida: Association for the Advancement of Computing in Education (AACE), 709-716. https://www.learntechlib.org/primary/p/22129/.
Royce, T. (2002). Multimodality in the TESOL classroom: Exploring visual-verbal synergy. TESOL Quarterly, 36(2), 191–205. https://doi.org/10.2307/3588330.
Serafini, F. (2012). Expanding the four resources model: Reading visual and multi-modal texts. Pedagogies, 7(2), 150–164. https://doi.org/10.1080/1554480X.2012.656347.
Sewell, W. C., & Denton, S. (2015). Multimodal literacies in the secondary English. The English Journal, 100(5), 61–65. http://www.jstor.org/stable/23047804.
Shanahan, L. E. (2013). Composing “kid-friendly” multimodal text: When conversations, instruction, and signs come together. Written Communication, 30(2), 194–227. https://doi.org/10.1177/0741088313480328.
Tang, K. S., & Moje, E. B. (2010). Relating multimodal representations to the literacies of science. Research in Science Education, 40(1), 81–85. https://doi.org/10.1007/s11165-009-9158-5.
Thomas, J. R, Nelson, J. K, & Silverman, S. (2005). Research methods in physical activity. Canada: Human Kinetics.
Tomsett, P. M., & Trott, D. C. (2014). Multimodal pedagogy in international business. International Journal of Research in Social Sciences, 4(2), 50–56. http://www.ijsk.org/volume-4-issue-2/.
Twiner, A., Coffin, C., Littleton, K., & Whitelock, D. (2010). Multimodality, orchestration and participation in the context of classroom use of the interactive whiteboard: A discussion. Technology, Pedagogy and Education, 19(2), 211–223. https://doi.org/10.1080/1475939X.2010.491232.
Vungthong, S., Djonov, E., & Torr, J. (2017). Images as a resource for supporting vocabulary learning: A multimodal analysis of Thai EFL tablet apps for primary school children. TESOL Quarterly, 51(1), 32–58. https://doi.org/10.1002/tesq.274.
Wang, S., & Zhan, H. (2010). Enhancing teaching and learning with digital storytelling. International Journal of Information and Communication Technology Education, 6(2), 76–87. https://doi.org/10.4018/jicte.2010040107.
Wu, S. (2014). A multimodal analysis of image-text relations in picture books. Theory and Practice in Language Studies, 4(7), 1415–1420. https://doi.org/10.4304/tpls.4.7.1415-1420.
Yus, F. (2006). Literacy in the new media age (review). Language, 82(4), 953-954. https://doi.org/10.1353/lan.2006.0242.
DOI: https://doi.org/10.21831/cp.v40i1.33755
Refbacks
- There are currently no refbacks.
Social Media:
Jurnal Cakrawala Pendidikan by Lembaga Pengembangan dan Penjaminan Mutu Pendidikan UNY is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Based on a work at https://journal.uny.ac.id/index.php/cp/index.
