Development and evaluation of a competency-based Electronic ICAO English Language Proficiency (E-IELP) platform in aviation vocational education
DOI:
https://doi.org/10.21831/jpv.v16i2.100458Keywords:
aviation communication competence, aviation vocational education, competency-based learning, digital learning, E-IELP platformAbstract
Aviation vocational education requires competency-based digital learning media that enable cadets to practice workplace communication tasks aligned with industry standards. This study developed and evaluated a web-based Electronic ICAO English Language Proficiency (E-IELP) platform to support aviation communication training for aeronautical communication cadets at an aviation vocational polytechnic in Indonesia. The platform provides ICAO-aligned learning activities, including radiotelephony read-back, situation analysis, emergency communication scenarios, and speaking tasks. This study employed a research and development (R&D) approach based on the ADDIE model, followed by a quasi-experimental pre-test–post-test control-group design to evaluate the platform's effectiveness. Forty-eight cadets participated in the study and were assigned to treatment and control groups. Data were collected through needs analysis questionnaires, curriculum analysis, expert validation forms, user response questionnaires, performance tests, and interviews. Quantitative data were analyzed using descriptive statistics, paired-samples t-tests, Welch's independent-samples t-test, and effect size estimates, while qualitative data were analyzed using thematic analysis. The platform was judged feasible by experts and received highly positive responses from users. The treatment group achieved significantly higher post-test performance than the control group, indicating that the platform effectively supports structured, repeated, and feedback-oriented aviation communication practice. However, because the study was conducted at a single institution over a four-week intervention and involved a relatively small sample using a five-point performance scale, the very large effect size should be interpreted with caution. Overall, the findings suggest that the E-IELP platform can serve as an effective supplementary competency-based digital learning platform for aviation vocational education.
References
Ada, M. B. (2021). Evaluation of a mobile web application for assessment feedback. Technology, Knowledge and Learning, 28(1), 23–46. https://doi.org/10.1007/s10758-021-09575-6
Afonso, A., Morgado, L., Noguera, I., Sepúlveda-Parrini, P., Hernandez-Leo, D., Alkhasawneh, S. N., Spilker, M. J., & Carvalho, I. C. (2025). Flexible learning by design: Enhancing faculty digital competence and engagement through the FLeD project. Education Sciences, 15(7), 934. https://doi.org/10.3390/educsci15070934
Ahmed, S. K., Mohammed, R. A., Nashwan, A. J., Ibrahim, R. H., Abdalla, A. Q., Ameen, B. M. M., & Khdhir, R. M. (2025). Using thematic analysis in qualitative research. Journal of Medicine, Surgery, and Public Health, 6, 100198. https://doi.org/10.1016/j.glmedi.2025.100198
Almelhi, A. M. (2021). Effectiveness of the ADDIE model within an E-learning environment in developing creative writing in EFL students. English Language Teaching, 14(2), 20–36. https://doi.org/10.5539/elt.v14n2p20
Alptekin, Z., & Taneri, A. (2025). Technology integration in pedagogical processes: Digital competence and teaching practices of primary school teachers in Turkey. Discover Education, 4(1), 351. https://doi.org/10.1007/s44217-025-00646-9
Andriansyah, E. H., & Kamalia, P. U. (2021). National Standards of Education affect the employment opportunities of vocational high school graduates. Jurnal Pendidikan Vokasi, 11(2), 112–124. https://doi.org/10.21831/jpv.v11i2.40791
Baziukė, D., Rupšienė, I., Kesylė, K., & Norvilienė, A. (2025). How e-learning platforms are addressing project-based learning: An assessment of digital learning tools in primary education. Applied Sciences, 15(23), 12422. https://doi.org/10.3390/app152312422
Borasheva, A. (2026). Student engagement and language learning in a flipped ESP classroom: The role of Telegram. Social Sciences & Humanities Open, 13, 102382. https://doi.org/10.1016/j.ssaho.2025.102382
Budiarto, M. K., Asrowi, A., Gunarhadi, G., Karsidi, R., & Rahman, A. (2024). E-learning platform for enhancing 21st century skills for vocational school students: A systematic literature review. Electronic Journal of E-Learning, 22(5), 76–90. https://doi.org/10.34190/ejel.22.5.3417
Chatzi, A. V., & Kourousis, K. I. (2024). Identifying the contribution of communication and trust in aviation maintenance occurrences: A content analysis methodology. Transportation Research Interdisciplinary Perspectives, 27, 101220. https://doi.org/10.1016/j.trip.2024.101220
Dapica, R., Hernández, A., & Peinado, F. (2022). Who trains the trainers? Gamification of flight instructor learning in evidence-based training scenarios. Entertainment Computing, 43, 100510. https://doi.org/10.1016/j.entcom.2022.100510
Demirdöken, G. (2024). Artificial intelligence in aviation English testing. The Literacy Trek, 10(3), 362–384. https://doi.org/10.47216/literacytrek.1556603
Dumdumaya, M. T. (2025). A systematic review of Aviation English communication in emergency situations. Journal of Education, Learning, and Management, 2(2), 338–343. https://doi.org/10.69739/jelm.v2i2.1207
Fussell, S., & Thomas, R. (2021). Interactive modules for flight training: A review. The Journal of Aviation/Aerospace Education and Research, 30(2), 3. https://doi.org/10.15394/jaaer.2021.1901
Garcia, A. C. de M. (2023). Investigating the construct of aeronautical English listening testing: A qualitative analysis of the ICAO rating scale. Journal of Teaching English for Specific and Academic Purposes, 11(1), 069–086. https://doi.org/10.22190/JTESAP230220007G
Gilic, F., & İnandi, Y. (2026). Aligning vocational and technical education with labor market demands in a knowledge-based economy: A case study of Türkiye. Education + Training, 68(7), 1036–1055. https://doi.org/10.1108/ET-04-2025-0232
Hack, E. M., Kelley, C. P., & Soboroff, S. (2026). Leadership style and follower perceptions: Evaluations of command within a military training context. Organization Management Journal, 23(3), 267–285. https://doi.org/10.1108/OMJ-06-2025-2597
International Civil Aviation Organization. (2016). Manual on air traffic controller competency-based training and assessment (1st ed.). International Civil Aviation Organization. https://www.icao.int/sites/default/files/sp-files/SAM/Documents/2016-CBT/10056_draft_en.pdf
Jiang, Y., Tran, T. H., & Williams, L. (2023). Machine learning and mixed reality for smart aviation: Applications and challenges. Journal of Air Transport Management, 111, 102437. https://doi.org/10.1016/j.jairtraman.2023.102437
Kes, L., Saunders-Smits, G. N., & Specht, M. M. (2026). Towards new educational standards for aircraft maintenance: analysing transversal competencies on industry safety priorities and assessment challenges. Cogent Education, 13(1). https://doi.org/10.1080/2331186X.2026.2629672
Killingback, C., Drury, D., Mahato, P., & Williams, J. (2020). Student feedback delivery modes: A qualitative study of student and lecturer views. Nurse Education Today, 84, 104237. https://doi.org/10.1016/j.nedt.2019.104237
Kravchenko, K., Ketsyk-Zinchenko, U., Suduk, I., Nykyporets, S., & Cherednychenko, V. (2025). Effectiveness of online platforms in developing language skills of higher education students. Eduweb, 19(3), 303–314. https://doi.org/10.46502/issn.1856-7576/2025.19.03.19
Lai, Z. C.-C. (2026). AI in EFL blended learning: Impact on speaking performance and learning resilience. Asian-Pacific Journal of Second and Foreign Language Education, 11(1), 11. https://doi.org/10.1186/s40862-025-00367-4
Leung, A., Fine, P. D., Blizard, R., Tonni, I., Ilhan, D., & Louca, C. (2022). Teacher feedback and student learning–The students’ perspective. Journal of Dentistry, 125, 104242. https://doi.org/10.1016/j.jdent.2022.104242
Li, N., Liu, C., Wang, N., Lin, S., Yuan, Y., Huang, F., & Zhu, P. (2024). Feasibility, usability and acceptability of a lifestyle-integrated multicomponent exercise delivered via a mobile health platform in community-dwelling pre-frail older adults: A short-term, mixed-methods, prospective pilot study. BMC Geriatrics, 24(1), 926. https://doi.org/10.1186/s12877-024-05523-y
Li, W. (2025). Exploring the effects of using automatic speech recognition on EFL university students with high speaking anxiety. International Journal of Information and Education Technology, 15(1), 187–194. https://doi.org/10.18178/ijiet.2025.15.1.2231
Lim, W. M. (2025). What is qualitative research? An overview and guidelines. Australasian Marketing Journal, 33(2), 199–229. https://doi.org/10.1177/14413582241264619
Lin, C., Bingwei, L., Sicheng, H., Yuchi, Z., Nan, L., Jiaqi, Z., Honglei, Z., Jingyu, A., Xin, Z., & Yanqing, W. (2025). Construction of leadership competency model for civil aviation flight cadets: An empirical study from China. Scientific Reports, 15(1), 12739. https://doi.org/10.1038/s41598-025-93713-y
Mahmood, A. S., Mat Saad, N. S., & Mohd Nur, N. (2025). Taking flight with Aviation English: How are Malaysian teachers preparing the next generation? F1000Research, 14, 1036. https://doi.org/10.12688/f1000research.169220.1
Mananggit, M. A. C., Intarakamhang, U., Mohan, K. P., Ledesma, A., Collado, J., Laureta, K. P., Balmilero-Pelagio, J. K., Pararuan, R. A. V., Reyes-Colar, F. F., Bustos, I. G., & Santos, J. C. (2026). Development, expert validation, and pilot testing of digital mental health literacy program for Filipino college students. BMC Psychology, 14(1), 1023. https://doi.org/10.1186/s40359-026-04695-z
Marzalius, L. R., & Jasril, I. R. (2026). Interactive multimedia learning for vocational electronics education: Development, validation, and classroom implementation. Journal of Hypermedia & Technology-Enhanced Learning, 4(1), 16–29. https://doi.org/10.58536/j-hytel.210
Masiulionienė, G., & Tupčiauskaitė, G. (2023). Bridging the gap between ICAO level 4 and 5 in Aviation English: expectations and results. Aviation, 27(3), 197–211. https://doi.org/10.3846/aviation.2023.19763
Mohammad, M. (2026). Authentic workplace learning in technology-enhanced vocational education: Examining situated learning principles in industrial English training. https://doi.org/10.21203/rs.3.rs-8817222/v1
Naeem, M., Ozuem, W., Howell, K., & Ranfagni, S. (2023). A step-by-step process of thematic analysis to develop a conceptual model in qualitative research. International Journal of Qualitative Methods, 22, 16094069231205788. https://doi.org/10.1177/16094069231205789
Pane, I. I. I., Mei, C. C. Y., T’chiang, D. C. U., Fibriasari, H., Sylvia, T., Naibaho, Y., & Sadri, I. (2025). Appropriating English proficiency test format: A case study of Indonesian Aviation School. In International Joint Conference on Arts and Humanities 2024 (IJCAH 2024) (pp. 2462–2477). Atlantis Press. https://doi.org/10.2991/978-2-38476-317-7_216
Pasupuleti, M. K. (2024). Research method design approaches for qualitative and quantitative data analysis. National Education Services. https://doi.org/10.62311/nesx/rb978-81-978028-5-0
Pilcher, N., & Cortazzi, M. (2024). “Qualitative” and “quantitative” methods and approaches across subject fields: Implications for research values, assumptions, and practices. Quality & Quantity, 58(3), 2357–2387. https://doi.org/10.1007/s11135-023-01734-4
Primartadi, A., Suyitno, S., Abdillah, F., Kamin, Y., Riyadi, S., & Nugroho, S. (2026). Student acceptance of AI-driven deep learning tools: The influence of institutional support and teacher competency in vocational schools. European Journal of Educational Research, 15(2), 481–495. https://doi.org/10.12973/eu-jer.15.2.481
Ramanjaneyulu, S., Jalandharachari, A. S., Bindhani, S., Kasodhan, P., Harish, D., & Murthy, B. R. (2026). Integrating digital competency into aviation training: An auditable inputs–processes–outcomes framework. Journal of the Air Transport Research Society, 6, 100104. https://doi.org/10.1016/j.jatrs.2026.100104
Rizvi, S. A. Q., Rehman, U., Cao, S., & Moncion, B. (2025). Exploring technology acceptance of flight simulation training devices and augmented reality in general aviation pilot training. Scientific Reports, 15(1), 2302. https://doi.org/10.1038/s41598-025-85448-7
Rochmawati, L., & Rosyid, H. (2025). Web 2.0-based Aviation English: A catalyst for English mastery at aviation vocational school. Jurnal Ilmu Pendidikan, 31(1), 50–60. https://doi.org/10.17977/um048v31i12025p50-60
Rosyid, H., Rochmawati, L., Sylvia, T., Rossydi, A., & Bhakti, H. D. (2025). Development of a web-based Aviation English proficiency test: Integrating adaptive algorithms and dynamic assessment for enhanced evaluation in aviation education. International Journal of Artificial Intelligence Research, 9(1.1). https://doi.org/10.29099/ijair.v9i1.1.1620
Sarmiento-Campos, N.-V., Lázaro-Guillermo, J. C., Silvera-Alarcón, E.-N., Cuellar-Quispe, S., Huamán-Romaní, Y.-L., Apaza, O. A., & Sorkheh, A. (2022). A look at Vygotsky’s Sociocultural Theory (SCT): The effectiveness of scaffolding method on EFL learners’ speaking achievement. Education Research International, 2022, 1–12. https://doi.org/10.1155/2022/3514892
Savchenko, N. S., & Necheporuk, Y. S. (2021). Foreign language preparedness for vocational communication of students in flight educational institutions. Espacios, 42(9), 82–90. https://doi.org/10.48082/espacios-a21v42n09p07
Sheffield, E., Lee, S.-Y., & Zhang, Y. (2025). A systematic review of general aviation accident factors, effects and prevention. Journal of Air Transport Management, 128, 102859. https://doi.org/10.1016/j.jairtraman.2025.102859
Shonfeld, M., Zidan, W., Yazbak Abu Ahmad, M., Cohen Liverant, R., Lieber-Milo, S., & Amichai-Hamburger, Y. (2025). Virtual bridges: Enhancing intercultural competence among pre-service teachers through 3D and video-conferencing platforms. Education Sciences, 15(10), 1296. https://doi.org/10.3390/educsci15101296
Spatioti, A. G., Kazanidis, I., & Pange, J. (2022). A comparative study of the ADDIE instructional design model in distance education. Information, 13(9), 402. https://doi.org/10.3390/info13090402
Suyatmo, S., Pratiwi, D. I., Wirawan, W. A., Warju, W., & Anggoro, K. J. (2026). Integrating human capital and learning environments in aviation vocational education: A structural model of learning effectiveness. International Journal of Sociology of Education, 15(2), 123–142. https://doi.org/10.17583/rise.19081
Syamala, S., Shrivastava, A., & Karmakar, S. (2025). Identifying interface design factors impacting user experience in digital learning platforms- A pilot study. Social Sciences & Humanities Open, 11, 101662. https://doi.org/10.1016/j.ssaho.2025.101662
Sylvia, T., Rochmawati, L., & Diriyanti Novalina, S. (2024). Blended learning for aviation school. JEES (Journal of English Educators Society), 9(1). https://doi.org/10.21070/jees.v9i1.1806
Tran, T. T. T., & Ma, Q. (2025). Technology-enhanced self-regulation training: A dynamic training model to facilitate second language Vietnamese learners’ self-regulated writing skills. System, 130, 103625. https://doi.org/10.1016/j.system.2025.103625
Treadaway, M., & Read, J. (2024). Setting standards for a diagnostic test of Aviation English for student pilots. Language Testing, 41(3), 557–583. https://doi.org/10.1177/02655322231224051
Treadaway, M., & Read, J. (2025). Assessing the language needs of L2 English student pilots preparing for flight training in English-speaking countries. English for Specific Purposes, 78, 125–138. https://doi.org/10.1016/j.esp.2024.12.007
Tsai, S.-C. (2023). Learning with mobile augmented reality-and automatic speech recognition-based materials for English listening and speaking skills: Effectiveness and perceptions of non-English major English as a foreign language students. Journal of Educational Computing Research, 61(2), 444–465. https://doi.org/10.1177/07356331221111203
Wan, Y., & Lian, J. (2026). The effects of old and new test question strategies on student academic performance in Chinese-English translation classes. Sage Open, 16(1), 21582440261423828. https://doi.org/10.1177/21582440261423827
Wang, G., & Zhao, W. (2020). Background introduction. In The Principles of Integrated Technology in Avionics Systems (pp. 1–40). Elsevier. https://doi.org/10.1016/B978-0-12-816651-2.00001-0
Wang, Z., Jiang, P., Wang, Z., Han, B., Liang, H., Ai, Y., & Pan, W. (2024). Enhancing air traffic control communication systems with integrated automatic speech recognition: Models, applications and performance evaluation. Sensors, 24(14), 4715. https://doi.org/10.3390/s24144715
Wiboolyasarin, W., Wiboolyasarin, K., Tiranant, P., Jinowat, N., & Boonyakitanont, P. (2025). AI-driven chatbots in second language education: A systematic review of their efficacy and pedagogical implications. Ampersand, 14, 100224. https://doi.org/10.1016/j.amper.2025.100224
Wild, G., Nanyonga, A., Iqbal, A., Bano, S., Somerville, A., & Pollock, L. (2025). Lightweight and mobile artificial intelligence and immersive technologies in aviation. Visual Computing for Industry, Biomedicine, and Art, 8(1), 21. https://doi.org/10.1186/s42492-025-00203-z
Wu, X.-Y. (2024). Artificial Intelligence in L2 learning: A meta-analysis of contextual, instructional, and social-emotional moderators. System, 126, 103498. https://doi.org/10.1016/j.system.2024.103498
Xu, T., & Wang, H. (2024). The effectiveness of artificial intelligence on English language learning achievement. System, 125, 103428. https://doi.org/10.1016/j.system.2024.103428
Yu, S.-J., Hsueh, Y.-L., Sun, J. C.-Y., & Liu, H.-Z. (2021). Developing an intelligent virtual reality interactive system based on the ADDIE model for learning pour-over coffee brewing. Computers and Education: Artificial Intelligence, 2, 100030. https://doi.org/10.1016/j.caeai.2021.100030
Zhang, H., & Li, C. (2026). Providing web-based feedback in distance language education: Instructors’ preferences and shared responsibilities. Acta Psychologica, 267, 107097. https://doi.org/10.1016/j.actpsy.2026.107097
Downloads
Published
How to Cite
Issue
Section
Citation Check
License
Copyright (c) 2026 Laila Rochmawati, Harunur Rosyid, Delmio A. M. G. de Sousa
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors retain the copyright of their work and grant Jurnal Pendidikan Vokasi the right of first publication. All articles are licensed under the Creative Commons Attribution-ShareAlike 4.0 International License (CC BY-SA 4.0).
