Developing a proficiency test of academic english in the Indonesian higher education context
Standardized tests remain crucial for students whose first language is not English in today’s globalized world, despite ongoing debates about their suitability. The purpose of this research is to develop an academic English proficiency test for higher education in Indonesia. The data were derived from a needs analysis conducted through focus group discussions (FGDs) and a pre-survey for the existing academic English proficiency test, followed by a test design process: creating a test blueprint and developing question items, and a second survey following a trial test with 538 test takers. The findings indicate that adjustments were required to the test format and duration, a basis for developing a new test format. Additionally, students reported a preference for computer-based tests. During the test design process, the research team revised the test, retained the test objectives, and modified the item test types. Lastly, post-test feedback and item analysis indicated an imbalance in item difficulty in the Structure and Written Expression section, while the Academic Listening and Academic Reading sections demonstrated relatively balanced difficulty levels. Overall, the findings of this research indicate a desire to revisit and refine the existing test to better meet students’ needs while maintaining its objectives.
Downloads
Brown, S. (2005). Assessment for learning. Learning and teaching in higher education, 1, 81-89.
Canagarajah, S. (2006). Changing communicative needs, revised assessment objectives: Testing English as an international language. Language Assessment Quarterly, 3(3), 229-242. https://doi.org/10.1207/s15434311laq0303_1
Cheng, L., & Watanabe, Y. (Eds.). (2004). Washback in language testing: Research contexts and methods. Routledge.
Choi, I. -C. (2008). The impact of EFL testing on EFL education in Korea. Language Testing, 25(1), 39–62. https://doi.org/10.1177/0265532207083744
The Design-Based Research Collective. (2003). Design-based research: An emerging paradigm for educational inquiry. Educational Researcher, 32(1), 5–8. http://www.jstor.org/stable/3699927
Douglas, B. H. (2010). Language assessment: principles and classroom practices. White Plains.
Hamid, M. O., Hoang, N. T. H., & Kirkpatrick, A. (2019). Language tests, linguistic gatekeeping and global mobility. Current Issues in Language Planning, 20(3), 226–244. https://doi.org/10.1080/14664208.2018.1495371
Hu, G. W. (2012). Assessing English as an international language. In L. Alsagoff, S. L. McKay, G. W. Hu, & W. Renandya (Eds.), Principles and practices for teaching English as an international language (pp. 123-143). Routledge.
Huang, Z., Mustakim, S., & Ghazali, N. (2024). Analysing the challenges of developing English for Specific Purpose (ESP) courses for Sino-Foreign cooperative educational programs. Cakrawala Pendidikan: Jurnal Ilmiah Pendidikan, 43(3), 765-772. DOI: https://doi.org/10.21831/cp.v43i3.64927
Hughes, A. (2003). Testing for language teachers (2nd Ed.). Cambridge. https://doi.org/10.1017/CBO9780511732980
Hsieh, C. N. (2017). The case of Taiwan: Perceptions of college students about the use of the TOEIC® tests as a condition of graduation. ETS Research Report Series, 2017(1), 1-12. https://files.eric.ed.gov/fulltext/EJ1168727.pdf
Jenkins, J. (2009). World Englishes. Routledge
McKay, S. L. (2002). Teaching English as an international language: Rethinking goals and perspectives. Oxford University Press.
Ministry of Education and Culture of the Republic of Indonesia. (2020). Peraturan Menteri Pendidikan dan Kebudayaan Republik Indonesia Nomor 3 Tahun 2020 tentang Standar Nasional Pendidikan Tinggi [Regulation of the Minister of Education and Culture Number 3 of 2020 on National Standards for Higher Education]. Ministry of Education and Culture.
Nhan, T. (2013). The TOEIC® test as an exit requirement in universities and colleges in Danang City, Vietnam: Challenges and impacts. International Journal of Innovative Interdisciplinary Research, 2(1), 33–50.
Ojha, L. P. (2022). World Englishes, monolingual bias, and standardized tests in a multilingual world: Ideologies, practices, and the missing link. Journal of NELTA, 27(1-2), 88-105. https://doi.org/10.3126/nelta.v27i1-2.53197
Pennycook, A., & Candlin, C. N. (2017). The cultural politics of English as an international language. Routledge.
Qian, D. D. (2008). English language assessment in Hong Kong: A survey of practices, developments and issues. Language Testing, 25(1), 85-110. https://doi.org/10.1177/0265532207083746
Rea-Dickins, P. (2000). Current research and professional practice: Reports of work in progress into the assessment of young language learners. Language Testing, 17(2), 245-249. https://doi.org/10.1177/026553220001700207
Sadeghpour, M., & Sharifi an, F. (2019). World Englishes in English language teaching. World Englishes, 38(1-2), 245-258. https://doi.org/10.1111/weng.12372
Schissel, J. L., Leung, C., López-Gopar, M., & Davis, J. R. (2018). Multilingual learners in language assessment: Assessment design for linguistically diverse communities. Language and Education, 167-182. https://doi.org/10.1080/09500782.2018.1429463
Sharma, B. K. (2008). World Englishes, English as a lingua franca, and English pedagogy. Journal of NELTA, 13(1-2), 121-130. https://doi.org/10.3126/nelta.v27i1-2.53197
Sumardi, S., & Muamaroh, M. (2020). Edmodo impacts: Mediating digital class and assessment in English language teaching. Cakrawala Pendidikan, 39(2), 319-331. DOI: https://doi.org/10.21831/cp.v39i2.30065
Wang, Y., & Li, S. (2020). Issues, challenges, and future directions for multilingual assessment. Journal of Language Teaching and Research, 11(6), 914-919. http://dx.doi.org/10.17507/jltr.1106.06
Winantaka, B., Efendi, A., & Putro, N. H. P. S. (2025). Exploring flipped classroom for business English: Preliminary insights from student voices and reflections. Cakrawala Pendidikan: Jurnal Ilmiah Pendidikan, 44(3), pp.730-739. DOI https://doi.org/10.21831/cp.v44i3.65140
Zhang-Wu, Q., & Brisk, M. E. (2021). “I must have taken a fake TOEFL!”: Rethinking linguistically responsive instruction through the eyes of Chinese international freshmen. TESOL Quarterly, 55(4), 1136-1161. https://doi.org/10.1002/tesq.3077
Copyright (c) 2026 Didi Sukyadi, Fuad Abdul Hamied, Ika Damayanti, Ari Arifin Danuwijaya, Lukman Hakim, Firly Asyifa
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Jurnal Cakrawala Pendidikan, Jurnal Ilmiah Pendidikan, with ISSN: 0216-1370, is published by the Institute of Education Development and Quality Assurance (LPPMP UNY). Cakrawala Pendidikan has been recently has been re-accredited by Indonesian Ministry of Education and Culture decision Number 230/E/KPT/2022 which is valid for five years since enacted on 30 December 2022.
