Development and validation of a CIPP-based evaluation instrument for the Reading Log Programme in elementary schools
School literacy programmes are often evaluated by counting books read, overlooking programme goals, resources, implementation, and impact. This study aimed to develop a valid, reliable instrument to evaluate the Reading Log Programme in elementary schools using the Context, Input, Process, and Product (CIPP) model. The study employed a research and development design adapted from Borg and Gall. Five experts in educational evaluation, school administration, and literacy reviewed an initial pool of 50 items, and we field-tested the refined instrument with 50 fifth-grade students at SD Khalifa IMS Primary Bintaro. We examined content validity using the Content Validity Ratio (CVR), the Item Content Validity Index (I-CVI), and the Scale Content Validity Index (S-CVI/Ave); we examined empirical validity using corrected item–total correlations (CITC); and we estimated reliability with Cronbach's alpha. Content validity was high (S-CVI/Ave = 0.94). After screening based on CVR values, expert recommendations, students' reading levels, and balanced dimensional coverage, we reduced the instrument to 20 items. In the field test, 18 items met the empirical validity criterion (CITC = 0.352–0.724), and internal consistency was high (α > 0.90). The study contributes a practical, process-oriented CIPP-based instrument for evaluating reading-habit programmes in primary education, enabling schools to monitor programme context, resources, implementation and outcomes in an integrated manner.
Downloads
Al-Shanawani, H. M. (2019). Evaluation of self-learning curriculum for kindergarten using Stufflebeam's CIPP model. SAGE Open, 9(1), Article 2158244018822380. https://doi.org/10.1177/2158244018822380
Amni, C., Sa'adah, N., & Nur, M. (2026). Bridging the digital divide in remote islands: Exploring literacy, culture, and community identity in Pulau Breueh, Indonesia. Social Sciences & Humanities Open, 13, Article 102495. https://doi.org/10.1016/j.ssaho.2026.102495
Anggara, D. S., & Abdillah, C. (2023). Content validity analysis of literacy assessment instruments. Jurnal Cakrawala Pendidikan, 42(2), 447–459. https://doi.org/10.21831/cp.v42i2.55900
Atin, N., Hendriana, E. C., & Yanti, L. (2024). Hubungan minat baca dengan kemampuan membaca pemahaman siswa kelas IV sekolah dasar [The relationship between reading interest and reading comprehension of fourth-grade elementary students]. Jurnal Basicedu, 8(2), 1428–1436. https://doi.org/10.31004/basicedu.v8i2.7367
Ayre, C., & Scally, A. J. (2014). Critical values for Lawshe's content validity ratio: Revisiting the original methods of calculation. Measurement and Evaluation in Counseling and Development, 47(1), 79–86. https://doi.org/10.1177/0748175613513808
Bashooir, K., & Supahar, S. (2018). Validitas dan reliabilitas instrumen asesmen kinerja literasi sains pelajaran fisika berbasis STEM [Validity and reliability of a STEM-based physics science literacy performance assessment instrument]. Jurnal Penelitian dan Evaluasi Pendidikan, 22(2), 219–230. https://doi.org/10.21831/pep.v22i2.19590
Borg, W. R., & Gall, M. D. (1983). Educational research: An introduction (4th ed.). Longman.
Daga, A. T., Engge, Y., & Tanggela, K. (2025). Impact of the School Literacy Movement on elementary students' reading interest and reading ability: Evidence from Southwest Sumba Regency, Indonesia. Journal of General Education and Humanities, 4(4), 1973–1984. https://doi.org/10.58421/gehu.v4i4.732
Damayanti, E., Ibrahim, M. M., & Ismail, M. I. (2022). Evaluation of online learning programs at universities using the CIPP model. Jurnal Educative: Journal of Educational Studies, 6(1), 95–110. https://doi.org/10.30983/educative.v6i1.4678
DeVellis, R. F., & Thorpe, C. T. (2022). Scale development: Theory and applications (5th ed.). SAGE.
Ebbes, R., Schuitema, J. A., Koomen, H. M. Y., Jansen, B. R. J., & Zee, M. (2024). Self-regulated learning: Validating a task-specific questionnaire for children in elementary school. Studies in Educational Evaluation, 81, Article 101339. https://doi.org/10.1016/j.stueduc.2024.101339
Guthrie, J. T., Klauda, S. L., & Ho, A. N. (2013). Modeling the relationships among reading instruction, motivation, engagement, and achievement for adolescents. Reading Research Quarterly, 48(1), 9–26. https://doi.org/10.1002/rrq.035
Hania, W. Z. Z., & Sutrisno, H. (2022). Development of an integrated ability assessment instrument in reaction rate material. Jurnal Kependidikan: Penelitian Inovasi Pembelajaran, 6(1), 1–13. https://doi.org/10.21831/jk.v6i1.38390
Hasan, A., Yasin, S. N. T. M., & Yunus, M. F. M. (2015). A conceptual framework for mechatronics curriculum using Stufflebeam CIPP evaluation model. Procedia – Social and Behavioral Sciences, 195, 844–849. https://doi.org/10.1016/j.sbspro.2015.06.324
Hurwitz, L. B., & Macaruso, P. (2021). Supporting struggling middle school readers: Impact of the Lexia® PowerUp Literacy® program. Journal of Applied Developmental Psychology, 77, Article 101329. https://doi.org/10.1016/j.appdev.2021.101329
Hutting, N., Belton, J., Caneiro, J. P., Oliveira, V. C., Devan, H., Johnston, V., Moore, P., Richardson, J., Staal, J. B., & Walsh, N. (2025). Development and content validity of the musculoskeletal self-management questionnaire (MSK-SMQ). Musculoskeletal Science and Practice, 78, Article 103342. https://doi.org/10.1016/j.msksp.2025.103342
Hyman, A., Stewart, K., Jamin, A.-M., Novak Lauscher, H., Stacy, E., Kasten, G., & Ho, K. (2020). Testing a school-based program to promote digital health literacy and healthy lifestyle behaviours in intermediate elementary students: The Learning for Life program. Preventive Medicine Reports, 19, Article 101149. https://doi.org/10.1016/j.pmedr.2020.101149
Irene, E. A. (2023). Evaluation of teacher education curricula and its relevance to licensure examination using Context, Input, Process and Product (CIPP) model. Social Sciences & Humanities Open, 8(1), Article 100607. https://doi.org/10.1016/j.ssaho.2023.100607
Kanonire, T., Lubenko, J., & Kuzmina, Y. (2022). The effects of intrinsic and extrinsic reading motivation on reading performance in elementary school. Journal of Research in Childhood Education, 36(1), 1–13. https://doi.org/10.1080/02568543.2020.1822961
Kantona, H., & Munadi, S. (2024). Development of digital literacy assessment instrument for prospective teacher students in higher education. Jurnal Penelitian dan Evaluasi Pendidikan, 28(2), 173–185. https://doi.org/10.21831/pep.v28i2.72712
Karatas, H., & Seval, F. (2011). CIPP evaluation model scale: Development, reliability and validity. Procedia – Social and Behavioral Sciences, 15, 592–599. https://doi.org/10.1016/j.sbspro.2011.03.146
Kultas, E. (2026). The effect of reading fluency strategies on improving primary school students' reading attitudes and their role in reducing reading anxiety. Acta Psychologica, 265, Article 106711. https://doi.org/10.1016/j.actpsy.2026.106711
Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563–575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x
Li, W., Kang, S., & Shao, Y. (2023). Development of the reading literacy questionnaire for EFL learners at primary schools. Frontiers in Psychology, 14, Article 1154076. https://doi.org/10.3389/fpsyg.2023.1154076
Mohebbi, N., Akhlaghi, F., Yarmohammadian, M. H., & Khoshgam, M. (2011). Application of CIPP model for evaluating the medical records education course at master of science level at Iranian medical sciences universities. Procedia – Social and Behavioral Sciences, 15, 3286–3290. https://doi.org/10.1016/j.sbspro.2011.04.287
OECD. (2023). PISA 2022 results (Volume I): The state of learning and equity in education. OECD Publishing. https://doi.org/10.1787/53f23881-en
Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30(4), 459–467. https://doi.org/10.1002/nur.20199
Retnawati, H. (2016). Analisis kuantitatif instrumen penelitian [Quantitative analysis of research instruments]. Parama Publishing.
Sankaran, S., & Saad, N. (2022). Evaluating the Bachelor of Education program based on the context, input, process, and product model. Frontiers in Education, 7, Article 924374. https://doi.org/10.3389/feduc.2022.924374
Schultes, M.-T., Graf, D., Holzer, J., Schober, B., & Spiel, C. (2025). Implementation and evaluation of service learning at higher education institutions. Evaluation and Program Planning, 112, Article 102622. https://doi.org/10.1016/j.evalprogplan.2025.102622
Starreveld, K. M., Overbeek, M. M., Willemen, A. M., & Bakermans-Kranenburg, M. J. (2026). An observation instrument to assess teacher–child interaction in early elementary education: Development and psychometric properties of the CCIS-E. Acta Psychologica, 262, Article 106157. https://doi.org/10.1016/j.actpsy.2025.106157
Stufflebeam, D. L., & Coryn, C. L. S. (2014). Evaluation theory, models, and applications (2nd ed.). Jossey-Bass.
Taye, T., & Teshome, G. (2025). The efficacy of extensive reading strategies for enhancing reading comprehension among 4th year EFL students at Mizan Tepi University. Social Sciences & Humanities Open, 11, Article 101616. https://doi.org/10.1016/j.ssaho.2025.101616
Tegmark, M., Alatalo, T., Vinterek, M., & Winberg, M. (2022). What motivates students to read at school? Student views on reading practices in middle and lower-secondary school. Journal of Research in Reading, 45(1), 100–118. https://doi.org/10.1111/1467-9817.12386
Troncoso-Ruiz, A., van de Ven, M., & Segers, E. (2026). Third and fifth graders' self-regulation in multiple digital documents reading. Computers in Human Behavior Reports, 23, Article 101127. https://doi.org/10.1016/j.chbr.2026.101127
Wati, M., & Misbah, M. (2021). Pengembangan materi ajar fisika bermuatan authentic learning pada pokok bahasan gerak melingkar [Development of physics teaching materials with authentic learning on circular motion]. Jurnal Kependidikan: Penelitian Inovasi Pembelajaran, 5(2). https://doi.org/10.21831/jk.v5i2.40320
Weerasekara, I., Hall, M., Shaw, L., & Kiegaldie, D. (2023). Instruments evaluating the quality of the clinical learning environment in nursing education: An updated systematic review. Nurse Education in Practice, 71, Article 103732. https://doi.org/10.1016/j.nepr.2023.103732
Winberg, M., Tegmark, M., Vinterek, M., & Alatalo, T. (2022). Motivational aspects of students' amount of reading and affective reading experiences in a school context: A large-scale study of grades 6 and 9. Reading Psychology, 43(7), 442–476. https://doi.org/10.1080/02702711.2022.2118914
Wu, J., Li, M., Wang, Z., & Hu, X. (2025). Enhancing primary students' language creativity through reading book-length fairy tale fiction in a computer-enriched environment. Thinking Skills and Creativity, 57, Article 101814. https://doi.org/10.1016/j.tsc.2025.101814
Zakaria, Sunendar, D., & Damaianti, V. S. (2022). Cultural literacy-based reading materials for elementary school students. In A. Amrullah, L. Herayanti, T. Sengupta-Irving, Y. S. Fern, F. Fathoroni, & I. Imran (Eds.), Proceedings of the 3rd Annual Conference of Education and Social Sciences (ACCESS 2021) (pp. 150–157). Atlantis Press. https://doi.org/10.2991/978-2-494069-21-3_17
Copyright (c) 2026 Jurnal Kependidikan: Penelitian Inovasi Pembelajaran
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
