Evaluation of the Environmental Chemistry Course Using the CIPP Model: Integrating SDGs and Enhancing Students' Environmental Literacy

Mellyzar Mellyzar; Nahadi Nahadi; Siti Sriyati; Hernani Hernani

doi:10.21831/jpms.v13i1.81825

Evaluation of the Environmental Chemistry Course Using the CIPP Model: Integrating SDGs and Enhancing Students' Environmental Literacy

Mellyzar Mellyzar, Universitas Malikussaleh Universitas Pendidikan Indonesia, Indonesia
Nahadi Nahadi, Universitas Pendidikan Indonesia, Indonesia
Siti Sriyati, Universitas Pendidikan Indonesia, Indonesia
Hernani Hernani, Universitas Pendidikan Indonesia, Indonesia

10.21831/jpms.v13i1.81825

Abstract

This study evaluates the alignment of the curriculum with national policies and global environmental challenges, assesses the availability of resources and teaching strategies, and measures students’ learning outcomes in cognitive, affective, and behavioral dimensions. Using a mixed-methods approach within the CIPP (Context, Input, Process, and Product) evaluation model, the study involved the program chair, two-course instructors, and 26 students from a public university in Aceh. Research instruments included questionnaires, observation sheets, interview guides, and test items. The findings indicate that the curriculum is relevant to global issues and supports the development of students’ critical thinking skills. However, limited laboratory facilities, insufficient funding, and a lack of support for environment-based projects pose significant challenges to optimal curriculum implementation. Additionally, the program effectively enhances students’ understanding of global environmental issues and their relevance to the SDGs but requires stronger integration of practical applications and explicit connections to SDG targets. Recommendations include project-based learning innovations, cross-sector collaborations, and improvements in facilities and funding to holistically enhance students' environmental literacy and prepare them as sustainability change agents.

Keywords

CIPP Evaluation Model; Environmental Chemistry; Environmental Literacy; Program evaluation; SDGs

Full Text:

PDF

References

Abera, H. G. (2023). The role of education in achieving the Sustainable Development Goals (SDGs): A global evidence based research article. International Journal of Social Science and Education Research Studies, 3(1), 67–81. https://doi.org/10.55677/ijssers/V03I1Y2023-09

Aikowe, L. D., & Mazancova, J. (2023). Pro-environmental awareness of university students – assessment through sustainability literacy test. International Journal of Sustainability in Higher Education, 24(3), 719–741. https://doi.org/10.1108/IJSHE-06-2021-0219

Ajzen, I. (2020). The theory of planned behavior: Frequently asked questions. Human Behavior and Emerging Technologies, 2(4), 314–324. https://doi.org/10.1002/hbe2.195

Andraos, J., & Dicks, A. P. (2013). Green chemistry teaching in higher education: a review of effective practices. Chemistry Education Research and Practice, 13(2), 69–79. https://doi.org/10.1039/C1RP90065J

Anglin, K. L., Krishnamachari, A., & Wong, V. (2020). Methodological Approaches for Impact Evaluation in Educational Settings. Grantee Submission, 1–28. https://doi.org/10.1093/obo/9780199756810-0244

Arif, M. (2024). Bibliometric analysis: Research trends of environmental literacy in higher education from 2019 to 2023. E3S Web of Conferences. Vol. 600, 05004. https://doi.org/10.1051/e3sconf/202460005004

Aripin, N., Kurniati, T., Festiyed, F., Asrizal, A., Diliarosta, S., Helendra, H., & Mufit, F. (2024). Enhancing Critical Thinking Skills and Environmental Awareness through Problem-Based Learning: A Meta-

Analytical Approach. Jurnal Pendidikan MIPA, 25(3), 1496–1513. https://doi.org/10.23960/jpmipa/v25i3.pp1480-1497

Awewomom, J., Dzeble, F., Takyi, Y. D., Ashie, W. B., Ettey, E. N. Y. O., Afua, P. E., Sackey, L. A., Opoku, F., & Akot, O. (2024). Addressing global environmental pollution using environmental control techniques: a focus on environmental policy and preventive environmental management. Discover Environment, 2(1), 8. https://doi.org/10.1007/s44274-024-00033-5

Azrai, E. P., Heryanti, E., Ramadhani, V., & Ilyas, M. (2024). Enhancing students’ pro-environmental behavior through project-based learning. Biosfer: Jurnal Pendidikan Biologi, 17(2). https://doi.org/10.21009/biosferjpb.28352

Bayer, S., Klieme, E., & Jude, N. (2016). Assessment and evaluation in educational contexts. In Assessing contexts of learning: An international perspective (pp. 469–488).

Berglund, T., Gericke, N., Boeve-de Pauw, J., Olsson, D., & Chang, T.-C. (2020). A cross-cultural comparative study of sustainability consciousness between students in Taiwan and Sweden. Environment,

Development and Sustainability, 22(7), 6287–6313. https://doi.org/10.1007/s10668-019-00478-2

Biggs, J., Tang, C., & Kennedy, G. (2022). Teaching for quality learning at university 5e. McGraw-hill education (UK).

Bilderback, S. (2024). Integrating training for organizational sustainability: the application of Sustainable Development Goals globally. European Journal of Training and Development, 48(7), 730–748. https://doi.org/10.1108/EJTD-01-2023-0005

Castellanos, A., Mauricio, P., & Queiruga-Dios, V. (2022). From environmental education to education for sustainable development in higher education: a systematic review. International Journal of Sustainability in Higher Education, 23(3), 622–644. https://doi.org/10.1108/IJSHE-04-2021-0167

Cherdymova, E., Ukolova, L. I., Gribkova, O. V, Kabkova, E. P., Tararina, L. I., Kurbanov, R. A., Belyalova, A. M., & Kudrinskaya, I. V. (2018). Projective Techniques for Student Environmental Attitudes Study. Ekoloji Dergisi, 106, 541–546.

Creswell, J. W., & Clark, V. L. P. (2018). Designing and conducting mixed methods research. Sage publications.

Deiparine, J., Glenn, A., Groenewald, E., Zamora, M., Pansacala, N., & Kilag, O. K. (2023). Enhancing Student Engagement: An Exploration of Five High-Impact Teaching Practices. Excellencia: International Multi-Disciplinary Journal of Education (2994-9521), 1(6), 498–508. https://doi.org/10.5281/zenodo.10442404

Dini, J. (2022). Evaluasi CIPP Penerapan Permendikbud 137 dan 146 Tahun 2014 di Kecamatan Sijunjung. Jurnal Obsesi: Jurnal Pendidikan Anak Usia Dini, 6(4), 2954–2961.

Djuanda, I. (2020). Implementasi evaluasi program pendidikan karakter model CIPP (Context, Input, Process dan Output). Al Amin: Jurnal Kajian Ilmu Dan Budaya Islam, 3(1), 37–53.

Fang, S. C. (2021). The pro-environmental behavior patterns of college students adapting to climate change. Journal of Baltic Science Education, 20(5), 700–715.

Fang, W.-T., Hassan, A., & LePage, B. A. (2023). The living environmental education: Sound science toward a cleaner, safer, and healthier future. Springer Nature.

Firmanshah, M. I., Abdullah, N., & Fariduddin, M. N. (2023). The relationship of school students’ environmental knowledge, attitude, behavior, and awareness toward the environment: a systematic review. International Journal of Academic Research in Progressive Education and Development, 12(1), 432–449. https://doi.org/10.6007/IJARPED/v12-i1/15707

Fitzpatrick, J. L., Sanders, J. R., & Worthen, B. R. (2011). Program evaluation: Alternative approaches and practical guidelines. Boston: Pearson.

Gök, G., & Boncukçu, G. (2023). The Effect of Problem-Based Learning on Middle School Students’ Environmental Literacy and Problem-Solving Skills. Journal of Science Learning, 6(4), 414–423. https://doi.org/10.17509/jsl.v6i4.62781

Goulgouti, A., Plakitsi, A., & Stylos, G. (2019). Environmental literacy: Evaluating knowledge, affect, and behavior of pre-service teachers in

Greece. Interdisciplinary Journal of Environmental and Science Education, 15(1), e02202. https://doi.org/10.29333/ijese/6287

Handoyo, A. F., Sobandi, A., & Bimo, W. A. (2024). Trend and research focus on Problem-Based Learning and learning outcome in the world: A bibliometric analysis. Inovasi Kurikulum, 21(2), 1289–1302. https://doi.org/10.17509/jik.v21i2.69328

Huang, Y., & Chiu, P. (2015). The effectiveness of a meaningful learning‐based evaluation model for context‐aware mobile learning. British Journal of Educational Technology, 46(2), 437–447. https://doi.org/10.1111/bjet.12147

Hungerford, Harold, & Volk, T. (1990). Changing learner behavior through environmental education. Journal of Environmental Education, 21(3), 8–21. https://doi.org/10.1080/00958964.1990.10753716

Hungerford, HR, Litherland, R., Peyton, R., Ramsey, J., & Volk, T. (1990). Investigating and evaluating environ- mental issues and actions: skill development program. Stipes Publishing, Champaign.

Hungerford, HR, & Tomera, A. (1985). Science methods for the elementary school. Stipes Publishing, Champaign.

Idsardi, R. (2020). Evidence-based practices for the active learning classroom. Active Learning in College Science: The Case for Evidence-Based Practice, 13–25. https://doi.org/10.1007/978-3-030-33600-4_2

Jia, F., & Wang, W. (2024). City-level sustainable development impacts on environmental literacy: feelings toward nature, environmental knowledge, and pro-environmental behavior. Environmental Education Research, 30(8), 1263–1278. https://doi.org/10.1080/13504622.2024.2315573

Kasapoğlu, A., & Turan, F. (2008). Attitude‐behaviour relationship in environmental education: a case study from Turkey. International Journal of Environmental Studies, 65(2), 219–231. https://doi.org/10.1080/00207230701502316

Kolb, D. A. (2014). Experiential learning: Experience as the source of learning and development. Pearson Education.

Kolmos, A., Graaff, E. De, & Du, X. (2009). Diversity of PBL–PBL learning principles and models. In Research on PBL practice in engineering education (pp. 9–21). Brill.

Leal Filho, W., Frankenberger, F., Salvia, A. L., Azeiteiro, U., Alves, F., Castro, P., Will, M., Platje, J., Lovren, V. O., Brandli, L., Price, E., Doni, F., Mifsud, M., & Ávila, L. V. (2021). A framework for the implementation of the Sustainable Development Goals in university programmes. Journal of Cleaner Production, 299, 126915. https://doi.org/https://doi.org/10.1016/j.jclepro.2021.126915

Leal Filho, W., Salvia, A. L., & Eustachio, J. H. P. P. (2023). An overview of the engagement of higher education institutions in the implementation of the UN Sustainable Development Goals. Journal of Cleaner Production, 386, 135694. https://doi.org/https://doi.org/10.1016/j.jclepro.2022.135694

Leal Filho, W., Shiel, C., Paço, A., Mifsud, M., Ávila, L. V., Brandli, L. L., Molthan-Hill, P., Pace, P., Azeiteiro, U. M., Vargas, V. R., & Caeiro, S. (2019). Sustainable Development Goals and sustainability teaching at universities: Falling behind or getting ahead of the pack? Journal of Cleaner Production, 232, 285–294. https://doi.org/https://doi.org/10.1016/j.jclepro.2019.05.309

Liang, S.-W., Fang, W.-T., Yeh, S.-C., Liu, S.-Y., Tsai, H.-M., Chou, J.-Y., & Ng, E. (2018). A nationwide survey evaluating the environmental literacy of undergraduate students in Taiwan. Sustainability, 10(6), 1730. https://doi.org/10.3390/su10061730

Liu, S.-Y., Yeh, S.-C., Liang, S.-W., Fang, W.-T., & Tsai, H.-M. (2015). A national investigation of teachers’ environmental literacy as a reference for promoting environmental education in Taiwan. The Journal of Environmental Education, 46(2), 114–132. https://doi.org/10.1080/00958964.2014.999742

Lopes, R. M., Hauser-Davis, R. A., Oliveira, M. M., Pierini, M. F., de Souza, C. A. M., Cavalcante, A. L. M., Santos, C. R. Dos, Comarú, M. W., & da Fonseca Tinoca, L. A. (2020). Principles of problem-based learning for training and professional practice in ecotoxicology. Science of The Total Environment, 702, 134809. https://doi.org/https://doi.org/10.1016/j.scitotenv.2019.134809

Luo, Z., Abbasi, B. N., Yang, C., Li, J., & Sohail, A. (2024). A systematic review of evaluation and program planning strategies for technology integration in education: Insights for evidence-based practice. Education and Information Technologies, 1–35.

Mayer, R. E. (2014). Multimedia Instruction BT - Handbook of Research on Educational Communications and Technology (J Michael Spector, M. D. Merrill, J. Elen, & M. J. Bishop (eds.); pp. 385–399). Springer New York. https://doi.org/10.1007/978-1-4614-3185-5_31

Müderrisoglu, H., & Altanlar, A. (2011). Attitudes and behaviors of undergraduate students toward environmental issues. International Journal of Environmental Science & Technology, 8(1), 159–168. https://doi.org/10.1007/BF03326205

O’Flaherty, J., & Liddy, M. (2018). The impact of development education and education for sustainable development interventions: a synthesis of the research. Environmental Education Research, 24(7), 1031–1049. https://doi.org/10.1080/13504622.2017.1392484

Oestergaard, L. G., Hansen, J. S., Ravn, M. B., & Maribo, T. (2024). Enhancing coherence and student engagement through portfolio assignments and peer-feedback. Discover Education, 3(1), 161. https://doi.org/10.1007/s44217-024-00260-1

Patton, M. Q. (2008). Utilization-Focused Evaluation. Sage Publications.

Prince, M. (2004). Does active learning work? A review of the research. Journal of Engineering Education, 93(3), 223–231. https://doi.org/10.1002/j.2168-9830.2004.tb00809.x

Rachman, I., Rohmawatiningsih, W., & Yayoi, K. (2021). Using Kamishibai Media in Thematic Learning to Increase Students’ Knowledge of Environmental Education. Jurnal Presipitasi : Media Komunikasi Dan Pengembangan Teknik Lingkungan, 18(3), 377–385. https://doi.org/10.14710/presipitasi.v18i3.377-385

Ribeiro-Silva, E., Amorim, C., Aparicio-Herguedas, J. L., & Batista, P. (2022). Trends of active learning in higher education and students’ well-being: A literature review. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.844236

Rossi, P. H., Lipsey, M. W., & Freeman, H. E. (2004). Evaluation: A Systematic Approach. Sage Publications.

Safitri, R., Alnedral, Gusril, Wahyuri, A. S., & Ockta, Y. (2024). The Impacts of the Project-Based Learning and Problem-Based Learning Models with Self-Confidence on Students’ Learning Outcomes . Indonesian Research Journal in Education |IRJE|, 8(1 SE-), 269–283. https://doi.org/10.22437/irje.v8i1.31480

Sajidan, S., Suranto, S., Atmojo, I. R. W., Saputri, D. Y., & Etviana, R. (2022). Problem-based learning-collaboration (PBL-C) model in elementary school science learning in the industrial revolution era 4.0 and Indonesia society 5.0. Jurnal Pendidikan IPA Indonesia, 11(3), 477–488. https://doi.org/10.15294/jpii.v11i3.30631

Sánchez-Carracedo, F., Moreno-Pino, F. M., Sureda, B., Antúnez, M., & Gutiérrez, I. (2019). A Methodology to Analyze the Presence of Sustainability in Engineering Curricula. Case of Study: Ten Spanish Engineering Degree Curricula. In Sustainability (Vol. 11, Issue 17). https://doi.org/10.3390/su11174553

Savery, J. R. (2015). Overview of problem-based learning: Definitions and distinctions.". In Essential readings in problem-based learning: Exploring and extending the legacy of Howard S. Barrows (Vol. 9, Issue 2, pp. 5–15).

Sillanpää, M. E. T. (2020). Grand Challenges in Environmental Chemistry. Frontiers in Environmental Chemistry, 1. https://doi.org/10.3389/fenvc.2020.00001

Spector, Jonathan Michael. (2023). Evaluations of Educational Practice, Programs, Projects, Products, and Policies. Learning, Design, and Technology: An International Compendium of Theory, Research, Practice, and Policy, 1989–2006.

Stufflebeam, D. L. (1971). The relevance of the CIPP evaluation model for educational accountability. In Paper read at the annual meeting of the American Association of School Administrators (pp. 1–31). Atlantic City, New Jersey.

Stufflebeam, D. L. (2023). The CIPP model for evaluation. 2003 Annual Conference of the Oregon Program Evaluators Network (OPEN), 1–68.

Stufflebeam, D. L., & Coryn, C. L. (2014). Evaluation theory, models, and applications. John Wiley & Sons.

Suryawati, E., Suzanti, F., Zulfarina, Z., Putriana, A. R., & Febrianti, L. (2020). The implementation of local environmental problem-based learning student worksheets to strengthen environmental literacy. Jurnal Pendidikan IPA Indonesia, 9(2), 169–178. https://doi.org/10.15294/jpii.v9i2.22892

Tampubolon, M. L. V., & Sipahutar, H. (2024). Development of project-based modules to improve learning outcomes, critical thinking and problem-solving skills. JPBI (Jurnal Pendidikan Biologi Indonesia), 10(2), 531–541. https://doi.org/10.22219/jpbi.v10i2.32958

Tutal, Ö. (2023). Does Context-Based Learning Increase Academic Achievement and Learning Retention?: A Review Based on Meta-Analysis. Journal of Practical Studies in Education, 4(5), 1–16.

Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes (86th ed.). Harvard university press.

Weiss, C. H. (1998). Evaluation: Methods for Studying Programs and Policies. Prentice Hall.

Yusnidar, M., Kurniawan, D. A., Azzahra, M. Z., Putri, F. I., & Prameswari, N. (2023). Effect of learning using the problem-based learning (PBL) model with scaffolding on creative thinking and learning independence. Journal of Southwest Jiaotong University, 58(5), 681–691. https://doi.org/10.35741/issn.0258-2724.58.5.52

Zahra, A. N., Maksum, M. N. R., Chusniatun, C., & Apriantoro, M. S. (2023). Trend Research of Project-Based Learning in The Database Scopus 1964-2023. Proceeding ISETH (International Summit on Science, Technology, and Humanity), 956–967.

Zeng, W., Huang, F., Yu, L., & Chen, S. (2018). Towards a learning-oriented assessment to improve students’ learning - a critical review of literature. Educational Assessment, Evaluation and Accountability, 30, 211–250.

DOI: https://doi.org/10.21831/jpms.v13i1.81825