Psychometric evaluation of a social-emotional competence assessment instrument for high school students: Evidence of construct validity and reliability
DOI:
https://doi.org/10.21831/reid.v11i2.89685Keywords:
social emotional competence, confirmatory factor analysis, instrument development, assessment instrumentAbstract
Social Emotional Competence (SEC) was one of the essential competencies in 21st-century education, playing a crucial role in students’ personal and social development. However, valid and reliable instruments for assessing SEC for high school students in Indonesia were still limited. The instrument used in this study was adapted from the CASEL framework, which encompassed five core competencies: self-awareness, self-management, social awareness, relationship skills, and responsible decision-making. The adaptation process involved contextual and linguistic adjustments to align with the characteristics of Indonesian students. This study aimed to examine the validity and reliability of the adapted SEC assessment instrument. The research subjects consisted of 220 high school students in Demak who responded to a questionnaire. This study was categorized as descriptive quantitative. Construct validity was tested using CFA, while reliability was estimated using Cronbach’s alpha. The construct validity test produced model feasibility indices with CFI = 0.928, TLI = 0.9109, SRMR = 0.0534, and RMSEA = 0.0601. These results indicated that the measurement model demonstrated good feasibility. Based on the CFA analysis, 25 items were declared valid. Of these, 22 items had loading factor values greater than 0.5, while 3 items had loading factor values below 0.5. Despite the lower factor loadings, these 3 items were retained because they represented essential indicators. However, the item statements were revised to improve clarity and better represent the intended construct. The internal consistency reliability test showed a Cronbach’s alpha coefficient of 0.942. Since the coefficient value exceeded 0.70, the instrument could be considered reliable.
References
Assessment Work Group. (2019). Student social and emotional competence assessment: The current state of the field and a vision for its future. Chicago, IL: Collaborative for Academic, Social, and Emotional Learning
Astuti, S., Pramudiani, P., Masykuroh, K., & Ulfah, S. (2021). Sinergitas guru dan orang tua dalam integrasi nilai karakter pada pembelajaran daring di masa pandemi COVID 19. Jurnal Pendidikan Karakter, 12(1), 117–133.
Atwell, M., & Bridgeland, J. (2019). Ready to lead: A 2019 update of principals’ perspectives on how social and emotional learning can prepare children and transform schools. Washington, DC: Civic Enterprises.
Azwar, S. (2015). Dasar dasar Psikometrika (Edisi ke 2). Yogyakarta: Pustaka Pelajar.
Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. A. Bollen & J. S. Long (Eds.), Testing Structural Equation Models (pp. 136–162). Sage Publications.
Byrne, B. M. (2010). Structural equation modeling with AMOS: Basic concepts, applications, and programming (2nd ed.). New York, NY: Routledge.
CASEL (2020). Compendium of SEL Assessment Measures. Collaborative for Academic, Social, and Emotional Learning. Retrieved from: https://casel.org
Ching, L. M., Yeo, K. J., & Jaffri, H. (2015). Developing discipline among students through social-emotional learning: A new model to prevent and reduce behavior problems. Journal of Education and Vocational Research, 6(2), 80–90.
Cipriano, C., Barnes, T., Pyle, S., & Rivers, S. E. (2020). Supporting SEL implementation in diverse contexts: The role of adaptation. CASEL Brief Series. https://casel.org
Cipriano, C., Ha, C., Wood, M., Sehgal, K., McCarthy, M. F., Strambler, M. J., Naples, L. H., Eveleigh, A., Ponnock, A., Chow, J. C., Durlak, J., & Funaro, M. (2024). A systematic review and meta-analysis of the effects of universal school-based SEL programs in the United States: Considerations for marginalized students. Social and Emotional Learning: Research, Practice, and Policy, 3, 100029.
Department for Education and Skills. (2005). Excellence and enjoyment: Social and emotional aspects of learning (SEAL): Guidance. Nottingham: DfES Publications.
Durlak, J. A., Domitrovich, C. E., Weissberg, R. P., & Gullotta, T. P. (Eds.). (2020). Handbook of social and emotional learning: Research and practice. The Guilford Press.
Durlak, J. D., Domitrovich, C. E., Weissberg, R. P., & Gullotta, T. P. (Eds.) (2015). Handbook of social and emotional learning: Research and practice. New York, NY: The Guilford Press. Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82, 405-432.
Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50.
Ghozali, I. (2017). Model Persamaan Struktural: Konsep dan Aplikasi dengan Program AMOS 24. Semarang: Badan Penerbit Universitas Diponegoro.
Goleman, D. (2006). Emotional Intelligence: Why It Can Matter More Than IQ (10th Anniversary ed.). Bantam Books.
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis (7th ed.). Pearson Prentice Hall.
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55.
Jofipasi, R.A. (2019) Pengembangan Instrument Asesmen Pilihan Karir Bagi Siswa Tuna Grahita Di Sekolah Menengah Atas Luar Biasa Kota Padang. [Tesis Magister, Universitas Negeri Yogyakarta].
John, O. P., Naumann, L. P., & Soto, C. J. (2008). Paradigm shift to the integrative Big Five trait taxonomy. In Handbook of personality: Theory and research (3rd ed., pp. 114–158). Guilford Press.
Khumaedi, M. (2012). Reliabilitas instrumen penelitian pendidikan. Jurnal Pendidikan Teknik Mesin, 12(1), 25–30.
Mahoney, J. L., Durlak, J. A., & Weissberg, R. P. (2018). An update on social and emotional learning outcome research. Phi Delta Kappan, 100(4), 18–23.
Mahoney, J. L., Durlak, J. A., & Weissberg, R. P. (2019). An update on social and emotional learning outcome research. Phi Delta Kappan, 100, 18-23.
Martinez-Yarza, N., Santibáñez, R., & Solabarrieta, J. (2023). A Systematic Review of Instruments Measuring Social and Emotional Skills in School-Aged Children and Adolescents. Child Indicators Research , 16 (4), 1475–1502.
McCormick, M. P., Cappella, E., O’Connor, E. E., & McClowry, S. G. (2015). Social-emotional learning and academic achievement: Using causal methods to explore classroom-level mechanisms. AERA Open, 1(3), 1–26.
Morris, A. S., Hays-Grudo, J., Zapata, M. I., Treat, A. E., & Kerr, K. L. (2018). Adverse childhood experiences, positive childhood experiences, and child well-being in a longitudinal study of children. Child Development, 89(5), 1808–1825.
O’Conner, R., De Feyter, J., Carr, A., Luo, J. L., & Romm, H. (2017). A review of the literature on social and emotional learning for students ages 3–8: Characteristics of effective social and emotional learning programs (Part 1 of 4). U.S. Department of Education.
OECD. (2015). Skills for Social Progress: The Power of Social and Emotional Skills. OECD Publishing. https://doi.org/10.1787/9789264226159-en
OECD. (2021). Beyond Academic Learning: First Results from the Survey of Social and Emotional Skills. OECD Publishing. https://doi.org/10.1787/92a11084-en
Petric, E.; Szamoskozi, S. (2018). Translation and adaptation of the social-emotional competence questionnaire for hungarian population. In Proceedings of the 5th International Multidisciplinary Scientific Conference on Social Sciences and Arts, Sofia, Bulgaria, 24 August–2 September 2018; Available online: https://n9.cl/guao (accessed on 14 November 2020).
Prawita, E., & Heryadi, A. (2023). Analisis validitas konstrak dan analisis konsistensi internal pada skala resiliensi. PSIMPHONI: Jurnal Psikometri dan Psikologi, 4(1), 8–19.
Rahayu, E.W.; Mustikasari, D.S. The Significant Role of Culture to Value Differences: Socio-Emotional Challenge in Digital Era. In Proceedings of the 5th ASEAN Conference on Psychology, Counselling, and Humanities (ACPCH 2019), Gelugor, Malaysia, 2–3 November 2019; Atlantis Press: Paris, France, (2020), 234–239.
Rahmi et al (2021). Confirmatory Factor Analysis pada Indikator Kesembuhan Pasien Isolasi Mandiri Covid-19 di Indonesia. Universitas Islam Bandung
Rahmi et al.,. (2022). Confirmatory Factor Analysis pada Indikator Kesembuhan Pasien Isolasi Mandiri Covid-19 di Indonesia. Statistika, 22(1), 13-23
Rahmi, N. S. (2015). Analisis pengaruh dukungan motivasi dan pengetahuan terhadap tindakan penyembuhan penderita penyakit Tuberculosis (TB) di pesisir Surabaya dengan pendekatan SEM (Structural equation modelling) [Institut Teknology Sepuluh Nopember].
Rose-Krasnor, L. (1997). The nature of social competence: A theoretical review. Social Development, 6(1), 111–135. https://doi.org/10.1111/j.1467-9507.1997.tb00097.x
Schumacker, R. E., & Lomax, R. G. (2016). A Beginner's Guide to Structural Equation Modeling (4th ed.). New York: Routledge.
Soto, C. J., & John, O. P. (2017). The next Big Five Inventory (BFI-2): Developing and assessing a hierarchical model with 15 facets to enhance bandwidth, fidelity, and predictive power. Journal of Personality and Social Psychology, 113(1), 117–143. https://doi.org/10.1037/pspp0000096
Sriyono, & Purwoko, R. Y. (2022). Confirmatory Factor Analysis Instrumen Sikap Sosial Sains Siswa SMA. Jurnal Evaluasi Pendidikan, 13(2), 131–137.
Sugiyono. (2015). Metode penelitian pendidikan: Pendekatan kuantitatif, kualitatif, dan R&D (Cetakan ke 21, Februari). Bandung: Alfabeta.
Sugiyono. (2017). Metode penelitian pendidikan: Pendekatan kuantitatif, kualitatif, dan R&D. Bandung: Alfabeta. (Edisi terbaru dalam 2017—sesuaikan cetakan Anda jika berbeda.)
Sugiyono. (2019). Metode Penelitian Pendidikan (Pendekatan Kuantitatif, Kualitatif, dan R&D). Bandung: Alfabeta.
Syafitri, W. (2017). Confirmatory Factor Analysis (CFA) Model Penerimaan Teknologi Berbasis Keamanan Informasi. SITEKIN: Jurnal Sains, Teknologi dan Industri, 14(2), 157-168.
Taylor, R., Oberle, E., Durlak, J. A., & Weissberg, R. P. (2017.). Promoting positive youth development through school-based social and emotional learning interventions: A meta-analysis of follow-up effects. Child Development, 88, 1156–1171
Wafturrohmah, E., & Sulistyawati, I. (2018). The Relationship between Anxiety Levels of Primigravida Mothers in the Third Trimester and the Incidence of Premature Birth at Jetis Health Center, Yogyakarta. Respati Medical Journal , 13 (3), 296–301.
Zhou, M., & Ee, J. (2012). Development of the Social Emotional Competence Questionnaire (SECQ). The International Journal of Emotional Education, 4, 27–42.
Zins, J. E., Weissberg, R. P., Wang, M. C., & Walberg, H. J. (2004). Building academic success on social and emotional learning: What does the research say? Teachers College Press.
Zych, I.; Ortega-Ruiz, R.; Muñoz-Morales, R.; Llorent, V.J.; De Córdoba, U. (2018). Dimensions and Psychometric Properties of the Social and Emotional Competencies Questionnaire (SEC-Q) in youth and adolescents. Rev. Latinoam. Psicol. 50, 98–106
Published
How to Cite
Issue
Section
Citation Check
License
Copyright (c) 2025 REID (Research and Evaluation in Education)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
The authors submitting a manuscript to this journal agree that, if accepted for publication, copyright publishing of the submission shall be assigned to REID (Research and Evaluation in Education). However, even though the journal asks for a copyright transfer, the authors retain (or are granted back) significant scholarly rights.
The copyright transfer agreement form can be downloaded here: [REID Copyright Transfer Agreement Form]
The copyright form should be signed originally and sent to the Editorial Office through email to reid.ppsuny@uny.ac.id
REID (Research and Evaluation in Education) by http://journal.uny.ac.id/index.php/reid is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
.png)
