Developing student social attitude self-assessment instruments: A study in vocational high school

Arief Nurrahman; Sukirno Sukirno; Dwi Setyo Pratiwi; Joni Iskandar; Abdul Rahim; Indah Sari Rahmaini

doi:10.21831/reid.v8i1.45100

Developing student social attitude self-assessment instruments: A study in vocational high school

Arief Nurrahman, Universitas Negeri Yogyakarta, Indonesia
Sukirno Sukirno, Universitas Negeri Yogyakarta, Indonesia
Dwi Setyo Pratiwi, Queensland University of Technology, Australia
Joni Iskandar, University of Nottingham, United Kingdom
Abdul Rahim, Universitas Negeri Yogyakarta, Indonesia
Indah Sari Rahmaini, Universitas Andalas, Indonesia

10.21831/reid.v8i1.45100

Abstract

This study aims to develop a self-assessment instrument in the affective domain of students' social attitudes, which was modified by the case of the instrument item. The measurement results can be used as a recommendation for the self-assessment of students' social attitudes at school. The sampling technique used is cluster random sampling. The instrument was content validated by five experts using Aiken, and construct validation using Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA), while the reliability estimation used Cronbach's Alpha coefficient. The results showed that there were seven instrument factors to assess the affective domain of students' social attitudes, namely honest, disciplined, polite, caring, responsible, responsive, and proactive. Content validity using the Aiken index shows 28 valid items. The construct validity of the instrument was carried out using EFA with a KMO value of 0.618, which means it has met the requirements. The fit model based on the CFA results shows the Chi-square value <2df = 258.02<2x341, p-value = 0.416>0.05, RMSEA = 0.0197<0.08, CFI = 0.91, GFI = 0.86, AGFI = 0.88. In item estimation, the factor loading value is > 0.3, which means the items in the instrument are valid. The estimated reliability of the instrument shows the Cronbach Alpha coefficient value of 0.895, which means that all developed instruments are reliable. Valid and reliable instruments are very important to get good information about the affective assessment of students' social attitudes.

Keywords

instruments; self-assessment; social attitude

Full Text:

PDF

References

Aguiar, A. S., Bataglion, C., Visscher, C. M., Grossi, D. B., & Chaves, T. C. (2017). Cross-cultural adaptation, reliability and construct validity of the Tampa scale for kinesiophobia for temporomandibular disorders (TSK/TMD-Br) into Brazilian Portuguese. Journal of Oral Rehabilitation, 44(7), 500–510. https://doi.org/https://doi.org/10.1111/joor.12515.

Ahmad, Z. (2020). Summative assessment, test scores and text quality: A study of cohesion as an unspecified descriptor in the assessment scale. European Journal of Educational Research, 9(2), 523–535. https://doi.org/10.12973/eu-jer.9.2.523.

Aiken, L. R. (1985). Three Coefficient For Analyzing The Reliability and Validity of Rating. Educational and Psychological Measurement, 45(1), 131–147. https://doi.org/10.1177/0013164485451012

Alimuddin, Z., Tjakraatmadja, J. H., & Ghazali, A. (2020). Developing an instrument to measure pedagogical content knowledge using an action learning method. International Journal of Instruction, 13(1), 425–444. https://doi.org/10.29333/iji.2020.13128a.

Anderson, K. P., Ritter, G. W., & Zamarro, G. (2019). Understanding a vicious cycle: The relationship between student discipline and student academic outcomes. Educational Researcher, 48(5), 251–262. https://doi.org/10.3102/0013189X19848720.

Apsari, Y. (2018). Teachers’ problems and solutions in implementing Curriculum 2013. Journal of English Language Pedagogy, Literature and Culture, 3(1), 11–23. https://doi.org/10.35974/acuity.v3i1.620.

Baidhowi, R. M. (2018). Instrumen penilaian sikap sosial (Studi penilaian sikap sosial pada mata pelajaran Fikih di Jurusan Tehnik dan Bisnis Sepeda Motor SMK Muhammadiyah 1 Patuk). EDUDEENA. https://doi.org/10.30762/ED.V2I1.518.

Brown, M. R. (2007). Educating all students: Creating culturally responsive teachers, classrooms, and schools. Intervention in School and Clinic, 43(1), 57–62. https://doi.org/10.1177/10534512070430010801.

Budiyono. (2019). Pengantar teori pengukuran pendidikan. UNS Press.

Christensen, R., & Knezek, G. (2015). The climate change attitude survey: Measuring middle school student beliefs and intentions to enact positive environmental change. International Journal of Environmental and Science Education, 10(5), 773–788. https://doi.org/10.12973/ijese.2015.276a.

Cramer, D. (2003). Advance quantitative data analysis. McGraw-Hill Education.

Crant, J. M. (2000). Proactive behavior in organizations. Journal of Management, 26(3), 435–462. https://doi.org/10.1177/014920630002600304.

Croasmun, J. T. (2011). Using Likert-type scales in the social sciences. Journal of Adult Education, 40(1), 19-22.

Directorate of Vocational High Schools. (2018). Panduan penilaian hasil belajar dan pengembangan karakter pada sekolah menengah kejuruan. Directorate of Vocational High Schools.

Feldt, L. S. , & Brennan, R. L. (1989). Reliability. In R. L. Linn (Ed.), Educational measurement. Macmillan.

Fenu, I. K., Amponsah, S., & Nkum, W. K. (2021). Familial, societal and situational factors influencing career choice among adult learners in Ghana. Journal of Interdisciplinary Studies in Education, 10, 125–145. https://www.ojed.org/index.php/jise/article/view/2783

Ferdinand, A. (2002). Structural equation modelling dalam peneltian manajemen. Universitas Diponegoro.

Field, A. (2009). Discovering statistics using SPSS (3rd ed.). SAGE Publication.

Ford, J., & Ford, S. S. (1989). A caring attitude and academic advising. NACADA Journal, 9(2), 43–48. http://meridian.allenpress.com/nacada-journal/article-pdf/9/2/43/2224610/0271-9517-9_2_43.pdf.

Givens, S. M. (2010). Using affective assessment to understand our students’ identities as readers (and non-readers). Inquiry: The Journal of the Virginia Community Colleges, 15(1), 5-19. https://commons.vccs.edu/inquiry/vol15/iss1/2/.

Gonulal, T. (2019). The development and validation of an attitude towards MALL instrument. Educational Technology Research and Development, 67(3), 733–748. https://doi.org/10.1007/s11423-019-09663-6.

Hadi, S., & Andrian, D. (2018). Detecting teacher difficulties in implementing the local curriculum developed by the local government. New Educational Review, 53(3), 250–260. https://doi.org/10.15804/tner.2018.53.3.21.

Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate data analysis: Global perpective (7th ed.). Pearson.

Hardiana, M., & Sano, A. (2019). Student discipline levels on sSchool rules and their implications in guidance and counseling. Jurnal Neo Konseling, 1(2), 1-5. http://neo.ppj.unp.ac.id/index.php/neo/article/view/107.

Hasanah, H., Nurjaya, I. G., & Astika, M. (2017). Pengintegrasian sikap spiritual dan sikap sosial dalam pembelajaran teks ulasan film/drama di kelas XI MIPA SMA Negeri 3 Singaraja. Jurnal Pendidikan Bahasa dan Sastra Indonesia Undiksha, 7(2). https://ejournal.undiksha.ac.id/index.php/JJPBS/article/view/11579.

Hill, J. L., Kern, M. L., Seah, W. T., & van Driel, J. (2021). Feeling good and functioning well in Mathematics Education: Exploring students’ conceptions of mathematical well-being and values. ECNU Review of Education, 4(2), 349–375. https://doi.org/10.1177/2096531120928084.

Jöreskog, K. G., & Sörbom, D. (1993). LISREL 8: Structural equation modeling with the SIMPLIS command language. Scientific Software International.

Julia, J., & Supriyadi, T. (2018). The implementation of character education at senior high school. SHS Web of Conferences, 42, 00085. https://doi.org/10.1051/shsconf/20184200085.

Kabha, R. (2019). Cognitive, affective, social and cultural aspects of teaching and learning in media studies. European Journal of Educational Research, 8(4), 1287–1294). https://doi.org/10.12973/eu-jer.8.4.1287.

Kaiser, H. F. (1960). The application of electronic computers to factor analysis. Educational and Psychological Measurement, 20(1), 141-151. https://doi.org/10.1177/001316446002000116.

Kartowagiran, B., Wibawa, E. A., Alfarisa, F., & Purnama, D. N. (2019). Can student assessment sheets replace observation sheets? Cakrawala Pendidikan, 38(1), 33–44. https://doi.org/10.21831/cp.v38i1.22207.

Kazu, İ. Y., & İş, A. (2018). An investigation about actualization levels of learning outcomes in early childhood curriculum. Journal of Education and Training Studies, 6(3), 66-77. https://doi.org/10.11114/jets.v6i3.2928.

Kesuma, D., Triatna, C., & Permana, J. (2011). Pendidikan karakter: Kajian teori dan praktik di sekolah (1st ed.). Remaja Rosdakarya.

Lee, C.-S., & Wong, K.-S. D. (2015). Developing a disposition for social innovations: An affective-socio-cognitive co-design model. In The 12th International Conference on Cognition and Exploratory Learning in Digital Age (CELDA 2015), 180-186. https://www.iadisportal.org/digital-library/developing-a-disposition-for-social-innovations-an-affective-socio-cognitive-co-design-model.

Lewis, R. (2001). Classroom discipline and student responsibility: The students’ view. Teaching and Teacher Education, 17(3), 307-319. https://doi.org/10.1016/S0742-051X(00)00059-7.

Luiselli, J. K., Putnam, R. F., Handler, M. W., & Feinberg, A. B. (2005). Whole-school positive behaviour support: Effects on student discipline problems and academic performance. Educational Psychology, 25(2-3), 183–198. https://doi.org/10.1080/0144341042000301265.

Mack, K. M., & Reyes-Chua, E. (2019). An evaluation of student discipline of Emilio Aguinaldo College – Cavite: A basis for continual improvement. Asian Journal of Interdisciplinary Research, 18–29. https://doi.org/10.34256/ajir1932.

Mahmud, M. (2018). Exploring students’ politeness perspectives at the State University of Makassar. Journal of Education and Learning (EduLearn), 12(1), 36–43. https://doi.org/10.11591/edulearn.v12i1.6926.

Majid, A. (2017). Penilaian autentik proses dan hasil pembelajaran. Remaja Rosdakarya.

Major, D. A., Turner, J. E., & Fletcher, T. D. (2006). Linking proactive personality and the big five to motivation to learn and development activity. Journal of Applied Psychology, 91(4), 927–935. https://doi.org/10.1037/0021-9010.91.4.927.

Makela, S., Si, Y., & Gelman, A. (2018). Bayesian inference under cluster sampling with probability proportional to size. Statistics in Medicine, 37(26), 3849–3868. https://doi.org/10.1002/sim.7892.

Malloy, L. C., Mugno, A. P., Waschbusch, D. A., Pelham, W. E., & Talwar, V. (2019). Parents’ attitudes about and socialization of honesty and dishonesty in typically-developing children and children with disruptive behavior disorders. Journal of Abnormal Child Psychology, 47(2), 299–312. https://doi.org/10.1007/s10802-018-0444-4.

Mardapi, D. (2017). Pengukuran, penilaian, dan evaluasi pendidikan (2nd ed.). Parama.

Mu’awanah, E., Hidayah, N., Sulistyorini, S., & Hidayah, R. (2020). Learning decision and spiritual based skills for adult education. International Journal of Instruction, 13(3), 805–826. https://doi.org/10.29333/iji.2020.13354a.

Mustari, M. (2014). Nilai karakter refleksi untuk pendidikan. Raja Grafindo Persada.

Nanda, D. W. (2019). Is the Study Abroad (SA) program important for Indonesian students? English Language Teaching, 12(8), 69-78. https://doi.org/10.5539/elt.v12n8p69.

Nejad, A. M., & Mahfoodh, O. H. A. (2019). Assessment of oral presentations: Effectiveness of self-, peer-, and teacher assessments. International Journal of Instruction, 12(3), 615–632. https://doi.org/10.29333/iji.2019.12337a.

Nunnally, J. C. & Bernstein, I. H. (1994). Psychometric theory (3rd ed.). McGraw Hill.

Oetomo, H. (2012). Pedoman dasar pendidikan budi pekerti. Prestasi Pustakaraya.

Otaya, L. G., Kartowagiran, B., & Retnawati, H. (2020). The construct validity and reliability of the lesson plan assessment instrument in primary schools. Jurnal Prima Edukasia, 8(2), 126–134. https://doi.org/10.21831/jpe.v8i2.33275.

Parker, S. K., Williams, H. M., & Turner, N. (2006). Modeling the antecedents of proactive behavior at work. Journal of Applied Psychology, 91(3), 636–652. https://doi.org/10.1037/0021-9010.91.3.636.

Payan, J., Reardon, J., & McCorkle, D. E. (2010). The effect of culture on the academic honesty of marketing and business students. Journal of Marketing Education, 32(3), 275–291. https://doi.org/10.1177/0273475310377781

Pedhazur, E. J. (1997). Multiple regression in behavioral research: Explanation & prediction. Harcourt Brace College.

Puspitasari, D. N., Mardila, D., & Kirana, K. (2018). School curriculum and parents’ support on kindergarten students’ caring attitude. Jurnal Varidika: Kajian Penelitian Pendidikan, 30(2), 27–35. https://doi.org/10.23917/varidika.v30i2.7574.

Regulation of the Minister of Education and Culture of the Republic of Indonesia No. 69 of 2013 concerning the Basic Framework and Structure of the Senior High School/Madrasah Aliyah Curriculum. (2013). Retrieved on November 4, 2021, from https://simpuh.kemenag.go.id/regulasi/permendikbud_69_13.pdf.

Retnawati, H. (2016). Analisis kuantitatif instrumen penelitian (Panduan peneliti, mahasiswa, dan psikometrian). Parama Publishing.

Retnawati, H., Hadi, S., & Nugraha, A. C. (2016). Vocational high school teachers’ difficulties in implementing the assessment in Curriculum 2013 in Yogyakarta Province of Indonesia. International Journal of Instruction 9(1), 33-48. https://doi.org/10.12973/iji.2016.914a.

Rivai, M., Yusri, Y., & Umar, N. F. (2019). The development of the instrument of politeness in the language used by teachers in the learning process. In The Proceedings of the 1st International Conference on Advanced Multidisciplinary Research (ICAMR 2018). https://doi.org/10.2991/icamr-18.2019.67.

Rohmatulloh, A., Prasetyo, Z. K., & Pambudi, H. A. (2019). Implementation of the 2013 Curriculum for science learning. Mimbar Sekolah Dasar, 6(1), 105-115. https://doi.org/10.17509/mimbar-sd.v6i1.15912.

Rusijono, R., Jaedun, A., Kartowagiran, B., Ahman, A., Laliyo, L. A. R., & Mam, S. (2020). Developing the teacher’s social competency assessment instrument in the fourth industrial revolution era. Jurnal Penelitian Dan Evaluasi Pendidikan, 24(2), 125-135. https://doi.org/10.21831/pep.v24i2.29482.

Sarah, S., Prasetyo, Z. K., & Wilujeng, I. (2019). Development of living values (honesty) assessment instrument in learning process. International Journal of Instruction, 12(4), 443–458. https://doi.org/10.29333/iji.2019.12429a.

Schoen, R. C., Bray, W., Wolfe, C., Tazaz, A., & Nielsen, L. (2017). Developing an assessment instrument to measure early elementary teachers’ mathematical knowledge for teaching. The Elementary School Journal, 188(1), 55-81. https://doi.org/10.1086/692912.

Seibert, S. E., Grant, J. M., & Kraimer, M. L. (1999). Proactive personality and career success. Journal of Applied Psychology, 84(3), 416-427. https://doi.org/10.1037/0021-9010.84.3.416.

Setiadi, H. (2016). Pelaksanaan penilaian pada Kurikulum 2013. Jurnal Penelitian Dan Evaluasi Pendidikan, 20(2), 166–178. https://doi.org/10.21831/pep.v20i2.7173.

Setiawan, A., Mardapi, D., Supriyoko, & Andrian, D. (2019). The development of instrument for assessing students’ affective domain using self- and peer-assessment models. International Journal of Instruction, 12(3), 425–438. https://doi.org/10.29333/iji.2019.12326a.

Setiawan, A., & Suardiman, S. P. (2018). Assessment of the social attitude of primary school students. REID (Research and Evaluation in Education), 4(1), 12–21. https://doi.org/10.21831/reid.v4i1.19284.

Stančić, M. (2021). Peer assessment as a learning and self-assessment tool: A look inside the black box. Assessment and Evaluation in Higher Education, 46(6), 852–864. https://doi.org/10.1080/02602938.2020.1828267.

Sumarti, S., Sahayu, W., & Triyono, S. (2020). What is maaf for in the Indonesian language? A study of its use in written sources. Studies in English Language and Education, 7(2), 592–606. https://doi.org/10.24815/siele.v7i2.16637.

Sumartono, S., & Sridevi, H. (2016). Mengembangkan karakter tanggung jawab siswa melalui pembelajaran Model Kooperatif tipe Number Head Together. EDU-MAT: Jurnal Pendidikan Matematika, 4(2). http://dx.doi.org/10.20527/edumat.v4i2.2579.

Tabi’in, A. (2017). Menumbuhkan sikap peduli pada anak melalui interaksi kegiatan sosial. Jurnal Ijtimaiyah, 1(1), 39-59. http://dx.doi.org/10.21043/ji.v1i1.3100.

Tentama, F., & Riskiyana, E. R. (2020). The role of social support and self-regulation on work readiness among students in vocational high school. International Journal of Evaluation and Research in Education, 9(4), 826–832. https://doi.org/10.11591/ijere.v9i4.20578.

Torka, N. (2019). Honesty and genuine happiness: Or why soft healers make stinking wounds (Dutch proverb). British Journal of Guidance and Counselling, 47(2), 200–209. https://doi.org/10.1080/03069885.2018.1453600.

Tuluk, A., & Yurdugül, H. (2020). Design and development of a web based dynamic assessment system to increase students’ learning effectiveness. International Journal of Assessment Tools in Education, 7(4), 631–656. https://doi.org/10.21449/ijate.730454.

Wagiran. (2015). Metodologi penelitian pendidikan: Teori dan implementasi. Deepublish.

Yan, Z., & Cheng, E. C. K. (2015). Primary teachers’ attitudes, intentions and practices regarding formative assessment. Teaching and Teacher Education, 45, 128–136. https://doi.org/10.1016/j.tate.2014.10.002.

Yasmin, F. L., Santoso, A., & Utaya, S. (2016). Hubungan disiplin dengan tanggung jawab belajar siswa. Jurnal Pendidikan: Teori, Penelitian, Dan Pengembangan, 1(4), 692–697. http://journal.um.ac.id/index.php/jptpp/article/view/6226.

Yilmaz, E. O., & Yurdugul, H. (2016). Design and effects of a concept focused discussion environment in e-learning. Eurasian Journal of Educational Research, 63, 353–374. https://ejer.com.tr/design-and-effects-of-a-concept-focused-discussion-environment-in-e-learning/.

Zhang, J., Paulhus, D. L., & Ziegler, M. (2018). Personality predictors of scholastic cheating in a Chinese sample. Educational Psychology, 39(5), 572-590. https://doi.org/10.1080/01443410.2018.1502414.

Zuchdi, D., & Ode, S. L. (2013). Pendidikan karakter: Konsep dasar dan implementasi di perguruan tinggi. UNY Press.

DOI: https://doi.org/10.21831/reid.v8i1.45100