Validity, reliability, and item characteristics of cell material science literacy assessment instruments

Asrizal Wahdan Wilsa; Ani Rusilowati; Endang Susilaningsih; Jaja Jaja; Veni Nurpadillah

doi:10.21831/pep.v27i2.61577

Validity, reliability, and item characteristics of cell material science literacy assessment instruments

Asrizal Wahdan Wilsa, STKIP Nahdlatul Ulama Indramayu, Indonesia
Ani Rusilowati, Universitas Negeri Semarang, Indonesia
Endang Susilaningsih, Universitas Negeri Semarang, Indonesia
Jaja Jaja, Universitas Swadaya Gunung Jati Cirebon, Indonesia
Veni Nurpadillah, IAIN Syekh Nurjati Cirebon, Indonesia

10.21831/pep.v27i2.61577

Abstract

This study aims to examine the validity, reliability, and item characteristics of scientific literacy assessment instruments on cell material. The scientific literacy ability category includes identifying valid scientific arguments, evaluating the validity of a source, evaluating the use and misuse of scientific information, understanding research design elements and how they impact scientific findings, and reading and interpreting graphical representations of data. The research subjects were students of the 5th semester elementary school teacher education study program. The validity test included content validity using Aiken V validity index and construct validity using Exploratory Factor Analysis (EFA). Reliability test is carried out by looking for the price of the reliability coefficient r with correlation product moment test. The characteristic test is carried out by determining the level of difficulty and discriminating power. The results show that the scientific literacy assessment instrument on cell material is a valid instrument based on the analysis of content validity, construct validity, and item characteristics. Thus, the assessment instrument is suitable for use as an assessment instrument in research to measure students' scientific literacy in cell material.

Keywords

Instrument; Item Characteristics; Science Literacy; Reliability; Validity

Full Text:

PDF

References

Afriana, J., Permanasari, A., & Fitriani, A. (2016). Project Based Learning Integrated to STEM to Enhance Elementary School’s Students Scientific Literacy. Jurnal Pendidikan IPA Indonesia, 5(2), 261–267. https://doi.org/10.15294/JPII.V5I2.5493

Aiken, L. R. (1985). Three Coefficients for Analyzing the Reliability and Validity of Ratings. 45(1), 131–142. https://doi.org/10.1177/0013164485451012

Amir, I. (2017). Pengembangan Buku Ajar dan Augmented Reality Pada Konsep Sistem Pencernaan di Sekolah Menengah Atas. In Universitas Negeri Makassar. Universitas Negeri Makassar.

Arifin, Z. (2012). Evaluasi Pembelajaran. PT. Remaja Rosdakarya.

Arikunto, S. (2008). Prosedur Penelitian Suatu Pendekatan Praktek. Rineka Cipta.

Arikunto, S. (2012). Prosedur Penelitian. Rineka Cipta.

Bashooir, K., Bashooir, K., & Supahar, S. (2018). Validitas dan reliabilitas instrumen asesmen kinerja literasi sains pelajaran fisika berbasis STEM. Jurnal Penelitian Dan Evaluasi Pendidikan, 22(2), 219–230. https://doi.org/10.21831/pep.v22i2.19590

Elviana, E. (2020). Analisis Butir Soal Evaluasi Pembelajaran PAI Menggunakan Program Anates. Jurnal MUDARRISUNA: Media Kajian Pendidikan Agama Islam, 10(2), 209–224. https://doi.org/10.22373/JM.V10I2.7839

Fadloli, Pamungkas, R., Sumarjoko, T., & Marlina, R. (2023). Analisis Faktor Pengembangan Instrumen Pengukuran Keterampilan Abad 21 Siswa Sekolah Menengah Atas. JIIP - Jurnal Ilmiah Ilmu Pendidikan, 6(3), 1995–2003. https://doi.org/10.54371/JIIP.V6I3.1802

Fraenkel, J. R., Wallen, N. E., & Hyun, H. H. (2012). How to DesIgn and Evaluate Research in EducatIon (8th ed.). Mc Graw HIll.

Fu’adah, H., Rusilowati, A. (2017). Pengembangan Alat Evaluasi Literasi Sains untuk Mengukur Kemampuan Literasi Sains Siswa Bertema Perpindahan Kalor dalam Kehidupan. Lembaran Ilmu Kependidikan, 46(2), 51–59. https://doi.org/10.15294/lik.v46i2.11350

Gormally, C., Brickman, P., & Lut, M. (2012). Developing a test of scientific literacy skills (TOSLS): Measuring undergraduates’ evaluation of scientific information and arguments. CBE Life Sciences Education, 11(4), 364–377. https://doi.org/10.1187/CBE.12-03-0026/ASSET/IMAGES/LARGE/364FIG4.JPEG

Hapsari, E. E., Sumantri, M. S., & Astra, I. M. (2019). Strategi Guru Meningkatkan Hasil Belajar Menggunakan Pendekatan Saintifik di Sekolah Dasar. Jurnal Basicedu, 3(3), 850–860. https://doi.org/10.31004/BASICEDU.V4I1.171

Helendra, H., & Sari, D. R. (2021). Pengembangan Instrumen Asesmen Berbasis Literasi Sains Tentang Materi Sistem Ekskresi dan Sistem Pernapasan. Jurnal Ilmiah Pendidikan Profesi Guru, 4(1), 17–25. https://doi.org/10.23887/JIPPG.V4I1.29860

Holbrook, J., & Rannikmae, M. (2009). The Meaning of Scientific Literacy. International Journal of Environmental and Science Education, 4(3), 275–288. http://www.ijese.com/

Iantovics, L. B., Rotar, C., & Morar, F. (2019). Survey on establishing the optimal number of factors in exploratory factor analysis applied to data mining. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 9(2), e1294. https://doi.org/10.1002/WIDM.1294

Khayati, D. N., & Raharjo. (2020). Pengembangan Instrumen Tes Berbasis Literasi Sains untuk Memetakan Critical Thinking dan Practical Skills Siswa pada Materi Sistem Peredaran Darah Kelas XI SMA. Berkala Ilmiah Pendidikan Biologi (BioEdu), 9(3), 433–442. https://doi.org/10.26740/BIOEDU.V9N3.P433-442

Kusuma Putri, R., Pendidikan, Y., & Medan, S. A. (2020). Pengembangan Instrumen Tes Literasi Sains Siswa Pada Topik Keanekaragaman Makhluk Hidup. Diklabio: Jurnal Pendidikan Dan Pembelajaran Biologi, 4(1), 71–78. https://doi.org/10.33369/DIKLABIO.4.1.71-78

Lestari, D., & Setyarsih, W. (2020). Kelayakan Instrumen Penilaian Formatif Berbasis Literasi Sains Peserta Didik pada Materi Pemanasan Global. IPF: Inovasi Pendidikan Fisika, 9(3), 561–570. https://doi.org/10.26740/IPF.V9N3.P561-570

Mardapi, D. (2008). Teknik Penyusunan Instrumen Tes dan Non Tes. Mitra Cendikia Offset.

Martinah, A. A., Mubarok, V., Miarsyah, M., Ristanto, R. H. (2022). Pengembangan Instrumen Tes Literasi Sains Berbasis Kontekstual pada Materi Pencemaran Lingkungan. Bioedusiana: Jurnal Pendidikan Biologi, 6(2), 192–218. https://doi.org/10.37058/bioed.v6i2.3251

Mayasari, T., Kadarohman, A., Rusdiana, D., & Kaniawati, I. (2016). Apakah Model Pembelajaran Problem Based Learning dan Project Based Learning Mampu Melatihkan Keterampilan Abad 21? Jurnal Pendidikan Fisika Dan Keilmuan (JPFK), 2(1), 48–55. https://doi.org/10.25273/JPFK.V2I1.24

Nyoman, N., & Handayani, L. (2015). Membangun Masyarakat Melek Sains Berkarakter Bangsa Melalui Pembelajaran. Prosiding Seminar Nasional MIPA. https://ejournal.undiksha.ac.id/index.php/semnasmipa/article/view/10307

OECD. (2015). PISA 2015 Result in Focus. Paris: OECD-PISA. https://www.oecd.org/pisa/pisa-2015-results-in-focus.pdf

OECD. (2019). PISA 2018 Results (Volume I): What Students Know and Can Do. In OECD Publishing: Vol. III.

Purwanto, Dr. (2004). Analisis Faktor: Konsep, Prosedur Uji dan Interpretasi. Jurnal Teknodik, 153–169. https://doi.org/10.32550/TEKNODIK.V4I15.388

Putri, A. A. A., Hussain, H., & Ramdhani. (2022). Pengembangan Instrumen Tes Literasi Sains Pada Dimensi Pengetahuan Materi Asam Basa. SCIENCE: Jurnal Inovasi Pendidikan Matematika Dan IPA, 2(4), 536–547. https://doi.org/10.51878/SCIENCE.V2I4.1797

Ridwan, M., Mardhiyyah, L. A., & Rusilowati, A. (2015). Pengembangan Instrumen Asesmen Dengan Pendekatan Kontekstual untuk Mengukur Level Literasi Sains Siswa.

Rusilowati, A. (2018). Asesmen Literasi Sains: Analisis Karakteristik Instrumen dan Kemampuan Siswa Menggunakan Teori Tes Modern Rasch Model.

Sinaga, T. (2015). Pengembangan Soal Model Pisa Mata Pelajaran Ilmu Pengetahuan Alam Terpadu Konten Fisika untuk Mengetahui Penalaran Siswa Kelas IX. Jurnal Inovasi dan Pembelajaran Fisika, 2(2), 194–196. https://doi.org/10.36706/JIPF.V2I2.2623

Soobard, R., & Rannikmae, M. (2011). Assessing Student’s Level of Scientific Literacy Using Interdisciplinary Scenarios. Science Education International, 22(2), 133–144.

Sumintono, & Widiharso. (2015). Aplikasi pemodelan RASCH pada assessment pendidikan. Tim Komunikata Publishing Hous.

Suryani, H., Kartowagiran, B., & Jaelani, J. (2017). Development and validity of mathematical learning assessment instruments based on multiple intelligence. Jurnal Penelitian Dan Evaluasi Pendidikan, 21(1), 93–103. https://doi.org/10.21831/pep.v21i1.15286

Udompong, L., & Wongwanich, S. (2014). Diagnosis of the Scientific Literacy Characteristics of Primary Students. Procedia - Social and Behavioral Sciences, 116, 5091–5096. https://doi.org/10.1016/J.SBSPRO.2014.01.1079

Wiguna, S. (2021). Aplikasi Anates dalam Evaluasi Pembelajaran. CV. Pena Persada.

Wulandari, N. (2016). Analisis Kemampuan Literasi Sains Pada Aspek Pengetahuan dan Kompetensi Sains Siswa SMP Pada Materi Kalor. EDUSAINS, 8(1), 66–73. https://doi.org/10.15408/ES.V8I1.1762

DOI: https://doi.org/10.21831/pep.v27i2.61577