Pengembangan sistem penilaian hasil belajar mata pelajaran menganalisis rangkaian listrik berbasis computerized adaptive testing

Kamaruddin Kamaruddin; Haryanto Haryanto

doi:10.21831/jpv.v4i1.2533

Pengembangan sistem penilaian hasil belajar mata pelajaran menganalisis rangkaian listrik berbasis computerized adaptive testing

Kamaruddin Kamaruddin, SMK Negeri 2 Sumbawa Besar
Haryanto Haryanto, Universitas Negeri Yogyakarta

10.21831/jpv.v4i1.2533

Abstract

Penelitian dan pengembangan ini bertujuan untuk: (1) menghasilkan instrumen tes terstandar untuk mata pelajaran Menganalisis Rangkaian Listrik yang tersimpan dalam bank soal elektronik; (2) menghasilkan perangkat lunak sistem penilaian berbasis CAT (SPBCAT) yang mampu melaksanakan tes secara adaptif; dan (3) SPBCAT yang mampu melakukan proses pengujian dengan unjuk kerja yang layak. Penelitian dan pengembangan ini dilaksanakan dalam empat tahap, yaitu: (1) definisi; (2) desain; (3) pengembangan; dan (4) pengujian. Kesimpulan dari hasil penelitian ini adalah: (1) instrumen tes terstandar yang berhasil dikembangkan berbentuk 105 butir pilihan ganda, tersusun dalam empat KD, dengan reliabilitas empiris, masing-masing 0,9086, 0,9067, 0,9087, dan 0,9086, dan tersimpan dalam bank soal elektronik; (2) SPBCAT mampu melaksanakan tes secara adaptif, dan menampilkan hasil tes dengan tepat; (3) perangkat lunak SPBCAT telah mampu menampilkan unjuk kerjanya secara layak dalam menguji 28 peserta tes secara serempak, dan mendapat penilaian sangat baik oleh pengguna.

DEVELOPMENT OF LEARNING OUTCOMES ASSESSMENT SYSTEMS FOR ELECTRIC CIRCUITS ANALYZING SUBJECTS BASED ON COMPUTERIZED ADAPTIVE TESTING

Abstract

This research and development aim to: (1) produce standardized test instruments for Electric Circuits Analyzing subjects which is stored in an electronic item bank; (2) produce a software of learning outcomes assessment system based on CAT (SPBCAT) which able to performs test adaptively; and (3) SPBCAT which is able to perform adaptive testing process with decent performance. This research and development were conducted in four stages, i.e.: (1) the definition; (2) the design; (3) the development; and (4) the testing. The conclusions of this research are: (1) the standardized test instrument which has been successfully developed in the forms of 105 items of multiple choice, arranged in four KD, with empirical reliability is 0.9086, 0.9067, 0.9087, and 0.9086, and stored in the electronic item bank; (2) SPBCAT has been able to perform test adaptively, displays test result precisely; (3) SPBCAT has been able to show its performance properly by present test items simultaneously to 28 students and got a very good appraisal from its user.

Full Text:

PDF | 28-42

References

Autor, D., Levy, F., & Murnane, R. (2003, Nopember). The skill content of recent technological change: An empirical exploration. The Quarterly Journal of Economics, 118(4), 1279–1333.

Berry, R., & Adamson, B. (2011). Assessment reform past, present and future. Dalam Berry, R., & Adamson, B. (Eds.). Assessment Reform in Education (pp. 3-14). New York: Springer.

DeMars, C. (2010). Item response theory. New York: Oxford University Press, Inc.

Djojonegoro, Wardiman (1998). Pengembangan sumber daya manusia melalui sekolah menengah kejuruan (SMK). Jakarta: PT Jayakarta Agung Offset.

Embretson, S.E., & Reise, S.P. (2000). Item response theory for psychologists multivariate. Mahwah: Lawrence Erlbaum Associates, Inc.

Falk, I., & Surata, K. (2011). Where ‘the TVET system’ meets the performativity of vocational learning: Borderlands of innovation and future directions. Dalam Catts, R., Falk, I., & Wallace, R. (Eds.). Vocational Learning Innovative Theory and Practice (pp. 33-62). New York: Springer.

Folk, V.G., & Smith, R.L. (2002). Models for delivery of CBTs. Dalam Mills, et.al. (Eds.). Computer Based Testing Building the Foundation for Future Assessments. (pp. 41-63). Mahwah: Lawrence Erlbaum Associates, Inc.

Froelich, A.G. (2009). Methods from item response theory: Going beyond traditional validity and reliability in standardizing assessments. Dalam Shelley II, M.C., Yore, L.D., & Hand, B. (Eds.). Quality Research in Literacy and Science Education International Perspectives and Gold Standards. (pp. 287-302). New York: Springer

Hambleton, R.K., & Jones, R.W. Comparison of classical test theory and item response theory and their applications to test development. Diakses tanggal 14 Oktober 2013 dari http://ncme.org/linkservid/66968080-1320-5CAE-6E4E546A2E4FA9E1/showMeta/0/.

Hambleton, R.K., Swaminathan, H., & Rogers, H.J. (1991). Fundamentals of item response theory. Newbury Park: Sage Publications.

Hulin, C.L., Drasgow, F., & Parsons, C. K. (1983). Item response theory: applications to psychological measurement. Homewood: Dow Jones Trurn.

Jones, P., Smith, R.W., & Talley, D. (2006). Developing test forms for small-scale achievement testing systems. Dalam Downing, S.M. & Haladyna, T.M. (Eds.). Handbook of Test Development. (pp. 487-526). Mahwah: Lawrence Erlbaum Associates, Inc.

Johnson, D. W., & Johnson, R.T. (2002). Meaningful assessment: A manageable and cooperative process. Boston: Allyn and Bacon.

Kantrowitz, T.M., Dawson, C.R., & Fetzer M.S. (2011). Computer adaptive testing (CAT): A faster, smarter, and more secure approach to pre-employment testing [Versi elektronik]. Journal of Business Psychology, 26:227–232. Diakses tanggal 20 Juni 2014 dari http://search.pro-quest.com/docview/867330795/758370F8DF04076PQ/17?accountid=31324.

Larson, J.W., & Madsen, H.S. (2011). Computerized adaptive language testing: Moving beyond computer-assisted testing [Versi elektronik]. Calico Journal, Vol 2, 3, 32-43. Diakses tanggal 20 Juni 2014 dari http://search.proquest.com/docview/749990459/758370F8DF04076PQ/13?accountid=31324.

Parshall, C. G., et.al. (2002). Practical considerations in computer-based testing. New York: Springer.

Segall. D.O. (2005). Computerized adaptive testing. Dalam Kempf-Leonard, K., et.al. (Eds.). Encyclopedia of Social Measurement (Vol. 1) (pp 429-438). Amsterdam: Elsevier Inc.

Shaik, N. (2006). Computer-adaptive online exit surveys: Conceptual and methodological issues. Dalam Williams, D.D., Howell, S.L., & Hricko, M. (Eds.). Online Assessment, Measurement, and Evaluation: Emerging Practices. (pp. 28-44). Hershey: Information Science Publishing.

Simms, L.J., & Watson, D. (2007). The construct validation approach to personality scale construction. Dalam Robins, R.W., Fraley, R.C., Krueger, R.F. (Eds.). Handbook of Research Methods in Personality Psychology (pp.240-258). New York: The Guilford Press.

Sudira, Putu (2012). Filosofi dan teori pendidikan vokasi dan kejuruan. Yogyakarta: UNY Press.

van der Linden, W.J. (2005). Linear models for optimal test design. New York: Springer Science Business Media, Inc.

Wainer H., Bradlow, E.T., & Xiaohui Wang (2007). Testlet response theory and its applications. Cambridge: Cambridge University Press.

Weiss, D. J. (1982). Improving measurement quality and efficiency with adaptive testing. Applied Psychological Measurement, 6, pp. 473-492. Diambil pada 28 Maret 2014 dari http://iacat.org/sites/de-fault/files/biblio/v06n4p473.pdf.

Wendler, C.L.W., & Walker, M.E., (2006). Practical issues in designing and maintaining multiple test forms for large-scale programs. Dalam Downing, S.M., & Haladyna, T.M. (Eds.). Handbook of Test Development. (pp. 445-468). Mahwah: Lawrence Erlbaum Associates, Inc.

DOI: https://doi.org/10.21831/jpv.v4i1.2533