The effectiveness of virtual reality media on student learning outcomes: A meta-analysis

Risky Setiawan; Rhoma Dwi Aria Yuliantri; Aman Aman; Ebtana Sella Mayang Fitri; Indri Kurniawati; Syahri Ramadan

doi:10.21831/jppfa.v12i1.67764

The effectiveness of virtual reality media on student learning outcomes: A meta-analysis

Risky Setiawan, Department of Educational Research and Evaluation, Universitas Negeri Yogyakarta, Indonesia
Rhoma Dwi Aria Yuliantri, Universitas Negeri Yogyakarta, Indonesia
Aman Aman, Universitas Negeri Yogyakarta, Indonesia
Ebtana Sella Mayang Fitri, Universitas Negeri Yogyakarta, Indonesia
Indri Kurniawati, Universitas Negeri Yogyakarta, Indonesia
Syahri Ramadan, Universitas Negeri Yogyakarta, Indonesia

10.21831/jppfa.v12i1.67764

Abstract

This study aims to analyze the effect of virtual reality media on student learning outcomes seen from the value of the effect size of published studies. This study used the meta-analysis method, with a group contrast design from experimental research and quasi-experiments that had experimental groups and control groups. The database used is the SCOPUS database. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) method determines articles. Data collection is carried out by collecting article metadata with specific keywords that have been determined. The article metadata obtained is then sorted based on inclusion and exclusion criteria. The next step is to download a PDF of the article that matches the criteria. The downloaded PDF is tabulated to obtain statistical data in effect size calculations. Calculation of the effect size of each study and data analysis to prove research hypotheses using the R application version 4.2.0 and assisted by the RStudio. The results showed a Q value of 163.54 with a p-value of 0.0001 < α (0.05), so it can be concluded that there is heterogeneity from the observed data regarding the effectiveness of virtual reality media research on learning outcomes. An I2 value of 90.8% indicates substantial heterogeneity categories. For this reason, a random effect size model is used; The results showed a random effect size of 0.6285 with a p-value of 0.0001 < α (0.05). A value of 0.6285 indicates the influence is in the medium category; The results showed that there were differences in the effectiveness of the given continental differences (Q value = 8.24 and p-value 0.02 > α (0.05)). There was no significant difference in the effectiveness of virtual reality media on learning outcomes in terms of education level (Q = 7.39 and p-value 0.02 < α (0.05)); The results showed that the distribution of data showed symmetric, indicating that none of the studies were distorted or article bias occurred.

Keywords

Meta-analysis, effectiveness, learning success, virtual reality

Full Text:

PDF

References

Akgün, M., & Atıcı, B. (2022). The effects of immersive virtual reality Environments on students’ academic achievement: A meta-analytical and meta-thematic study. Participatory Educational Research, 9(3), 111–131. https://doi.org/10.17275/per.22.57.9.3

Albus, P., Vogt, A., & Seufert, T. (2021). Signaling in virtual reality influences learning outcome and cognitive load. Computers & Education, 166, 104154. https://doi.org/10.1016/j.compedu.2021.104154

Alfatih, A. A. (2021). Problematika dalam pembelajaran Pendidikan Agama Islam pada masa pandemi Covid-19 di SMP Islam Almaarif 01 Singosari [Universitas Islam Negeri Maulana Malik Ibrahim]. http://etheses.uin-malang.ac.id/28644/

Anam, S., & Hanik, E. U. (2020). Problematika kebijakkan pendidikan di tengah pandemi dan dampaknya terhadap proses pembelajaran di sekolah dasar. Jurnal Qiroah, 10(2), 73–81. https://doi.org/10.33511/qiroah.v10n2.73-81

Andiyanto, T. (2018). Konsep pendidikan pranatal, postnatal, dan pendidikan sepanjang hayat. Elementary: Jurnal Ilmiah Pendidikan Dasar, 4(2), 195–204. https://doi.org/10.32332/elementary.v4i2.1236

Andriyani, Y., Husein Arifin, M., & Wahyuningsih, Y. (2021). Pengaruh modernisasi terhadap perilaku siswa sekolah dasar. Didaktik : Jurnal Ilmiah PGSD STKIP Subang, 7(2), 268–278. https://doi.org/10.36989/didaktik.v7i01.232

Arifin, M. (2000). Filsafat pendidikan Islam. Bumi Aksara.

Arslan, F., & Kaysi, F. (2013). Virtual learning environments. Journal of Teaching and Education, 2(4), 57–65. http://www.universitypublications.net/jte/0204/pdf/HVD867.pdf

Aviory, K., Wahyumiani, N., & Suharni, S. (2022). Factors that affect learning outcomes in online learning. REID (Research and Evaluation in Education), 8(1), 46–54. https://doi.org/10.21831/reid.v8i1.44454

Aziz, E.-S., Esche, S., & Chassapis, C. (2009). Review of the state of the art in virtual learning environments based on multi-player computer games. 2009 Annual Conference & Exposition Proceedings, 14.1032.1-14.1032.16. https://doi.org/10.18260/1-2--5578

Bandura, A. (1977). Social learning theory. Prentice-Hall.

Bashori, M., van Hout, R., Strik, H., & Cucchiarini, C. (2021). Effects of ASR-based websites on EFL learners’ vocabulary, speaking anxiety, and language enjoyment. System, 99, 102496. https://doi.org/10.1016/j.system.2021.102496

Basri, B. (2014). Bimbingan konseling dan kesuksesan belajar. Tarbawiyah: Jurnal Ilmiah Pendidikan, 11(1), 34–52. https://www.e-journal.ejournal.metrouniv.ac.id/tarbawiyah/article/view/358

Chan, A.-W., Song, F., Vickers, A., Jefferson, T., Dickersin, K., Gøtzsche, P. C., Krumholz, H. M., Ghersi, D., & van der Worp, H. B. (2014). Increasing value and reducing waste: Addressing inaccessible research. The Lancet, 383(9913), 257–266. https://doi.org/10.1016/S0140-6736(13)62296-5

Fauzan, A. (2002). Applying Realistic Mathematics Education (RME) in teaching geometry in Indonesian primary schools [University of Twente]. https://research.utwente.nl/en/publications/applying-realistic-mathematics-education-rme-in-teaching-geometry

Freeman, A., Becker, S. A., & Cummins, M. (2017). NMC/CoSN horizon report: 2017 K-12 Edition. The New Media Consortium. https://www.learntechlib.org/p/182003/

Freina, L., & Ott, M. (2015). A literature review on immersive virtual reality in education: State of the art and perspectives. The International Scientific Conference Elearning and Software for Education, 133–141. https://doi.org/10.12753/2066-026X-15-020

Gavaghan, D. J., Moore, A. R., & McQuay, H. J. (2000). An evaluation of homogeneity tests in meta-analyses in pain using simulations of individual patient data. Pain, 85(3), 415–424. https://doi.org/10.1016/S0304-3959(99)00302-4

Geiger, R. E. (2019). Preschool self-regulation: A predictor of school readiness [Western Kentucky University]. https://digitalcommons.wku.edu/cgi/viewcontent.cgi?article=4127&context=theses

Gillespie, H., Boulton, H., Hramiak, A. H., & Williamson, R. (2007). Learning and teaching with virtual learning environments. Learning Matters. https://irep.ntu.ac.uk/id/eprint/24186

Herlambang, P. M., & Aryoseto, L. (2016). Potensi virtual reality berbasis smartphone sebagai media belajar mahasiswa kedokteran. Cermin Dunia Kedokteran, 43(6), 412–415. https://cdkjournal.com/index.php/CDK/article/view/67

Hidayah, A. A. F., Adawiyah, R. Al, & Mahanani, P. A. R. (2020). Efektivitas pembelajaran daring di masa Pandemi Covid-19. JURNAL SOSIAL : Jurnal Penelitian Ilmu-Ilmu Sosial, 21(2), 53–56. https://doi.org/10.33319/sos.v21i2.61

Higgins, J. P. T. (2003). Measuring inconsistency in meta-analyses. BMJ, 327(7414), 557–560. https://doi.org/10.1136/bmj.327.7414.557

Higgins, J. P. T., & Thompson, S. G. (2002). Quantifying heterogeneity in a meta‐analysis. Statistics in Medicine, 21(11), 1539–1558. https://doi.org/10.1002/sim.1186

Hovlid, E., Husabø, G., Valestrand, E. A., & Hartveit, M. (2022). Learning team-based quality improvement in a virtual setting: A qualitative study. BMJ Open, 12(6), e061390. https://doi.org/10.1136/bmjopen-2022-061390

Huang, M., Kuang, F., & Ling, Y. (2022). EFL learners’ engagement in different activities of blended learning environment. Asian-Pacific Journal of Second and Foreign Language Education, 7(1), 9. https://doi.org/10.1186/s40862-022-00136-7

Hutama, R. C. (2017). Pengaruh keterlibatan pemakai sistem, program pelatihan dan pendidikan, kemampuan teknik personal, dukungan manajemen puncak, dan formalisasi pengembangan sistem informasi terhadap kinerja sistem informasi akuntansi di Bank Umum Kota Surakarta [Universitas Muhammadiyah Surakarta]. https://eprints.ums.ac.id/49463/33/Naskah Publikasi.pdf

Indraswari, A. (2016). Pengaruh pendekatan matematika realistik melalui lingkungan belajar virtual terhadap kemampuan pemecahan masalah matematik siswa di SMP Perguruan Sumatra T.A 2017/2018 [Universitas Negeri Medan]. https://digilib.unimed.ac.id/id/eprint/29026/

Jaffe, K. (2014). Social and natural sciences differ in their research strategies, adapted to work for different knowledge landscapes. PLoS ONE, 9(11), e113901. https://doi.org/10.1371/journal.pone.0113901

Jones, C., Jones, D., & Moro, C. (2021). Use of virtual and augmented reality-based interventions in health education to improve dementia knowledge and attitudes: an integrative review. BMJ Open, 11(11), e053616. https://doi.org/10.1136/bmjopen-2021-053616

Khasanah, B. A., & Khoiriah, S. (2017). Efektivitas penerapan strategi learning start with a question pada pembelajaran matematika. Prosiding Seminar Nasional Matematika Dan Pendidikan Matematika, 1(1), 297–301. https://www.academia.edu/download/53589616/34._Binti_Anisaul_297_-_301.pdf

Kristanto, Y. D., & Padmi, R. S. (2020). Using network analysis for rapid, transparent, and rigorous thematic analysis: A case study of online distance learning. Jurnal Penelitian Dan Evaluasi Pendidikan, 24(2), 177–189. https://doi.org/10.21831/pep.v24i2.33912

Luthfi, N. F., & Hamdi, S. (2020). Evaluation of online learning in Natural Science for junior high school. Jurnal Penelitian Dan Evaluasi Pendidikan, 24(2), 218–227. https://doi.org/10.21831/pep.v24i2.35015

Marfuah, M., Suryadi, D., Turmudi, T., & Isnawan, M. G. (2022). Providing online learning situations for in-service mathematics teachers’ external transposition knowledge during COVID-19 Pandemic: Case of Indonesia. Electronic Journal of E-Learning, 20(1), 69–84. https://doi.org/10.34190/ejel.20.1.2388

Maruhawa, F. N. (2019). Faktor kesiapan dan keberhasilan implementasi sistem informasi di institusi pendidikan dasar [UIN Syarif Hidayatullah Jakarta]. https://repository.uinjkt.ac.id/dspace/handle/123456789/51999

Miles, D. A. (2017). A taxonomy of research gaps: Identifying and defining the seven research gaps. In Doctoral student workshop: finding research gaps-research methods and strategies (pp. 1–15). https://www.researchgate.net/profile/Sanusi-Sani-Maimagani/post/What-is-a-research-gap-or-knowledge-gap-in-research-and-literature-Is-gap-explored-or-constructed-How-can-gap-in-research-be-identified/attachment/612e5570647f3906fc94fab2/AS%3A10628998501539

Msila, V. (2020). Heutagogy and teaching: Toward liberatory methods. The International Journal of Humanities Education, 18(1), 1–18. https://doi.org/10.18848/2327-0063/CGP/v18i01/1-18

Oonk, C., Gulikers, J., den Brok, P., & Mulder, M. (2022). Stimulating boundary crossing learning in a multi-stakeholder learning environment for sustainable development. International Journal of Sustainability in Higher Education, 23(8), 21–40. https://doi.org/10.1108/IJSHE-04-2021-0156

Phungsuk, R., Viriyavejakul, C., & Ratanaolarn, T. (2017). Development of a problem-based learning model via a virtual learning environment. Kasetsart Journal of Social Sciences, 38(3), 297–306. https://doi.org/10.1016/j.kjss.2017.01.001

Putri, U. H. (2019). Efektivitas dan efisiensi pembiayaan pendidikan. https://doi.org/10.31227/osf.io/yg3an

Rohmawati, A. (2017). Efektivitas pembelajaran. JPUD - Jurnal Pendidikan Usia Dini, 9(1), 15–32. https://doi.org/10.21009/JPUD.091.02

Rothstein, H. R. (2008). Publication bias as a threat to the validity of meta-analytic results. Journal of Experimental Criminology, 4(1), 61–81. https://doi.org/10.1007/s11292-007-9046-9

Rudyanto, H. E., Ghufron, A., & Hartono, H. (2019). Use of integrated mobile application with realistic mathematics education: A study to develop elementary students’ creative thinking ability. International Journal of Interactive Mobile Technologies (IJIM), 13(10), 19–27. https://doi.org/10.3991/ijim.v13i10.11598

Saat, S. (2015). Faktor-faktor determinan dalam pendidikan (studi tentang makna dan kedudukannya dalam pendidikan). Al-TA’DIB: Jurnal Kajian Ilmu Kependidikan, 8(2), 1–17. https://ejournal.iainkendari.ac.id/index.php/al-tadib/article/view/407/392

Scherer, R., Howard, S. K., Tondeur, J., & Siddiq, F. (2021). Profiling teachers’ readiness for online teaching and learning in higher education: Who’s ready? Computers in Human Behavior, 118, 106675. https://doi.org/10.1016/j.chb.2020.106675

Scott, E., Soria, A., & Campo, M. (2017). Adaptive 3D virtual learning environments—A review of the literature. IEEE Transactions on Learning Technologies, 10(3), 262–276. https://doi.org/10.1109/TLT.2016.2609910

Setiawan, H., Isnaeni, W., Budijantoro, F. P. M. H., & Marianti, A. (2015). Implementation of digital learning using interactive multimedia in excretory system with virtual laboratory. REID (Research and Evaluation in Education), 1(2), 212–224. https://doi.org/10.21831/reid.v1i2.6501

Suhariyono, S., & Retnawati, H. (2022). The influence of online learning on physics learning outcomes during the Covid-19 Pandemic. Radiasi : Jurnal Berkala Pendidikan Fisika, 15(1), 35–42. https://doi.org/10.37729/radiasi.v15i1.1812

Supriyono, R. A. (2000). Sistem pengendalian manajemen. BPFE.

Syafii, A., & Retnawati, H. (2022). Opportunities and challenges of online learning methods in religious education. 5th International Conference on Current Issues in Education (ICCIE 2021), 285–290. https://doi.org/10.2991/assehr.k.220129.052

Taranilla, R. V., Cózar-Gutiérrez, R., González-Calero, J. A., & López Cirugeda, I. (2022). Strolling through a city of the Roman Empire: An analysis of the potential of virtual reality to teach history in Primary Education. Interactive Learning Environments, 30(4), 608–618. https://doi.org/10.1080/10494820.2019.1674886

Tenório, M. M., Reinaldo, F. A. F., Góis, L. A., Lopes, R. P., & dos Santos Junior, G. (2018). Elements of gamification in virtual learning environments: A systematic review. In Teaching and Learning in a Digital World: Proceedings of the 20th International Conference on Interactive Collaborative Learning (pp. 86–96). Springer International Publishing. https://doi.org/10.1007/978-3-319-73204-6_12

Trinidad, S., Aldridge, J., & Fraser, B. (2005). Development, validation and use of the online learning environment survey. Australasian Journal of Educational Technology, 21(1). https://doi.org/10.14742/ajet.1343

Wijayanti, D. (2018). Character education designed by Ki Hadjar Dewantara. EduHumaniora | Jurnal Pendidikan Dasar Kampus Cibiru, 10(2), 85. https://doi.org/10.17509/eh.v10i2.10865

Wilson, B. G. (1996). Constructivist learning environments: Case studies in instructional design. Educational Technology.

Zulkardi, Z. (2002). Developing a learning environment on realistic mathematics education for Indonesian student teachers [University of Twente]. https://repository.unsri.ac.id/871/

DOI: https://doi.org/10.21831/jppfa.v12i1.67764