The effectiveness of Game-Based Science Learning (GBSL) to improve students’ academic achievement: A meta-analysis of current research from 2010 to 2017

Heru Setiawan; Shane Phillipson

doi:10.21831/reid.v5i2.28073

The effectiveness of Game-Based Science Learning (GBSL) to improve students’ academic achievement: A meta-analysis of current research from 2010 to 2017

Heru Setiawan, Sekolah Menengah Atas Global Mandiri Jakarta, Indonesia
Shane Phillipson, Monash University, Australia, Australia

10.21831/reid.v5i2.28073

Abstract

This study identifies the effectiveness of game-based science learning (GBSL) for improving students’ learning outcomes by conducting a literature review of the current research from 2010 to 2017. This study also explores the correlation between variation in school level and year of publication on GBSL effect size. Data were collected from peer-reviewed journal articles published in educational databases including ERIC (Educational Research Information Centre), Springer Link, ProQuest education journal, and A+ education. Seven inclusion criteria were used to select relevant studies. Comprehensive Meta-Analysis (CMA 2.0) was used to analyze the data. This study finds that (1) GBSL intervention has a statistically significant effect on students' learning outcomes with a higher average on the effect size of the experimental group (41.12) than the control group (37.07). The mean of the reviewed studies’ effect size is 0.667 in the medium category. (2) The implementation of GBSL in secondary school has a bigger average effect size than in elementary school. Year of publication and effect size has a low positive correlation with a coefficient of correlation 0.40.

Keywords

game-based science learning; learning outcomes; meta-analysis

Full Text:

PDF

References

Adam, S. (2004). A consideration of the nature, role, application, and implications for European education of employing ‘learning outcomes’ at the local, national, and international levels. United Kingdom Bologna Seminar. 1-2 July 2004, Heriot-Watt University (Edinburgh Conference Centre), Edinburgh.

Anderson, J. L., & Barnett, M. (2013). Learning physics with digital game simulations in middle school science. Journal of Science Education and Technology, 22(6), 914–926. https://doi.org/10.1007/s10956-013-9438-8

Annetta, L. A., Minogue, J., Holmes, S. Y., & Cheng, M.-T. (2009). Investigating the impact of video games on high school students’ engagement and learning about genetics. Computers & Education, 53(1), 74–85. https://doi.org/10.1016/j.compedu.2008.12.020

Bello, S., Ibi, M. B., & Bukar, I. B. (2016). Effect of simulation techniques and lecture method on students’ academic performance in mafoni day secondary school Maiduguri, Borno state, Nigeria. Journal of Education and Practice, 7(23), 113–117. Retrieved from https://www.iiste.org/Journals/index.php/JEP/article/view/32584

Bennett, S., Maton, K., & Kervin, L. (2008). The ‘digital natives’ debate: A critical review of the evidence. British Journal of Educational Technology, 39(5), 775–786. https://doi.org/10.1111/j.1467-8535.2007.00793.x

Borenstein, M., Hedges, L., Higgins, J., & Rothstein, H. (2005). Comprehensive meta-analysis version 2. Englewood Cliffs, NJ: Biostat.

Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010). A basic introduction to fixed-effect and random-effects models for meta-analysis. Research Synthesis Methods, 1(2), 97–111. https://doi.org/10.1002/jrsm.12

Borg, W. R., & Gall, M. D. (1983). Educational research: An introduction (4th ed.). New York, NY: Longman.

Brockwell, S. E., & Gordon, I. R. (2001). A comparison of statistical methods for meta-analysis. Statistics in Medicine, 20(6), 825–840. https://doi.org/10.1002/sim.650

Chee, Y. S., & Tan, K. C. D. (2012). Becoming chemists through game-based inquiry learning: The case of “legends of alkhimia.” Electronic Journal of E-Learning, 10(2), 185–198. Retrieved from http://www.ejel.org/issue/download.html?idArticle=188

Chen, C.-L. D., Yeh, T.-K., & Chang, C.-Y. (2016). The effects of game-based learning and anticipation of a test on the learning outcomes of 10th grade Geology students. EURASIA Journal of Mathematics, Science and Technology Education, 12(5), 1379–1388. https://doi.org/10.12973/eurasia.2016.1519a

Chen, C., & Hwang, G. (2017). Effects of the team competition-based ubiquitous gaming approach on students’ interactive patterns, collective efficacy and awareness of collaboration and communication. Educational Technology & Society, 20(1), 87–98. Retrieved from https://www.jstor.org/stable/jeductechsoci.20.1.87

Cheng, M.-T., Su, T., Huang, W.-Y., & Chen, J.-H. (2014). An educational game for learning human immunology: What do students learn and how do they perceive? British Journal of Educational Technology, 45(5), 820–833. https://doi.org/10.1111/bjet.12098

Cheung, A. C. K., & Slavin, R. E. (2013). The effectiveness of educational technology applications for enhancing mathematics achievement in K-12 classrooms: A meta-analysis. Educational Research Review, 9, 88–113. https://doi.org/10.1016/j.edurev.2013.01.001

Chorney, A. I. (2012). Taking the game out Of gamification. Dalhousie Journal of Interdisciplinary Management, 8(1), 1–14. https://doi.org/10.5931/djim.v8i1.242

Chu, H.-C., & Hung, C.-M. (2015). Effects of the digital game-development approach on elementary school students’ learning motivation, problem solving, and learning achievement. International Journal of Distance Education Technologies, 13(1), 87–102. https://doi.org/10.4018/ijdet.2015010105

Clark, D. B., Nelson, B. C., Chang, H.-Y., Martinez-Garza, M., Slack, K., & D’Angelo, C. M. (2011). Exploring Newtonian mechanics in a conceptually-integrated digital game: Comparison of learning and affective outcomes for students in Taiwan and the United States. Computers & Education, 57(3), 2178–2195. https://doi.org/10.1016/j.compedu.2011.05.007

Cohen, L., Manion, L., & Morrison, K. (2007). Research methods in education (6th ed.). New York, NY: Routledge.

Corbett, S. (2010, September 15). Learning by playing video games in the classroom. The New York Times. Retrieved from https://www.nytimes.com/2010/09/19/magazine/19video-t.html

Culp, K. M., Martin, W., Clements, M., & Lewis Presser, A. (2015). Testing the impact of a pre-instructional digital game on middle-grade students’ understanding of photosynthesis. Technology, Knowledge and Learning, 20(1), 5–26. https://doi.org/10.1007/s10758-014-9233-5

Divjak, B., & Tomić, D. (2011). The impact of game-based learning on the achievement of learning goals and motivation for learning mathematics - literature review. Journal of Information and Organizational Sciences, 35(1), 15–30. Retrieved from https://jios.foi.hr/index.php/jios/article/view/182

Easterbrook, P. J., Gopalan, R., Berlin, J. A., & Matthews, D. R. (1991). Publication bias in clinical research. The Lancet, 337(8746), 867–872. https://doi.org/10.1016/0140-6736(91)90201-Y

Echeverría, A., García-Campo, C., Nussbaum, M., Gil, F., Villalta, M., Améstica, M., & Echeverría, S. (2011). A framework for the design and integration of collaborative classroom games. Computers & Education, 57(1), 1127–1136. https://doi.org/10.1016/j.compedu.2010.12.010

Fan, K.-K., Xiao, P., & Su, C. (2015). The effects of learning styles and meaningful learning on the learning achievement of gamification health education curriculum. EURASIA Journal of Mathematics, Science and Technology Education, 11(5), 1211–1229. https://doi.org/10.12973/eurasia.2015.1413a

Furió, D., Juan, M.-C., Seguí, I., & Vivó, R. (2015). Mobile learning vs. traditional classroom lessons: A comparative study. Journal of Computer Assisted Learning, 31(3), 189–201. https://doi.org/10.1111/jcal.12071

Gee, J. P. (2007). What video games have to teach us about learning and literacy (Revised an). New York, NY: Palgrave Macmillan.

Glass, G. V., McGaw, B., & Smith, M. L. (1981). Meta-analysis in social research. Beverly Hills, CA: Sage Publications.

Hamari, J., & Keronen, L. (2017). Why do people play games? A meta-analysis. International Journal of Information Management, 37(3), 125–141. https://doi.org/10.1016/j.ijinfomgt.2017.01.006

Hedges, L. V., & Vevea, J. L. (1998). Fixed- and random-effects models in meta-analysis. Psychological Methods, 3(4), 486–504. https://doi.org/10.1037/1082-989X.3.4.486

Honey, M. A., & Hilton, M. (Eds.). (2011). Learning science through computer games and simulations. Washington, DC: National Academy of Sciences.

Huang, B., Hew, K. F., & Lo, C. K. (2019). Investigating the effects of gamification-enhanced flipped learning on undergraduate students’ behavioral and cognitive engagement. Interactive Learning Environments, 27(8), 1106–1126. https://doi.org/10.1080/10494820.2018.1495653

Khalili, N., Sheridan, K., Williams, A., Clark, K., & Stegman, M. (2011). Students designing video games about immunology: Insights for science learning. Computers in the Schools, 28(3), 228–240. https://doi.org/10.1080/07380569.2011.594988

Kim, H., Munson, M. R., & McKay, M. M. (2012). Engagement in mental health treatment among adolescents and young adults: A systematic review. Child and Adolescent Social Work Journal, 29(3), 241–266. https://doi.org/10.1007/s10560-012-0256-2

King, W. R., & He, J. (2005). Understanding the role and methods of meta-analysis in IS research. Communications of the Association for Information Systems, 16, 665–686. https://doi.org/10.17705/1CAIS.01632

Li, M.-C., & Tsai, C.-C. (2013). Game-based learning in science education: A review of relevant research. Journal of Science Education and Technology, 22(6), 877–898. https://doi.org/10.1007/s10956-013-9436-x

Lipsey, M. W., & Wilson, D. B. (2001). Practical meta-analysis (Vol. 49). Thousand Oaks, CA: SAGE Publications.

Mayo, M. J. (2007). Games for science and engineering education. Communications of the ACM, 50(7), 30–35. https://doi.org/10.1145/1272516.1272536

McGonigal, J. (2011). Reality is broken: Why games make us better and how they can change the world. New York, NY: Penguin.

Mertens, D. M. (2015). Research and evaluation in education and psychology (4th ed.). London: SAGE Publication.

Nakagawa, S., & Cuthill, I. C. (2007). Effect size, confidence interval and statistical significance: A practical guide for biologists. Biological Reviews, 82(4), 591–605. https://doi.org/10.1111/j.1469-185X.2007.00027.x

Nickell, S. (1981). Biases in dynamic models with fixed effects. Econometrica, 49(6), 1417–1426. https://doi.org/10.2307/1911408

Nilsson, E. M., & Jakobsson, A. (2011). Simulated sustainable societies: Students’ reflections on creating future cities in computer games. Journal of Science Education and Technology, 20(1), 33–50. https://doi.org/10.1007/s10956-010-9232-9

Okeke, G. N. (2016). The impact of digital games on high school students’ learning outcomes in mathematics education: A meta-analytic investigation. Doctoral thesis, University of North Texas, Denton, TX.

Olejnik, S., & Algina, J. (2000). Measures of effect size for comparative studies: Applications, interpretations, and limitations. Contemporary Educational Psychology, 25(3), 241–286. https://doi.org/10.1006/ceps.2000.1040

Ones, D. S., Viswesvaran, C., & Schmidt, F. L. (1993). Comprehensive meta-analysis of integrity test validities: Findings and implications for personnel selection and theories of job performance. Journal of Applied Psychology, 78(4), 679–703. https://doi.org/10.1037/0021-9010.78.4.679

Orwin, R. G. (1983). A fail-safe N for effect size in meta-analysis. Journal of Educational Statistics, 8(2), 157–159. https://doi.org/10.2307/1164923

Papastergiou, M. (2009). Digital game-based learning in high school Computer Science education: Impact on educational effectiveness and student motivation. Computers & Education, 52(1), 1–12. https://doi.org/10.1016/j.compedu.2008.06.004

Peters, J. L., Sutton, A. J., Jones, D. R., Abrams, K. R., & Rushton, L. (2006). Comparison of two methods to detect publication bias in meta-analysis. JAMA, 295(6), 676. https://doi.org/10.1001/jama.295.6.676

Prensky, M. (2001). Digital natives, digital immigrants Part 1. On the Horizon, 9(5), 1–6. https://doi.org/10.1108/10748120110424816

Quandt, T., Van Looy, J., Vogelgesang, J., Elson, M., Ivory, J. D., Consalvo, M., & Mäyrä, F. (2015). Digital games research: A survey study on an emerging field and its prevalent debates. Journal of Communication, 65(6), 975–996. https://doi.org/10.1111/jcom.12182

Rothstein, H. R., Sutton, A. J., & Borenstein, M. (Eds.). (2006). Publication bias in meta-analysis: Prevention, assessment and adjustments. Hoboken, NJ: John Wiley & Sons.

Sacks, H. S., Berrier, J., Reitman, D., Ancona-Berk, V. A., & Chalmers, T. C. (1998). Meta-Analyses and Large Randomized, Controlled Trials. New England Journal of Medicine, 338(1), 59–62. https://doi.org/10.1056/NEJM199801013380112

Sánchez, J., & Olivares, R. (2011). Problem solving and collaboration using mobile serious games. Computers & Education, 57(3), 1943–1952. https://doi.org/10.1016/j.compedu.2011.04.012

Schmidt, F. L., & Hunter, J. E. (2014). Methods of meta-analysis: Correcting error and bias in research findings. London: SAGE Publications.

Sjöblom, M., Törhönen, M., Hamari, J., & Macey, J. (2017). Content structure is king: An empirical study on gratifications, game genres and content type on Twitch. Computers in Human Behavior, 73, 161–171. https://doi.org/10.1016/j.chb.2017.03.036

Spires, H. A., Rowe, J. P., Mott, B. W., & Lester, J. C. (2011). Problem solving and game-based learning: Effects of middle grade students’ hypothesis testing strategies on learning outcomes. Journal of Educational Computing Research, 44(4), 453–472. https://doi.org/10.2190/EC.44.4.e

Sterne, J. A. C., Sutton, A. J., Ioannidis, J. P. A., Terrin, N., Jones, D. R., Lau, J., … Higgins, J. P. T. (2011). Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ, 343(jul22 1), d4002–d4002. https://doi.org/10.1136/bmj.d4002

Sterne, J. A. C., & Egger, M. (2001). Funnel plots for detecting bias in meta-analysis. Journal of Clinical Epidemiology, 54(10), 1046–1055. https://doi.org/10.1016/S0895-4356(01)00377-8

Su, C.-H., & Cheng, C.-H. (2015). A mobile gamification learning system for improving the learning motivation and achievements. Journal of Computer Assisted Learning, 31(3), 268–286. https://doi.org/10.1111/jcal.12088

Sung, H.-Y., & Hwang, G.-J. (2013). A collaborative game-based learning approach to improving students’ learning performance in science courses. Computers & Education, 63, 43–51. https://doi.org/10.1016/j.compedu.2012.11.019

Sutton, A. J., Abrams, K. R., Jones, D. R., Sheldon, T. A., & Song, F. (2000). Methods for meta-analysis in medical research. Chichester: John Wiley & Sons.

Ting, Y. L. (2010). Using mainstream game to teach technology through an interest framework. Journal of Educational Technology & Society, 13(2), 141–152. Retrieved from https://scholar.lib.ntnu.edu.tw/en/publications/using-mainstream-game-to-teach-technology-through-an-interest-fra

Tsay, C. H.-H., Kofinas, A., & Luo, J. (2018). Enhancing student learning experience with technology-mediated gamification: An empirical study. Computers & Education, 121, 1–17. https://doi.org/10.1016/j.compedu.2018.01.009

van Eck, R. (2006). Digital game-based learning: It’s not just the digital natives who are restless. EDUCAUSE Review, 41(2), 16–30. Retrieved from https://er.educause.edu/articles/2006/1/digital-gamebased-learning-its-not-just-the-digital-natives-who-are-restless

Vogel, J. J., Vogel, D. S., Cannon-Bowers, J., Bowers, C. A., Muse, K., & Wright, M. (2006). Computer gaming and interactive simulations for learning: A meta-analysis. Journal of Educational Computing Research, 34(3), 229–243. https://doi.org/10.2190/FLHV-K4WA-WPVQ-H0YM

Wrzesien, M., & Raya, M. A. (2010). Learning in serious virtual worlds: Evaluation of learning effectiveness and appeal to students in the E-Junior project. Computers & Education, 55(1), 178–187. https://doi.org/10.1016/j.compedu.2010.01.003

Yien, J.-M., Hung, C.-M., Hwang, G.-J., & Lin, Y.-C. (2011). A game-based learning approach to improving students’ learning achievements in a nutrition course. TOJET: The Turkish Online Journal of Educational Technology, 10(2). Retrieved from http://www.tojet.net/articles/v10i2/1021.pdf

Young, M. F., Slota, S., Cutter, A. B., Jalette, G., Mullin, G., Lai, B., … Yukhymenko, M. (2012). Our princess is in another castle: A review of trends in serious gaming for education. Review of Educational Research, 82(1), 61–89. https://doi.org/10.3102/0034654312436980

DOI: https://doi.org/10.21831/reid.v5i2.28073