Technology-enhanced pre-instructional peer assessment: Exploring students’ perceptions in a Statistical Methods course

Yosep Dwi Kristanto, Department of Mathematics Education, Universitas Sanata Dharma, Indonesia

Abstract


There has been strong interest among higher education institution in implementing technology-enhanced peer assessment as a tool for enhancing students’ learning. However, little is known on how to use the peer assessment system in pre-instructional activities. This study aims to explore how technology-enhanced peer assessment can be embedded into pre-instructional activities to enhance students’ learning. Therefore, the present study was an explorative descriptive study that used the qualitative approach to attain the research aim. This study used a questionnaire, students’ reflections, and interview in collecting student’s perceptions toward the interventions. The results suggest that the technology-enhanced pre-instructional peer assessment helps students to prepare the new content acquisition and become a source of students’ motivation in improving their learning performance for the following main body of the lesson. A set of practical suggestions is also proposed for designing and implementing technology-enhanced pre-instructional peer assessment.


Keywords


peer assessment; pre-instructional activities; perceptions; Statistical Methods; higher education

Full Text:

PDF

References


Alfieri, L., Nokes-Malach, T. J., & Schunn, C. D. (2013). Learning through case comparisons: A meta-analytic review. Educational Psychologist, 48(2), 87–113. https://doi.org/10.1080/00461520.2013.775712

Ashton, S., & Davies, R. S. (2015). Using scaffolded rubrics to improve peer assessment in a MOOC writing course. Distance Education, 36(3), 312–334. https://doi.org/10.1080/01587919.2015.1081733

Bluman, A. G. (2012). Elementary statistics: A step by step approach (8th ed.). New York, NY: McGraw-Hill.

Brindley, C., & Scoffield, S. (1998). Peer assessment in undergraduate programmes. Teaching in Higher Education, 3(1), 79–90. https://doi.org/10.1080/1356215980030106

Chen, Y., & Tsai, C. (2009). An educational research course facilitated by online peer assessment. Innovations in Education and Teaching International, 46(1), 105–117. https://doi.org/10.1080/14703290802646297

Cheng, W., & Warren, M. (1999). Peer and teacher assessment of the oral and written tasks of a group project. Assessment & Evaluation in Higher Education, 24(3), 301–314. https://doi.org/10.1080/0260293990240304

Chi, M. T. H. (1996). Constructing self-explanations and scaffolded explanations in tutoring. Applied Cognitive Psychology, 10(7), 33–49. https://doi.org/10.1002/(SICI)1099-0720(199611)10:7<33::AID-ACP436>3.0.CO;2-E

Cho, K., Schunn, C. D., & Wilson, R. W. (2006). Validity and reliability of scaffolded peer assessment of writing from instructor and student perspectives. Journal of Educational Psychology, 98(4), 891–901. https://doi.org/10.1037/0022-0663.98.4.891.supp

Conner, K. (2015). Investigating diagnostic preassessments. Mathematics Teacher, 108(7), 536–542.

Davies, P. (2000). Computerized peer assessment. Innovations in Education and Training International, 37(4), 346–355. https://doi.org/10.1080/135580000750052955

Davies, R., & Berrow, T. (1998). An evaluation of the use of computer supported peer review for developing higher-level skills. Computers & Education, 30(1), 111–115.

Dick, W., Carey, L., & Carey, J. O. (2015). Systematic design of instruction (8th ed.). Boston, MA: Pearson.

Dooley, J. F. (2009). Peer assessments using the moodle workshop tool. In Proceedings of the 14th Annual ACM SIGCSE Conference on Innovation and Technology in Computer Science Education (Vol. 41, pp. 344–344). New York, NY: ACM. https://doi.org/10.1145/1562877.1562985

Friese, S. (2014). Qualitative data analysis with ATLAS.ti (2nd ed.). London: SAGE.

Gagné, R. M., Briggs, L. J., & Wager, W. W. (1992). Principles of instructional design (4th ed.). Fort Worth, TX: Harcourt Brace College.

Gibbs, G. (1988). Learning by doing: A guide to teaching and learning methods. London: FEU.

Gielen, M., & De Wever, B. (2015). Structuring the peer assessment process: A multilevel approach for the impact on product improvement and peer feedback quality. Journal of Computer Assisted Learning, 31(5), 435–449. https://doi.org/10.1111/jcal.12096

Haaga, D. A. F. (1993). Peer review of term papers in graduate psychology courses. Teaching of Psychology, 20(1), 28–32. https://doi.org/10.1207/s15328023top2001_5

Hafner, J., & Hafner, P. (2003). Quantitative analysis of the rubric as an assessment tool: An empirical study of student peer‐group rating. International Journal of Science Education, 25(12), 1509–1528. https://doi.org/10.1080/0950069022000038268

Hanrahan, S. J., & Isaacs, G. (2001). Assessing self- and peer-assessment: The students’ views. Higher Education Research & Development, 20(1), 53–70. https://doi.org/10.1080/07294360123776

Hwang, G.-J., Hung, C.-­Ming, & Chen, N.-S. (2014). Improving learning achievements, motivations and problem-solving skills through a peer assessment-­based game development approach. Educational Technology Research and Development, 62(2), 129–145.

Jenkins, M. (2005). Unfulilled Promise: Formative assessment using computer-aided assessment. Learning and Teaching in Higher Education, (1), 67–80.

Jones, I., & Alcock, L. (2014). Peer assessment without assessment criteria. Studies in Higher Education, 39(10), 1774–1787. https://doi.org/10.1080/03075079.2013.821974

Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2(2), 130–144. https://doi.org/10.1016/J.EDUREV.2007.05.002

Jungić, V., Kaur, H., Mulholland, J., & Xin, C. (2015). On flipping the classroom in large first year calculus courses. International Journal of Mathematical Education in Science and Technology, 46(4), 508–520. https://doi.org/10.1080/0020739X.2014.990529

Kwok, R. C. W., & Ma, J. (1999). Use of a group support system for collaborative assessment. Computers & Education, 32(2), 109–125.

Lee, A. Y., & Hutchison, L. (1998). Improving learning from examples through reflection. Journal of Experimental Psychology: Applied, 4(3), 187–210. https://doi.org/10.1037/1076-898X.4.3.187

Liu, E. Z.-F., Lin, S. S. J., Chiu, C.-H., & Yuan, S.-M. (2001). Web-based peer review: The learner as both adapter and reviewer. IEEE Transactions on Education, 44(3), 246–251. https://doi.org/10.1109/13.940995

Liu, N.-F., & Carless, D. (2006). Peer feedback: The learning element of peer assessment. Teaching in Higher Education, 11(3), 279–290. https://doi.org/10.1080/13562510600680582

Loch, B., Jordan, C. R., Lowe, T. W., & Mestel, B. D. (2014). Do screencasts help to revise prerequisite mathematics? An investigation of student performance and perception. International Journal of Mathematical Education in Science and Technology, 45(2), 256–268. https://doi.org/10.1080/0020739X.2013.822581

Love, B., Hodge, A., Corritore, C., & Ernst, D. C. (2015). Inquiry-based learning and the flipped classroom model. PRIMUS: Problems, Resources, and Issues in Mathematics Undergraduate Studies, 25(8), 745–762. https://doi.org/10.1080/10511970.2015.1046005

Mowl, G., & Pain, R. (1995). Using self and peer assessment to improve students’ essay writing: A case study from geography. Innovations in Education and Training International, 32(4), 324–335. https://doi.org/10.1080/1355800950320404

Nastasi, B. K., & Clements, D. H. (1992). Social-cognitive behaviors and higher-order thinking in educational computer environments. Learning and Instruction, 2(3), 215–238. https://doi.org/10.1016/0959-4752(92)90010-J

Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199–218.

Patchan, M. M., Schunn, C. D., & Clark, R. J. (2018). Accountability in peer assessment: Examining the effects of reviewing grades on peer ratings and peer feedback. Studies in Higher Education, 43(12), 2263–2278. https://doi.org/10.1080/03075079.2017.1320374

Peter, E. E. (2012). Critical thinking: Essence for teaching mathematics and mathematics problem solving skills. African Journal of Mathematics and Computer Science Research, 5(3), 39–43. https://doi.org/10.5897/AJMCSR11.161

Reinholz, D. (2016). The assessment cycle: A model for learning through peer assessment. Assessment & Evaluation in Higher Education, 41(2), 301–315. https://doi.org/10.1080/02602938.2015.1008982

Scott, F. J. (2017). A simulated peer-assessment approach to improve students’ performance in numerical problem-solving questions in high school biology. Journal of Biological Education, 51(2), 107–122. https://doi.org/10.1080/00219266.2016.1177571

Sheatsley, P. B. (1983). Questionnaire construction and item writing. In P. H. Rossi, J. D. Wright, & A. B. Anderson (Eds.), Handbook of survey research (pp. 195–230). New York, NY: Academic Press.

Silver, H. F. (2010). Compare & contrast: Teaching comparative thinking to strengthen student learning (A strategic teacher PLC guide). Alexandria, VA: Association for Supervision & Curriculum Development.

Stefani, L. A. J. (1994). Peer, self and tutor assessment: Relative reliabilities. Studies in Higher Education, 19(1), 69–75. https://doi.org/10.1080/03075079412331382153

Strang, K. D. (2013). Determining the consistency of student grading in a Hybrid Business course using a LMS and statistical software. International Journal of Web-Based Learning and Teaching Technologies (IJWLTT), 8(2), 58–76. https://doi.org/10.4018/jwltt.2013040103

Sun, D. L., Harris, N., Walther, G., & Baiocchi, M. (2015). Peer assessment enhances student learning: The results of a matched randomized crossover experiment in a college statistics class. PLoS ONE, 10(12), e0143177. https://doi.org/10.1371/journal.pone.0143177

Tanner, H., & Jones, S. (1994). Using peer and self-assessment to develop modelling skills with students aged 11 to 16: A socio-constructive view. Educational Studies in Mathematics, 27(4), 413–431. https://doi.org/10.1007/BF01273381

Topping, K. (1998). Peer assessment between students in colleges and universities. Review of Educational Research, 68(3), 249–276. https://doi.org/10.3102/00346543068003249

Triola, M. F. (2012). Elementary statistics technology update (11th ed.). Boston, MA: Addison-Wisley.

van Woerkom, M. (2010). Critical reflection as a rationalistic ideal. Adult Education Quarterly, 60(4), 339–356. https://doi.org/10.1177/0741713609358446

Wain, A. (2017). Learning through reflection. British Journal of Midwifery, 25(10), 662–666. https://doi.org/10.12968/bjom.2017.25.10.662

Wen, M. L., & Tsai, C.-C. (2006). University students’ perceptions of and attitudes toward (online) peer assessment. Higher Education, 51(1), 27–44. https://doi.org/10.1007/s10734-004-6375-8

Willey, K., & Gardner, A. (2010). Investigating the capacity of self and peer assessment activities to engage students and promote learning. European Journal of Engineering Education, 35(4), 429–443. https://doi.org/10.1080/03043797.2010.490577

Yang, Y.-F., & Tsai, C.-C. (2010). Conceptions of and approaches to learning through online peer assessment. Learning and Instruction, 20(1), 72–83.

Alfieri, L., Nokes-Malach, T. J., & Schunn, C. D. (2013). Learning through case comparisons: A meta-analytic review. Educational Psychologist, 48(2), 87–113. https://doi.org/10.1080/00461520.2013.775712

Ashton, S., & Davies, R. S. (2015). Using scaffolded rubrics to improve peer assessment in a MOOC writing course. Distance Education, 36(3), 312–334. https://doi.org/10.1080/01587919.2015.1081733

Bluman, A. G. (2012). Elementary statistics: A step by step approach (8th ed.). New York, NY: McGraw-Hill.

Brindley, C., & Scoffield, S. (1998). Peer assessment in undergraduate programmes. Teaching in Higher Education, 3(1), 79–90. https://doi.org/10.1080/1356215980030106

Chen, Y., & Tsai, C. (2009). An educational research course facilitated by online peer assessment. Innovations in Education and Teaching International, 46(1), 105–117. https://doi.org/10.1080/14703290802646297

Cheng, W., & Warren, M. (1999). Peer and teacher assessment of the oral and written tasks of a group project. Assessment & Evaluation in Higher Education, 24(3), 301–314. https://doi.org/10.1080/0260293990240304

Chi, M. T. H. (1996). Constructing self-explanations and scaffolded explanations in tutoring. Applied Cognitive Psychology, 10(7), 33–49. https://doi.org/10.1002/(SICI)1099-0720(199611)10:7<33::AID-ACP436>3.0.CO;2-E

Cho, K., Schunn, C. D., & Wilson, R. W. (2006). Validity and reliability of scaffolded peer assessment of writing from instructor and student perspectives. Journal of Educational Psychology, 98(4), 891–901. https://doi.org/10.1037/0022-0663.98.4.891.supp

Conner, K. (2015). Investigating diagnostic preassessments. Mathematics Teacher, 108(7), 536–542.

Davies, P. (2000). Computerized peer assessment. Innovations in Education and Training International, 37(4), 346–355. https://doi.org/10.1080/135580000750052955

Davies, R., & Berrow, T. (1998). An evaluation of the use of computer supported peer review for developing higher-level skills. Computers & Education, 30(1), 111–115.

Dick, W., Carey, L., & Carey, J. O. (2015). Systematic design of instruction (8th ed.). Boston, MA: Pearson.

Dooley, J. F. (2009). Peer assessments using the moodle workshop tool. In Proceedings of the 14th Annual ACM SIGCSE Conference on Innovation and Technology in Computer Science Education (Vol. 41, pp. 344–344). New York, NY: ACM. https://doi.org/10.1145/1562877.1562985

Friese, S. (2014). Qualitative data analysis with ATLAS.ti (2nd ed.). London: SAGE.

Gagné, R. M., Briggs, L. J., & Wager, W. W. (1992). Principles of instructional design (4th ed.). Fort Worth, TX: Harcourt Brace College.

Gibbs, G. (1988). Learning by doing: A guide to teaching and learning methods. London: FEU.

Gielen, M., & De Wever, B. (2015). Structuring the peer assessment process: A multilevel approach for the impact on product improvement and peer feedback quality. Journal of Computer Assisted Learning, 31(5), 435–449. https://doi.org/10.1111/jcal.12096

Haaga, D. A. F. (1993). Peer review of term papers in graduate psychology courses. Teaching of Psychology, 20(1), 28–32. https://doi.org/10.1207/s15328023top2001_5

Hafner, J., & Hafner, P. (2003). Quantitative analysis of the rubric as an assessment tool: An empirical study of student peer‐group rating. International Journal of Science Education, 25(12), 1509–1528. https://doi.org/10.1080/0950069022000038268

Hanrahan, S. J., & Isaacs, G. (2001). Assessing self- and peer-assessment: The students’ views. Higher Education Research & Development, 20(1), 53–70. https://doi.org/10.1080/07294360123776

Hwang, G.-J., Hung, C.-­Ming, & Chen, N.-S. (2014). Improving learning achievements, motivations and problem-solving skills through a peer assessment-­based game development approach. Educational Technology Research and Development, 62(2), 129–145.

Jenkins, M. (2005). Unfulilled Promise: Formative assessment using computer-aided assessment. Learning and Teaching in Higher Education, (1), 67–80.

Jones, I., & Alcock, L. (2014). Peer assessment without assessment criteria. Studies in Higher Education, 39(10), 1774–1787. https://doi.org/10.1080/03075079.2013.821974

Jonsson, A., & Svingby, G. (2007). The use of scoring rubrics: Reliability, validity and educational consequences. Educational Research Review, 2(2), 130–144. https://doi.org/10.1016/J.EDUREV.2007.05.002

Jungić, V., Kaur, H., Mulholland, J., & Xin, C. (2015). On flipping the classroom in large first year calculus courses. International Journal of Mathematical Education in Science and Technology, 46(4), 508–520. https://doi.org/10.1080/0020739X.2014.990529

Kwok, R. C. W., & Ma, J. (1999). Use of a group support system for collaborative assessment. Computers & Education, 32(2), 109–125.

Lee, A. Y., & Hutchison, L. (1998). Improving learning from examples through reflection. Journal of Experimental Psychology: Applied, 4(3), 187–210. https://doi.org/10.1037/1076-898X.4.3.187

Liu, E. Z.-F., Lin, S. S. J., Chiu, C.-H., & Yuan, S.-M. (2001). Web-based peer review: The learner as both adapter and reviewer. IEEE Transactions on Education, 44(3), 246–251. https://doi.org/10.1109/13.940995

Liu, N.-F., & Carless, D. (2006). Peer feedback: The learning element of peer assessment. Teaching in Higher Education, 11(3), 279–290. https://doi.org/10.1080/13562510600680582

Loch, B., Jordan, C. R., Lowe, T. W., & Mestel, B. D. (2014). Do screencasts help to revise prerequisite mathematics? An investigation of student performance and perception. International Journal of Mathematical Education in Science and Technology, 45(2), 256–268. https://doi.org/10.1080/0020739X.2013.822581

Love, B., Hodge, A., Corritore, C., & Ernst, D. C. (2015). Inquiry-based learning and the flipped classroom model. PRIMUS: Problems, Resources, and Issues in Mathematics Undergraduate Studies, 25(8), 745–762. https://doi.org/10.1080/10511970.2015.1046005

Mowl, G., & Pain, R. (1995). Using self and peer assessment to improve students’ essay writing: A case study from geography. Innovations in Education and Training International, 32(4), 324–335. https://doi.org/10.1080/1355800950320404

Nastasi, B. K., & Clements, D. H. (1992). Social-cognitive behaviors and higher-order thinking in educational computer environments. Learning and Instruction, 2(3), 215–238. https://doi.org/10.1016/0959-4752(92)90010-J

Nicol, D. J., & Macfarlane-Dick, D. (2006). Formative assessment and self-regulated learning: A model and seven principles of good feedback practice. Studies in Higher Education, 31(2), 199–218.

Patchan, M. M., Schunn, C. D., & Clark, R. J. (2018). Accountability in peer assessment: Examining the effects of reviewing grades on peer ratings and peer feedback. Studies in Higher Education, 43(12), 2263–2278. https://doi.org/10.1080/03075079.2017.1320374

Peter, E. E. (2012). Critical thinking: Essence for teaching mathematics and mathematics problem solving skills. African Journal of Mathematics and Computer Science Research, 5(3), 39–43. https://doi.org/10.5897/AJMCSR11.161

Reinholz, D. (2016). The assessment cycle: A model for learning through peer assessment. Assessment & Evaluation in Higher Education, 41(2), 301–315. https://doi.org/10.1080/02602938.2015.1008982

Scott, F. J. (2017). A simulated peer-assessment approach to improve students’ performance in numerical problem-solving questions in high school biology. Journal of Biological Education, 51(2), 107–122. https://doi.org/10.1080/00219266.2016.1177571

Sheatsley, P. B. (1983). Questionnaire construction and item writing. In P. H. Rossi, J. D. Wright, & A. B. Anderson (Eds.), Handbook of survey research (pp. 195–230). New York, NY: Academic Press.

Silver, H. F. (2010). Compare & contrast: Teaching comparative thinking to strengthen student learning (A strategic teacher PLC guide). Alexandria, VA: Association for Supervision & Curriculum Development.

Stefani, L. A. J. (1994). Peer, self and tutor assessment: Relative reliabilities. Studies in Higher Education, 19(1), 69–75. https://doi.org/10.1080/03075079412331382153

Strang, K. D. (2013). Determining the consistency of student grading in a Hybrid Business course using a LMS and statistical software. International Journal of Web-Based Learning and Teaching Technologies (IJWLTT), 8(2), 58–76. https://doi.org/10.4018/jwltt.2013040103

Sun, D. L., Harris, N., Walther, G., & Baiocchi, M. (2015). Peer assessment enhances student learning: The results of a matched randomized crossover experiment in a college statistics class. PLoS ONE, 10(12), e0143177. https://doi.org/10.1371/journal.pone.0143177

Tanner, H., & Jones, S. (1994). Using peer and self-assessment to develop modelling skills with students aged 11 to 16: A socio-constructive view. Educational Studies in Mathematics, 27(4), 413–431. https://doi.org/10.1007/BF01273381

Topping, K. (1998). Peer assessment between students in colleges and universities. Review of Educational Research, 68(3), 249–276. https://doi.org/10.3102/00346543068003249

Triola, M. F. (2012). Elementary statistics technology update (11th ed.). Boston, MA: Addison-Wisley.

van Woerkom, M. (2010). Critical reflection as a rationalistic ideal. Adult Education Quarterly, 60(4), 339–356. https://doi.org/10.1177/0741713609358446

Wain, A. (2017). Learning through reflection. British Journal of Midwifery, 25(10), 662–666. https://doi.org/10.12968/bjom.2017.25.10.662

Wen, M. L., & Tsai, C.-C. (2006). University students’ perceptions of and attitudes toward (online) peer assessment. Higher Education, 51(1), 27–44. https://doi.org/10.1007/s10734-004-6375-8

Willey, K., & Gardner, A. (2010). Investigating the capacity of self and peer assessment activities to engage students and promote learning. European Journal of Engineering Education, 35(4), 429–443. https://doi.org/10.1080/03043797.2010.490577

Yang, Y.-F., & Tsai, C.-C. (2010). Conceptions of and approaches to learning through online peer assessment. Learning and Instruction, 20(1), 72–83.




DOI: https://doi.org/10.21831/reid.v4i2.20951

Refbacks





Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.




Find REID (Research and Evaluation in Education) on:

  

ISSN 2460-6995 (Online)

View REiD Visitor Statistics