Email this article 
Factors influencing assessment in higher education: Empirical evidence from physical education and fitness compulsory courses in Indonesia
Bayu Budi Prakoso, Universitas Negeri Surabaya, Indonesia
Hijrin Fithroni, Universitas Negeri Surabaya, Indonesia
Dani Primanata, Universitas Negeri Surabaya, Indonesia
Sasminta Christina Yuli Hartati, Universitas Negeri Surabaya, Indonesia
Dwi Cahyo Kartiko, Universitas Negeri Surabaya, Indonesia
Abstract
The present study delves into the multifarious factors that underpin students' learning assessment in higher education. Through the utilisation of an exploratory sequential mixed methods design, the researchers scrutinise the evaluation of 5,564 students by 23 lecturers, taking into consideration 9 characteristics. To that end, ANOVA and T-test are employed to analyse the mandatory course, and three lecturers who embody distinct criteria are interviewed, and their responses are subjected to a thematic analysis. The results indicate that assessment results are significantly different based on lecturers' working experience (teaching experience [F= 20.1, p= 0.000] and age [F= 48.6, p= 0.000]), academic background (department [F= 33.8, p= 0.000] and skills [F= 30.17, p= 0.000]), and teaching load (credit unit (credit unit) [F= 48.7, p= 0.000], number of classes taught [F= 61.4, p= 0.000] and teaching partners [F= 79.3, p=0.000]). Meanwhile, there is no difference in assessment results based on lecturers' qualifications (certificates [t= -0.587, p= 0.557] and latest degree [F= 2.56, p= 0.074]). The qualitative data reveals that four crucial factors - idealism, mindset, grading standard, and perspective - account for the variance observed in compulsory courses. The study's results underscore the need for universities to devise pedagogical strategies based on lecturers' attributes, as these factors bear a direct impact on the attainment of the desired graduate profiles as reflected in students' academic performance in specific courses.
Keywords
Full Text:
PDFReferences
Allen, I. E., & Seaman, J. (2017). Digital Compass Learning: Distance Education Enrollment Report 2017. In Babson Survey Research Group. Babson Survey Research Group. Babson College, 231 Forest Street, Babson Park, MA 02457. Tel: 909-278-7389; Web site: http://www.babson.edu/Academics/centers/blank-center/global-research/Pages/babson-survey-research-group.aspx. https://eric.ed.gov/?id=ed580868
Bahous, R., & Nabhani, M. (2011). Assessing education program learning outcomes. Educational Assessment, Evaluation and Accountability, 23(1), 21–39. https://doi.org/10.1007/S11092-010-9112-0/TABLES/1
Bahous, R., & Nabhani, M. (2015). Faculty Views on Developing and Assessing Learning Outcomes at the Tertiary Level. The Journal of General Education, 64(4), 294–309. https://doi.org/10.5325/JGENEEDUC.64.4.0294
Bazvand, A. D., & Rasooli, A. (2022). Students' experiences of fairness in summative assessment: A study in a higher education context. Studies in Educational Evaluation, 72, 101118. https://doi.org/10.1016/J.STUEDUC.2021.101118
Cahyadi, A., Hendryadi, Widyastuti, S., Mufidah, V. N., & Achmadi. (2021). Emergency remote teaching evaluation of the higher education in Indonesia. Heliyon, 7(8), e07788. https://doi.org/10.1016/J.HELIYON.2021.E07788
Coates, H., & Zlatkin-Troitschanskaia, O. (2019). The Governance, Policy and Strategy of Learning Outcomes Assessment in Higher Education. Higher Education Policy, 32(4), 507–512. https://doi.org/10.1057/S41307-019-00161-1/METRICS
Creswell, J. W., & Clark, V. L. P. (2017). Designing and Conducting Mixed Methods Research. SAGE Publications.
D'elia, F. (2019). The training of physical education teacher in primary school. Journal of Human Sport and Exercise, 14, S100–S104. https://doi.org/10.14198/JHSE.2019.14.PROC1.12
D'isanto, T. (2019). State of art and didactics opportunities of Physical Education teaching in Primary School. Journal of Physical Education and Sport ® (JPES), 19, 1759–1762. https://doi.org/10.7752/jpes.2019.s5257
Eckhaus, E., & Davidovitch, N. (2019). Potential for Blocking Advancement: Teaching Surveys for Student Evaluation of Lecturers. International Journal of Educational Methodology, 5(3), 401–406. https://doi.org/10.12973/IJEM.5.3.401
Elia, F. D. ’, & Uk, A. (2020). Teachers' perspectives about contents and learning aim of physical education in Italian primary school CORE View metadata, citation and similar papers at core. https://doi.org/10.14198/jhse.2020.15.Proc2.19
Evi, M., Bambang, T., & Sri, N. (2021). Factors Affecting Student Performance in E-Learning: A Case Study of Higher Educational Institutions in Indonesia *. Journal of Asian Finance, 8(4), 993–1001. https://doi.org/10.13106/jafeb.2021.vol8.no4.0993
Farias, C. F. G., Harvey, S., Hastie, P. A., & Mesquita, I. M. R. (2019). Effects of situational constraints on students' game-play development over three consecutive Sport Education seasons of invasion games. Https://Doi.Org/10.1080/17408989.2019.1571184, 24(3), 267–286. https://doi.org/10.1080/17408989.2019.1571184
Gadi, N., Saleh, S., Johnson, J. A., & Trinidade, A. (2022). The impact of the COVID-19 Pandemic on the lifestyle and behaviours, mental health and education of students studying healthcare-related courses at a British university. BMC Medical Education, 22(1), 1–9. https://doi.org/10.1186/S12909-022-03179-Z/TABLES/2
Goss, H. (2022). Student Learning Outcomes Assessment in Higher Education and in Academic Libraries: A Review of the Literature. The Journal of Academic Librarianship, 48(2), 102485. https://doi.org/10.1016/J.ACALIB.2021.102485
Gouveia, É., Rúbio, ;, Gouveia, B., Raquel, ;, Marques, A. ;, Kliegel, M. ;, Rodrigues, A., José, ;, Prudente, J. ;, & Lopes, A. (2019). The effectiveness of a tactical games approach in the teaching of invasion games. Journal of Physical Education and Sport, 19(3), 962–970. https://doi.org/10.7752/jpes.2019.Doctoral139
Hendel, D. D., & Lewis, D. R. (2005). Quality assurance of higher education in transition countries: Accreditation - Accountability and assessment. Tertiary Education and Management, 11(3), 239–258. https://doi.org/10.1007/S11233-005-5111-Y/METRICS
Higson, H. E. (2020). Measures of engagement in the first three weeks of higher education predict subsequent activity and attainment in first year undergraduate students: a UK case study. RSA Blog; Routledge. https://doi.org/10.1080/02602938.2020.1822282
Howes, L., Ferrell, L., Pettys, G., & Roloff, A. (2021). Adapting to Remote Library Services during COVID-19. Https://Doi.Org/10.1080/02763869.2021.1873616, 40(1), 35–47. https://doi.org/10.1080/02763869.2021.1873616
Huber, S. G., & Skedsmo, G. (2016). Assessment in education—from early childhood to higher education. Educational Assessment, Evaluation and Accountability, 28(3), 201–203. https://doi.org/10.1007/S11092-016-9245-X/METRICS
Jankowski, N. A. (2020). Assessment During A Crisis: Responding to a Global Pandemic.
Kahu, E. R. (2013). Framing student engagement in higher education. Https://Doi.Org/10.1080/03075079.2011.598505, 38(5), 758–773. https://doi.org/10.1080/03075079.2011.598505
Kizilcec, R. F., Makridis, C. A., & Sadowski, K. C. (2021). Pandemic response policies' democratising effects on online learning. Proceedings of the National Academy of Sciences of the United States of America, 118(11). https://doi.org/10.1073/PNAS.2026725118
Kubrushko, P. F., Alipichev, A. Y., Kozlenkova, E. N., Nazarova, L. I., & Siman, A. S. (2020). Digital competence as the basis of a lecturer's readiness for innovative pedagogical activity. Journal of Physics: Conference Series, 1691(1), 012116. https://doi.org/10.1088/1742-6596/1691/1/012116
Martin, F., Sun, T., & Westine, C. D. (2020). A systematic review of research on online teaching and learning from 2009 to 2018. Computers & Education, 159, 104009. https://doi.org/10.1016/J.COMPEDU.2020.104009
Morgan, H. (2020). Best Practices for Implementing Remote Learning during a Pandemic. Https://Doi.Org/10.1080/00098655.2020.1751480, 93(3), 135–141. https://doi.org/10.1080/00098655.2020.1751480
Nguyen, L. A. T., & Habók, A. (2023). Tools for assessing teacher digital literacy: a review. Journal of Computers in Education, 1–42. https://doi.org/10.1007/S40692-022-00257-5/TABLES/4
Nurmawiya, & Harvian, K. A. (2022). Public sentiment towards face-to-face activities during the COVID-19 Pandemic in Indonesia. Procedia Computer Science, 197, 529–537. https://doi.org/10.1016/J.PROCS.2021.12.170
Ozer, S. (2013). Theories and Methodologies in Acculturation Psychology: The Emergence of a Scientific Revolution? Psychological Studies, 58(3), 339–348. https://doi.org/10.1007/s12646-013-0203-0
Prieto-Ayuso, A., Pastor-Vicedo, J. C., González-Víllora, S., & Contreras-Jordán, O. (2019). Observation Criteria for Physical Education Teachers to Identify Gifted Children through Invasion Games. International Journal of Environmental Research and Public Health 2019, Vol. 16, Page 4830, 16(23), 4830. https://doi.org/10.3390/IJERPH16234830
Robertshaw, M. B., & Asher, A. (2019). Unethical Numbers? A Meta-analysis of Library Learning Analytics Studies. Library Trends, 68(1), 76–101. https://doi.org/10.1353/LIB.2019.0031
Santos, J., Jesus, L. F. De, Sealmoy, R. R., & Fajardo, R. R. C. (2020). Online Distance Learning Amidst COVID-19. IJERI: International Journal of Educational Research and Innovation, 15(15), 291–304. https://doi.org/10.46661/ijeri.5271
Shiyanbola, O. O., Rao, D., Bolt, D., Brown, C., Zhang, M., & Ward, E. (2021). Using an exploratory sequential mixed methods design to adapt an Illness Perception Questionnaire for African Americans with diabetes: the mixed data integration process. https://doi.org/10.1080/21642850.2021.1976650
Sinatra, G. M., Heddy, B. C., & Lombardi, D. (2015). The Challenges of Defining and Measuring Student Engagement in Science. Https://Doi.Org/10.1080/00461520.2014.1002924, 50(1). https://doi.org/10.1080/00461520.2014.1002924
Sulaiman, T., Kotamjani, S. S., Rahim, S. S. A., & Hakim, M. N. (2020). Malaysian Public University Lecturers’ Perceptions and Practices of Formative and Alternative Assessments. International Journal of Learning, Teaching and Educational Research, 19(5), 379–394. https://doi.org/10.26803/IJLTER.19.5.23
Summers, R., Higson, H., & Moores, E. (2021). The impact of disadvantage on higher education engagement during different delivery modes: a pre- versus peri-pandemic comparison of learning analytics data. Assessment and Evaluation in Higher Education, 48(1), 56–66. https://doi.org/10.1080/02602938.2021.2024793
Summers, R. J., Higson, H. E., & Moores, E. (2020). Measures of engagement in the first three weeks of higher education predict subsequent activity and attainment in first year undergraduate students: a UK case study. Https://Doi.Org/10.1080/02602938.2020.1822282, 46(5), 821–836. https://doi.org/10.1080/02602938.2020.1822282
Suroto, S., Kuntjoro, B. F. T., Dinata, V. C., & Prakoso, B. B. (2022). Active learning to improve self-learning among student teachers. Jurnal SPORTIF : Jurnal Penelitian Pembelajaran, 8(2), 226–240. https://doi.org/10.29407/JS_UNPGRI.V8I2.18315
Susanti, S., Van Harling, V. N., Kurniawan, M. A., Rusdin, Asdi, & Putra, A. H. P. K. (2019). Model of Higher Education Quality Improvement in Indonesia: Relationship between HRM and Information Technology Literacy. Journal of Physics: Conference Series, 1424(1), 012035. https://doi.org/10.1088/1742-6596/1424/1/012035
van Dijk, E. E., van Tartwijk, J., van der Schaaf, M. F., & Kluijtmans, M. (2020). What makes an expert university teacher? A systematic review and synthesis of frameworks for teacher expertise in higher education. Educational Research Review, 31, 100365. https://doi.org/10.1016/J.EDUREV.2020.100365
Waheed, H., Hassan, S. U., Aljohani, N. R., Hardman, J., Alelyani, S., & Nawaz, R. (2020). Predicting academic performance of students from VLE big data using deep learning models. Computers in Human Behavior, 104, 106189. https://doi.org/10.1016/J.CHB.2019.106189
Wang, D., Sun, Y., & Jiang, T. (2018). The Assessment of Higher Education Quality from the Perspective of Students through a Case Study Analysis. Frontiers of Education in China, 13(2), 267–287. https://doi.org/10.1007/S11516-018-0014-0/METRICS
Yan, Z., & Cheng, E. C. K. (2015). Primary teachers' attitudes, intentions and practices regarding formative assessment. Teaching and Teacher Education, 45, 128–136. https://doi.org/10.1016/J.TATE.2014.10.002
Yuting, Z., Adams, D., & Lee, K. C. S. (2022). The relationship between technology leadership and teacher ICT competency in higher education. Education and Information Technologies, 27(7), 10285–10307. https://doi.org/10.1007/S10639-022-11037-0/TABLES/9
DOI: https://doi.org/10.21831/cp.v42i3.60151
Refbacks
- There are currently no refbacks.
Social Media:
Jurnal Cakrawala Pendidikan by Lembaga Pengembangan dan Penjaminan Mutu Pendidikan UNY is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Based on a work at https://journal.uny.ac.id/index.php/cp/index.
