Factors influencing assessment in higher education: Empirical evidence from physical education and fitness compulsory courses in Indonesia

Advendi Kristiyandaru, Universitas Negeri Surabaya, Indonesia
Bayu Budi Prakoso, Universitas Negeri Surabaya, Indonesia
Hijrin Fithroni, Universitas Negeri Surabaya, Indonesia
Dani Primanata, Universitas Negeri Surabaya, Indonesia
Sasminta Christina Yuli Hartati, Universitas Negeri Surabaya, Indonesia
Dwi Cahyo Kartiko, Universitas Negeri Surabaya, Indonesia

Abstract


The present study delves into the multifarious factors that underpin students' learning assessment in higher education. Through the utilisation of an exploratory sequential mixed methods design, the researchers scrutinise the evaluation of 5,564 students by 23 lecturers, taking into consideration 9 characteristics. To that end, ANOVA and T-test are employed to analyse the mandatory course, and three lecturers who embody distinct criteria are interviewed, and their responses are subjected to a thematic analysis. The results indicate that assessment results are significantly different based on lecturers' working experience (teaching experience [F= 20.1, p= 0.000] and age [F= 48.6, p= 0.000]), academic background (department [F= 33.8, p= 0.000] and skills [F= 30.17, p= 0.000]), and teaching load (credit unit (credit unit) [F= 48.7, p= 0.000], number of classes taught [F= 61.4, p= 0.000] and teaching partners [F= 79.3, p=0.000]). Meanwhile, there is no difference in assessment results based on lecturers' qualifications (certificates [t= -0.587, p= 0.557] and latest degree [F= 2.56, p= 0.074]). The qualitative data reveals that four crucial factors - idealism, mindset, grading standard, and perspective - account for the variance observed in compulsory courses. The study's results underscore the need for universities to devise pedagogical strategies based on lecturers' attributes, as these factors bear a direct impact on the attainment of the desired graduate profiles as reflected in students' academic performance in specific courses. 


Keywords


physical education; higher education; assessment; lecturer characteristics

Full Text:

PDF

References


Allen, I. E., & Seaman, J. (2017). Digital Compass Learning: Distance Education Enrollment Report 2017. In Babson Survey Research Group. Babson Survey Research Group. Babson College, 231 Forest Street, Babson Park, MA 02457. Tel: 909-278-7389; Web site: http://www.babson.edu/Academics/centers/blank-center/global-research/Pages/babson-survey-research-group.aspx. https://eric.ed.gov/?id=ed580868

Bahous, R., & Nabhani, M. (2011). Assessing education program learning outcomes. Educational Assessment, Evaluation and Accountability, 23(1), 21–39. https://doi.org/10.1007/S11092-010-9112-0/TABLES/1

Bahous, R., & Nabhani, M. (2015). Faculty Views on Developing and Assessing Learning Outcomes at the Tertiary Level. The Journal of General Education, 64(4), 294–309. https://doi.org/10.5325/JGENEEDUC.64.4.0294

Bazvand, A. D., & Rasooli, A. (2022). Students' experiences of fairness in summative assessment: A study in a higher education context. Studies in Educational Evaluation, 72, 101118. https://doi.org/10.1016/J.STUEDUC.2021.101118

Cahyadi, A., Hendryadi, Widyastuti, S., Mufidah, V. N., & Achmadi. (2021). Emergency remote teaching evaluation of the higher education in Indonesia. Heliyon, 7(8), e07788. https://doi.org/10.1016/J.HELIYON.2021.E07788

Coates, H., & Zlatkin-Troitschanskaia, O. (2019). The Governance, Policy and Strategy of Learning Outcomes Assessment in Higher Education. Higher Education Policy, 32(4), 507–512. https://doi.org/10.1057/S41307-019-00161-1/METRICS

Creswell, J. W., & Clark, V. L. P. (2017). Designing and Conducting Mixed Methods Research. SAGE Publications.

D'elia, F. (2019). The training of physical education teacher in primary school. Journal of Human Sport and Exercise, 14, S100–S104. https://doi.org/10.14198/JHSE.2019.14.PROC1.12

D'isanto, T. (2019). State of art and didactics opportunities of Physical Education teaching in Primary School. Journal of Physical Education and Sport ® (JPES), 19, 1759–1762. https://doi.org/10.7752/jpes.2019.s5257

Eckhaus, E., & Davidovitch, N. (2019). Potential for Blocking Advancement: Teaching Surveys for Student Evaluation of Lecturers. International Journal of Educational Methodology, 5(3), 401–406. https://doi.org/10.12973/IJEM.5.3.401

Elia, F. D. ’, & Uk, A. (2020). Teachers' perspectives about contents and learning aim of physical education in Italian primary school CORE View metadata, citation and similar papers at core. https://doi.org/10.14198/jhse.2020.15.Proc2.19

Evi, M., Bambang, T., & Sri, N. (2021). Factors Affecting Student Performance in E-Learning: A Case Study of Higher Educational Institutions in Indonesia *. Journal of Asian Finance, 8(4), 993–1001. https://doi.org/10.13106/jafeb.2021.vol8.no4.0993

Farias, C. F. G., Harvey, S., Hastie, P. A., & Mesquita, I. M. R. (2019). Effects of situational constraints on students' game-play development over three consecutive Sport Education seasons of invasion games. Https://Doi.Org/10.1080/17408989.2019.1571184, 24(3), 267–286. https://doi.org/10.1080/17408989.2019.1571184

Gadi, N., Saleh, S., Johnson, J. A., & Trinidade, A. (2022). The impact of the COVID-19 Pandemic on the lifestyle and behaviours, mental health and education of students studying healthcare-related courses at a British university. BMC Medical Education, 22(1), 1–9. https://doi.org/10.1186/S12909-022-03179-Z/TABLES/2

Goss, H. (2022). Student Learning Outcomes Assessment in Higher Education and in Academic Libraries: A Review of the Literature. The Journal of Academic Librarianship, 48(2), 102485. https://doi.org/10.1016/J.ACALIB.2021.102485

Gouveia, É., Rúbio, ;, Gouveia, B., Raquel, ;, Marques, A. ;, Kliegel, M. ;, Rodrigues, A., José, ;, Prudente, J. ;, & Lopes, A. (2019). The effectiveness of a tactical games approach in the teaching of invasion games. Journal of Physical Education and Sport, 19(3), 962–970. https://doi.org/10.7752/jpes.2019.Doctoral139

Hendel, D. D., & Lewis, D. R. (2005). Quality assurance of higher education in transition countries: Accreditation - Accountability and assessment. Tertiary Education and Management, 11(3), 239–258. https://doi.org/10.1007/S11233-005-5111-Y/METRICS

Higson, H. E. (2020). Measures of engagement in the first three weeks of higher education predict subsequent activity and attainment in first year undergraduate students: a UK case study. RSA Blog; Routledge. https://doi.org/10.1080/02602938.2020.1822282

Howes, L., Ferrell, L., Pettys, G., & Roloff, A. (2021). Adapting to Remote Library Services during COVID-19. Https://Doi.Org/10.1080/02763869.2021.1873616, 40(1), 35–47. https://doi.org/10.1080/02763869.2021.1873616

Huber, S. G., & Skedsmo, G. (2016). Assessment in education—from early childhood to higher education. Educational Assessment, Evaluation and Accountability, 28(3), 201–203. https://doi.org/10.1007/S11092-016-9245-X/METRICS

Jankowski, N. A. (2020). Assessment During A Crisis: Responding to a Global Pandemic.

Kahu, E. R. (2013). Framing student engagement in higher education. Https://Doi.Org/10.1080/03075079.2011.598505, 38(5), 758–773. https://doi.org/10.1080/03075079.2011.598505

Kizilcec, R. F., Makridis, C. A., & Sadowski, K. C. (2021). Pandemic response policies' democratising effects on online learning. Proceedings of the National Academy of Sciences of the United States of America, 118(11). https://doi.org/10.1073/PNAS.2026725118

Kubrushko, P. F., Alipichev, A. Y., Kozlenkova, E. N., Nazarova, L. I., & Siman, A. S. (2020). Digital competence as the basis of a lecturer's readiness for innovative pedagogical activity. Journal of Physics: Conference Series, 1691(1), 012116. https://doi.org/10.1088/1742-6596/1691/1/012116

Martin, F., Sun, T., & Westine, C. D. (2020). A systematic review of research on online teaching and learning from 2009 to 2018. Computers & Education, 159, 104009. https://doi.org/10.1016/J.COMPEDU.2020.104009

Morgan, H. (2020). Best Practices for Implementing Remote Learning during a Pandemic. Https://Doi.Org/10.1080/00098655.2020.1751480, 93(3), 135–141. https://doi.org/10.1080/00098655.2020.1751480

Nguyen, L. A. T., & Habók, A. (2023). Tools for assessing teacher digital literacy: a review. Journal of Computers in Education, 1–42. https://doi.org/10.1007/S40692-022-00257-5/TABLES/4

Nurmawiya, & Harvian, K. A. (2022). Public sentiment towards face-to-face activities during the COVID-19 Pandemic in Indonesia. Procedia Computer Science, 197, 529–537. https://doi.org/10.1016/J.PROCS.2021.12.170

Ozer, S. (2013). Theories and Methodologies in Acculturation Psychology: The Emergence of a Scientific Revolution? Psychological Studies, 58(3), 339–348. https://doi.org/10.1007/s12646-013-0203-0

Prieto-Ayuso, A., Pastor-Vicedo, J. C., González-Víllora, S., & Contreras-Jordán, O. (2019). Observation Criteria for Physical Education Teachers to Identify Gifted Children through Invasion Games. International Journal of Environmental Research and Public Health 2019, Vol. 16, Page 4830, 16(23), 4830. https://doi.org/10.3390/IJERPH16234830

Robertshaw, M. B., & Asher, A. (2019). Unethical Numbers? A Meta-analysis of Library Learning Analytics Studies. Library Trends, 68(1), 76–101. https://doi.org/10.1353/LIB.2019.0031

Santos, J., Jesus, L. F. De, Sealmoy, R. R., & Fajardo, R. R. C. (2020). Online Distance Learning Amidst COVID-19. IJERI: International Journal of Educational Research and Innovation, 15(15), 291–304. https://doi.org/10.46661/ijeri.5271

Shiyanbola, O. O., Rao, D., Bolt, D., Brown, C., Zhang, M., & Ward, E. (2021). Using an exploratory sequential mixed methods design to adapt an Illness Perception Questionnaire for African Americans with diabetes: the mixed data integration process. https://doi.org/10.1080/21642850.2021.1976650

Sinatra, G. M., Heddy, B. C., & Lombardi, D. (2015). The Challenges of Defining and Measuring Student Engagement in Science. Https://Doi.Org/10.1080/00461520.2014.1002924, 50(1). https://doi.org/10.1080/00461520.2014.1002924

Sulaiman, T., Kotamjani, S. S., Rahim, S. S. A., & Hakim, M. N. (2020). Malaysian Public University Lecturers’ Perceptions and Practices of Formative and Alternative Assessments. International Journal of Learning, Teaching and Educational Research, 19(5), 379–394. https://doi.org/10.26803/IJLTER.19.5.23

Summers, R., Higson, H., & Moores, E. (2021). The impact of disadvantage on higher education engagement during different delivery modes: a pre- versus peri-pandemic comparison of learning analytics data. Assessment and Evaluation in Higher Education, 48(1), 56–66. https://doi.org/10.1080/02602938.2021.2024793

Summers, R. J., Higson, H. E., & Moores, E. (2020). Measures of engagement in the first three weeks of higher education predict subsequent activity and attainment in first year undergraduate students: a UK case study. Https://Doi.Org/10.1080/02602938.2020.1822282, 46(5), 821–836. https://doi.org/10.1080/02602938.2020.1822282

Suroto, S., Kuntjoro, B. F. T., Dinata, V. C., & Prakoso, B. B. (2022). Active learning to improve self-learning among student teachers. Jurnal SPORTIF : Jurnal Penelitian Pembelajaran, 8(2), 226–240. https://doi.org/10.29407/JS_UNPGRI.V8I2.18315

Susanti, S., Van Harling, V. N., Kurniawan, M. A., Rusdin, Asdi, & Putra, A. H. P. K. (2019). Model of Higher Education Quality Improvement in Indonesia: Relationship between HRM and Information Technology Literacy. Journal of Physics: Conference Series, 1424(1), 012035. https://doi.org/10.1088/1742-6596/1424/1/012035

van Dijk, E. E., van Tartwijk, J., van der Schaaf, M. F., & Kluijtmans, M. (2020). What makes an expert university teacher? A systematic review and synthesis of frameworks for teacher expertise in higher education. Educational Research Review, 31, 100365. https://doi.org/10.1016/J.EDUREV.2020.100365

Waheed, H., Hassan, S. U., Aljohani, N. R., Hardman, J., Alelyani, S., & Nawaz, R. (2020). Predicting academic performance of students from VLE big data using deep learning models. Computers in Human Behavior, 104, 106189. https://doi.org/10.1016/J.CHB.2019.106189

Wang, D., Sun, Y., & Jiang, T. (2018). The Assessment of Higher Education Quality from the Perspective of Students through a Case Study Analysis. Frontiers of Education in China, 13(2), 267–287. https://doi.org/10.1007/S11516-018-0014-0/METRICS

Yan, Z., & Cheng, E. C. K. (2015). Primary teachers' attitudes, intentions and practices regarding formative assessment. Teaching and Teacher Education, 45, 128–136. https://doi.org/10.1016/J.TATE.2014.10.002

Yuting, Z., Adams, D., & Lee, K. C. S. (2022). The relationship between technology leadership and teacher ICT competency in higher education. Education and Information Technologies, 27(7), 10285–10307. https://doi.org/10.1007/S10639-022-11037-0/TABLES/9




DOI: https://doi.org/10.21831/cp.v42i3.60151

Refbacks

  • There are currently no refbacks.




 

Social Media:

     


 

 Creative Commons License
Jurnal Cakrawala Pendidikan by Lembaga Pengembangan dan Penjaminan Mutu Pendidikan UNY is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Based on a work at http://journal.uny.ac.id/index.php/cp/index.

Translator
 
 web
analytics
View Our Stats

Flag Counter