Assessing motor competence in Indonesian sports science admissions: A comparison of portfolio assessment and direct practical testing
Indonesia's National Selection for State University Admission (SNMPTN) for Sports Science programs has shifted from practical motor skill tests to portfolio-based assessment, raising concerns about validity and reliability in measuring motor competence. This study examined the validity and reliability of portfolio assessment by comparing it with direct motor skill tests as the criterion measure. A quantitative descriptive-verificative design involved 50 Physical Education students at Jenderal Soedirman University with complete portfolio and practical test data. Four motor skill domains were assessed: hand-eye coordination, agility, lower-limb muscle power, and endurance. Statistical analyses included Wilcoxon test, Spearman's correlation, Intraclass Correlation Coefficient (ICC), Bland-Altman analysis, and error measurements. Results showed portfolio scores consistently overestimated performance with significant differences in three domains (p ≤ 0.001). Spearman's correlations ranged from moderate to strong (ρ = 0.432–0.814), yet ICC values indicated low-to-moderate absolute agreement except for lower-limb muscle power (ICC = 0.800). Bland-Altman analysis revealed systematic positive bias with wide limits of agreement. These findings suggest portfolio assessment is inadequate as a standalone instrument for selecting candidates based on motor skills and should serve as a complementary tool to standardize direct practical tests in Sports Science admissions.
Downloads
Abudari, A. S., Al dababseh, M. F., & Al Fattah, O. A. (2022). Standard levels of physical fitness components as one of the admission indicators for students of sports excellence. International Journal of Health Sciences, 11641–11650. https://doi.org/10.53730/ijhs.v6nS5.12013
Carballo-Fazanes, A., Rey, E., Valentini, N. C., Rodríguez-Fernández, J. E., Varela-Casal, C., Rico-Díaz, J., Barcala-Furelos, R., & Abelairas-Gómez, C. (2021). Intra-rater (Live vs. video assessment) and inter-rater (Expert vs. novice) reliability of the test of gross motor development, third edition. International Journal of Environmental Research and Public Health, 18(4), 1652. https://doi.org/10.3390/ijerph18041652
Choo, L., Novak, A., Impellizzeri, F. M., Porter, C., & Fransen, J. (2024). Skill acquisition interventions for the learning of sports-related skills: A scoping review of randomised controlled trials. Psychology of Sport and Exercise, 72, 102615. https://doi.org/10.1016/j.psychsport.2024.102615
de Jong, L. H., Bok, H. G. J., Schellekens, L. H., Kremer, W. D. J., Jonker, F. H., & van der Vleuten, C. P. M. (2022). Shaping the right conditions in programmatic assessment: how quality of narrative information affects the quality of high-stakes decision-making. BMC Medical Education, 22(1), 409. https://doi.org/10.1186/s12909-022-03257-2
Debertin, D., Wargel, A., & Mohr, M. (2024). Reliability of Xsens IMU-based lower extremity joint angles during in-field running. Sensors, 24(3), 871. https://doi.org/10.3390/s24030871
Eddy, L. H., Bingham, D. D., Crossley, K. L., Shahid, N. F., Ellingham-Khan, M., Otteslev, A., Figueredo, N. S., Mon-Williams, M., & Hill, L. J. B. (2020). The validity and reliability of observational assessment tools available to measure fundamental movement skills in school-age children: A systematic review. PLOS ONE, 15(8), e0237919. https://doi.org/10.1371/journal.pone.0237919
Fouche, I., Dison, L., Andrews, G., & Prozesky, M. (2021). Pedagogical and decolonial affordances of group portfolio assessments for learning in South African universities. Critical Studies in Teaching and Learning, 9(SI). https://doi.org/10.14426/cristal.v9iSI.325
Goosey-Tolfrey, V. L., de Groot, S., Tolfrey, K., & Paulson, T. A. W. (2021). Criterion validity of a field-based assessment of aerobic capacity in wheelchair rugby athletes. International Journal of Sports Physiology and Performance, 16(9), 1341–1346. https://doi.org/10.1123/ijspp.2020-0517
Hawkins, M., Elsworth, G. R., Nolte, S., & Osborne, R. H. (2021). Validity arguments for patient-reported outcomes: justifying the intended interpretation and use of data. Journal of Patient-Reported Outcomes, 5(1), 64. https://doi.org/10.1186/s41687-021-00332-y
Hariadi, H., Valianto, B., Akhmad, I., & bin Syed Ali, K. S. (2025). Implementation study of authentic assessment in physical education in Indonesia and Malaysia. Cakrawala Pendidikan: Jurnal Ilmiah Pendidikan, 44(1), 102-115. DOI: https://doi.org/10.21831/cp.v44i1.71485
Hogan, J., Penney, D., O’Hara, E., & Scott, J. (2023). Stakeholder perceptions of the feasibility of e-portfolio-based assessment of physical literacy in primary health and physical education. Physical Education and Sport Pedagogy, 1(1), 1–17. https://doi.org/10.1080/17408989.2023.2287523
Hulteen, R. M., True, L., & Kroc, E. (2023). Trust the “process”? When fundamental motor skill scores are reliably unreliable. Measurement in Physical Education and Exercise Science, 27(4), 391–402. https://doi.org/10.1080/1091367X.2023.2199126
James, L. P., Haycraft, J. A. Z., Carey, D. L., & Robertson, S. J. (2024). A framework for test measurement selection in athlete physical preparation. Frontiers in Sports and Active Living, 6. https://doi.org/10.3389/fspor.2024.1406997
Jimenez-Iglesias, J., Gonzalo-Skok, O., Landi-Fernández, M., Perez-Bey, A., & Castro-Piñero, J. (2024). Age-related differences and reliability of a field-based fitness test battery in young trained footballers: The role of biological age. Life, 14(11), 1448. https://doi.org/10.3390/life14111448
Kristiyandaru, A., Prakoso, B. B., Fitroni, H., Primanata, D., Hartati, S.C.Y., & Kartiko, D.C. (2023). Factors influencing assessment in higher education: Empirical evidence from physical education and fitness compulsory courses in Indonesia. Cakrawala Pendidikan: Jurnal Ilmiah Pendidikan, 42(3), 617-630. DOI: https://doi.org/10.21831/cp.v42i3.60151
Lindberg, K., Solberg, P., Bjørnsen, T., Helland, C., Rønnestad, B., Thorsen Frank, M., Haugen, T., Østerås, S., Kristoffersen, M., Midttun, M., Sæland, F., Eythorsdottir, I., & Paulsen, G. (2022). Strength and power testing of athletes: Associations of common assessments over time. International Journal of Sports Physiology and Performance, 17(8), 1280–1288. https://doi.org/10.1123/ijspp.2021-0557
Liu, J., & Li, Y. (2022). The visual movement analysis of physical education teaching considering the generalized hough transform model. Computational Intelligence and Neuroscience, 2022, 1–11. https://doi.org/10.1155/2022/3675319
Louder, T., Thompson, B. J., & Bressel, E. (2021). Association and agreement between reactive strength index and reactive strength index-modified scores. Sports, 9(7), 97. https://doi.org/10.3390/sports9070097
Makaruk, H., Porter, J. M., Webster, E. K., Makaruk, B., Bodasińska, A., Zieliński, J., Tomaszewski, P., Nogal, M., Szyszka, P., Starzak, M., Śliwa, M., Banaś, M., Biegajło, M., Chaliburda, A., Gierczuk, D., Suchecki, B., Molik, B., & Sadowski, J. (2023). The fus test: a promising tool for evaluating fundamental motor skills in children and adolescents. BMC Public Health, 23(1), 1912. https://doi.org/10.1186/s12889-023-16843-w
Miqueleiz, U., Aguado-Jimenez, R., Lecumberri, P., Garcia-Tabar, I., & M. Gorostiaga, E. (2025). Reliability of inertial measurement unit-based spatiotemporal and kinetic variables in endurance runners during treadmill running. Journal of Human Kinetics, 97, 65–76. https://doi.org/10.5114/jhk/195895
Ng, J. L., & Button, C. (2023). Construct validation of a general movement competence assessment utilising active video gaming technology. Frontiers in Bioengineering and Biotechnology, 11. https://doi.org/10.3389/fbioe.2023.1094469
Nikolaidis, P. (2023). Exercise testing and motivation. Sci, 5(1), 12. https://doi.org/10.3390/sci5010012
Otero-Saborido, F. M., Torreblanca-Martínez, V., & González-Jurado, J. A. (2021). Systematic review of self-assessment in physical education. International Journal of Environmental Research and Public Health, 18(2), 766. https://doi.org/10.3390/ijerph18020766
Pang, Y., Zhang, K., & Li, F. (2025). Explainable quality assessment of effective aligned skeletal representations for martial arts movements by multi-machine learning decisions. Scientific Reports, 15(1), 323. https://doi.org/10.1038/s41598-024-83475-4
Peng, S., Khairani, A. Z., Rabiu Uba, A., & Yuan, F. (2025). Physical activity measurement tools among college students in intervention studies: A systematic review. PLOS ONE, 20(4), e0321593. https://doi.org/10.1371/journal.pone.0321593
Penney, D., O’Hara, E., & Lund, R. (2023). Enhancing quality and equity? Performance assessment validation in examination physical education in Western Australia. Curriculum Studies in Health and Physical Education, 14(3), 288–305. https://doi.org/10.1080/25742981.2022.2136007
Pool, A. O., Jaarsma, A. D. C., Driessen, E. W., & Govaerts, M. J. B. (2020). Student perspectives on competency-based portfolios: Does portfolio reflect their competence development? Perspectives on Medical Education, 9(3), 166–172. https://doi.org/10.1007/S40037-020-00571-7
Ramos-Campo, D. J., Foster, C., Andreu-Caravaca, L., Rubio-Arias, J. Á., & Rosenblat, M. A. (2026). Comparative effects of pacing strategies on endurance performance: a systematic review and network meta-analysis. Sports Medicine, 56(3), 725–738. https://doi.org/10.1007/s40279-025-02367-3
Rey, E., Carballo-Fazanes, A., Varela-Casal, C., & Abelairas-Gómez, C. (2020). Reliability of the test of gross motor development: A systematic review. PLOS ONE, 15(7), e0236070. https://doi.org/10.1371/journal.pone.0236070
Ross, G. B., Zhao, X., Troje, N. F., Fischer, S. L., & Graham, R. B. (2024). Assessing inter- and intra-rater reliability of movement scores and the effects of body-shape using a custom visualisation tool: an exploratory study. BMC Sports Science, Medicine and Rehabilitation, 16(1), 205. https://doi.org/10.1186/s13102-024-00988-1
Stjepanovic, M., Knechtle, B., Weiss, K., Nikolaidis, P. T., Cuk, I., Thuany, M., & Sousa, C. V. (2023). Changes in pacing variation with increasing race duration in ultra-triathlon races. Scientific Reports, 13(1), 3692. https://doi.org/10.1038/s41598-023-30932-1
Sunardianta, R., Prasojo, L. D., Yuliarto, H., & Firmansyah, F. (2024). Child friendly school-based learning management model for health and physical education. Cakrawala Pendidikan: Jurnal Ilmiah Pendidikan, 43(2), 459-469. DOI:https://doi.org/10.21831/cp.v43i2.64652
Thron, M., Düking, P., Ruf, L., Härtel, S., Woll, A., & Altmann, S. (2024). Assessing anaerobic speed reserve: A systematic review on the validity and reliability of methods to determine maximal aerobic speed and maximal sprinting speed in running-based sports. PLOS ONE, 19(1), e0296866. https://doi.org/10.1371/journal.pone.0296866
van Maarseveen, M., Leenhouts, J., de Witte, A., Flux, E., van Doorn, H., & van der Kamp, J. (2025). Enhancing affordance perception in pre-service physical education teachers: effects of content knowledge, motor experience and visual experience programs. Frontiers in Sports and Active Living, 7. https://doi.org/10.3389/fspor.2025.1583448
Warneke, K., Gronwald, T., Wallot, S., Magno, A., Hillebrecht, M., & Wirth, K. (2025). Discussion on the validity of commonly used reliability indices in sports medicine and exercise science: a critical review with data simulations. European Journal of Applied Physiology, 125(6), 1511–1526. https://doi.org/10.1007/s00421-025-05720-6
Warneke, K., Skratek, J., Wagner, C.-M., Wirth, K., & Keiner, M. (2024). Random measurement and prediction errors limit the practical relevance of two velocity sensors to estimate the 1RM back squat. Frontiers in Physiology, 15. https://doi.org/10.3389/fphys.2024.1435103
Yang, Q., Song, M., Chen, X., Li, M., & Wang, X. (2025). The influence of linear and nonlinear pedagogy on motor skill performance: the moderating role of adaptability. Frontiers in Psychology, 16(1), 1–11. https://doi.org/10.3389/fpsyg.2025.1540821
Yu, X., Huang, Z., Yang, S., Wang, Z., Ma, H., & Zhang, X. (2026). PEOAT: Personalization-guided evolutionary question assembly for one-shot adaptive testing. Proceedings of the AAAI Conference on Artificial Intelligence, 40(33), 27978–27986. https://doi.org/10.1609/aaai.v40i33.40022
Copyright (c) 2026 Ngadiman, Akbar Kusuma Abadi, Eko Sumianto, Agung Prabowo, Bayu Suko Wahono
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Jurnal Cakrawala Pendidikan, Jurnal Ilmiah Pendidikan, with ISSN: 0216-1370, is published by the Institute of Education Development and Quality Assurance (LPPMP UNY). Cakrawala Pendidikan has been recently has been re-accredited by Indonesian Ministry of Education and Culture decision Number 230/E/KPT/2022 which is valid for five years since enacted on 30 December 2022.
