Development of physical education teacher attitude instruments towards stimulating HOTS: PE-SHOTS questionnaire
Downloads
Students need higher-order thinking skills (HOTS) to develop optimally and answer the challenges of the 21st century. In addition, HOTS also needs stimulation in the learning process to grow optimally, and the teacher's decision to stimulate HOTS is highly dependent on the teacher's attitude towards stimulating HOTS itself. Hence, the teacher's attitude towards stimulating HOTS must be revealed. However, until now, teachers' attitudes, especially in physical education, towards stimulating HOTS have not been identified with certainty due to the unavailability of valid and reliable instruments. This study aims to develop an instrument to measure physical education teachers' attitudes toward stimulating HOTS in student. This study used a research and development design with the development stages consisting of a content validity test, ICC test, construct validity, reliability test and concuren validity. Based on these tests, it can be stated that 29 statement items have met the validity and reliability standards. Hence, the PE-SHOTS questionnaire instrument developed in this study is suitable
Ahmad, I. F., Putro, N. H. P. S., Thontowi, Z. S., Syafii, A., & Subakti, M. A. (2020). Trends in the Implementation of Higher-Order Thinking Skills in Islamic Religious Education in Madrasahs and Schools: A Systematic Literature Review. Jurnal Pendidikan Islam, 9, 195–216. https://doi.org/10.14421/JPI.2020.92.195-216
Ahmed, I., & Ishtiaq, S. (2021). Reliability and validity: Importance in Medical Research. JPMA. The Journal of the Pakistan Medical Association, 71 10, 2401–2406. https://doi.org/10.47391/JPMA.06-861
Alavi, M., Biros, E., & Cleary, M. (2023). Notes to Factor Analysis Techniques for Construct Validity. Canadian Journal of Nursing Research, 56, 164–170. https://doi.org/10.1177/08445621231204296
Alavi, M., Thapa, D. K., Biros, E., & Cleary, M. (2023). Considerations in the use of concurrent or predictive validity in clinical measurement. Nursing & Health Sciences, 25(2). https://doi.org/10.1111/nhs.13030
Bambling, M. (2024). The Problem of Scale Contamination and Construct Validity in Mental Health, Social Science and Spirituality-Related Research. Health and Social Care Chaplaincy. https://doi.org/10.1558/hscc.31277
Cerri, L., Justo, M. C., Clemente, V., Gomes, A. A., Pereira, A. S., & Marques, D. R. (2023). Insomnia Severity Index: A reliability generalisation meta"analysis. Journal of Sleep Research, 32. https://doi.org/10.1111/jsr.13835
Chenani, K. H. T., & Madadizadeh, F. (2021). Guideline for Selecting Types of Reliability and Suitable Intra-class Correlation Coefficients in Clinical Research. Journal of Biostatistics and Epidemiology. https://doi.org/10.18502/jbe.v7i3.7301
Damaianti, V. S., Abidin, Y., & Rahma, R. (2020). Higher order thinking skills-based reading literacy assessment instrument: An Indonesian context. Indonesian Journal of Applied Linguistics, 10, 513–525. https://doi.org/10.17509/ijal.v10i2.28600
de Barros Ahrens, R., da Silva Lirani, L., & de Francisco, A. C. (2020). Construct Validity and Reliability of the Work Environment Assessment Instrument WE-10. International Journal of Environmental Research and Public Health, 17. https://doi.org/10.3390/ijerph17207364
Fariyani, Q., & Kusuma, H. H. (2021). Development of Test Instruments to Analyze Higher-Order Thinking Skills Through Science-Based Literacy Learning. https://doi.org/10.26737/jipf.v6i1.1886
Halimoon, H., Mukhtar, M. I., & Roddin, R. (2021). Validity and Reliability of Practical Teaching Practice Instruments among Construction Technology Lecturers in Vocational Colleges. Journal of Technical Education and Training. https://doi.org/10.30880/jtet.2021.13.03.016
Hardiansyah, S., Kusmaedi, N., Ma'mun, A., & Mahendra, A. (2024). Physical education teachers' attitudes towards stimulating higher order thinking skills in elementary school students: Differences in certified and non-certified teachers. Retos: Nuevas Tendencias En Educación Fisica, Deporte y Recreación, 54, 857–866. https://doi.org/10.47197/retos.v54.103844
Heo, C. Y., Kim, B., Park, K., & Back, R. M. (2022). A comparison of Best-Worst Scaling and Likert Scale methods on peer-to-peer accommodation attributes. Journal of Business Research. https://doi.org/10.1016/j.jbusres.2022.04.064
Ichsan, I. Z., Sigit, D. V., Miarsyah, M., Ali, A., Arif, W. P., & Prayitno, T. A. (2019). HOTS-AEP: Higher Order Thinking Skills from Elementary to Master Students in Environmental Learning. European Journal of Educational Research, 8(4), 935–942. https://doi.org/10.12973/eu-jer.8.4.935
Jebb, A. T., Ng, V., & Tay, L. (2021). A Review of Key Likert Scale Development Advances: 1995–2019. Frontiers in Psychology, 12. https://doi.org/10.3389/fpsyg.2021.637547
Jurek, T. (2020). Physical Education and School Sport of the German Minority in Poland in the Interwar Period of the 20th Century. Central European Journal of Sport Sciences and Medicine. https://doi.org/10.18276/cej.2020.2-03
Karhulahti, V.-M., Martoncik, M., & Adamkovic, M. (2021). Measuring Internet Gaming Disorder and Gaming Disorder: A Qualitative Content Validity Analysis of Validated Scales. Assessment, 30, 402–413. https://doi.org/10.1177/10731911211055435
Kokkinaki, F. (2020). Attitudinal and normative influence on behavioral intentions: the moderating role of meta-attitudinal judgments within the Theory of Reasoned Action. Psychology, 16, 28. https://doi.org/10.12681/PSY_HPS.23800
Koo, T. K., & Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15(2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012
Kosasih, A., Supriyadi, T., Firmansyah, M. I., & Rahminawati, N. (2021). Higher-Order Thinking Skills in Primary School: Teachers' Perceptions of Islamic Education. Journal of Ethnic and Cultural Studies. https://doi.org/10.29333/ejecs/994
Kusmaryono, I., & Wijayanti, D. (2022). Number of Response Options, Reliability, Validity, and Potential Bias in the Use of the Likert Scale Education and Social Science Research: A Literature Review. International Journal of Educational Methodology. https://doi.org/10.12973/ijem.8.4.625
Liu, G., & Fernando, Y. (2024). Health Education in The Parameter of Physical in Primary and Secondary Schools. International Journal of Innovation Research in Education, Technology and Management, 1(1), 17–22. https://doi.org/10.61098/ijiretm.v1i1.110
Liu, J., Liu, Z., Wang, C., Xu, Y., Chen, J., & Cheng, Y. (2024). K-12 students' higher-order thinking skills: Conceptualization, components, and evaluation indicators. Thinking Skills and Creativity, 52, 101551. https://doi.org/10.1016/j.tsc.2024.101551
Martínez, M. C., Franco-Paredes, K., de Jesús Díaz-Reséndiz, F., & Camacho-Ruiz, E. J. (2022). Content validity of a psychological e"health program of self"control and motivation for adults with excess weight. Clinical Obesity, 12. https://doi.org/10.1111/cob.12530
Meier, S. (2021). Pedagogical content knowledge in students majoring in physical education vs. sport science. The same but different? German Journal of Exercise and Sport Research, 51, 269–276. https://doi.org/10.1007/s12662-021-00725-7
Misrom, N. B., Muhammad, A., Abdullah, A., Osman, S., Hamzah, M., & Fauzan, A. (2020). Enhancing students' higher-order thinking skills (HOTS) through an inductive reasoning strategy using geogebra. International Journal of Emerging Technologies in Learning (IJET), 15(3), 156–179. https://doi.org/10.3991/ijet.v15i03.9839
Mitani, H. (2021). Test score gaps in higher order thinking skills: Exploring instructional practices to improve the skills and narrow the gaps. AERA Open, 7, 23328584211016470. https://doi.org/10.1177/23328584211016470
Nagórska, M., Dal, N. A., Apay, S. E., LesiÅ„ska-Sawicka, M., & í‡apik, C. (2022). Psychometric properties and cultural adaptation of Polish version of Gynecological Cancers Awareness Scale (GCAS). Ginekologia Polska. https://doi.org/10.5603/GP.a2021.0191
OECD. (2023). PISA 2022 Results. Learning During-and from-Distruption: Vol. II. PISA OECD Publishing, Paris. https://doi.org/10.1787/a97db61c-en
Rebellon, C. J. (2021). Construct Validity. The Encyclopedia of Research Methods in Criminology and Criminal Justice. https://doi.org/10.1002/9781119111931.ch4
Salleh, K. M., lisa Sulaiman, N., & Gloeckner, G. W. (2023). Exploring Test Concept andMeasurement Through Validity andReliability Process inTVET Research: Guideline forThe Novice Researcher. Journal of Technical Education and Training. https://doi.org/10.30880/jtet.2023.15.01.022
Shuttleworth, M. (2019). Test Validity. https://doi.org/10.2307/1165021
Shuttleworth, M. (2022). Concurrent Validity. The SAGE Encyclopedia of Research Design. https://doi.org/10.4135/9781071812082.n101
Sjí¸berg, D. I. K., & Bergersen, G. R. (2021). Construct Validity in Software Engineering. IEEE Transactions on Software Engineering, 49, 1374–1396. https://doi.org/10.1109/TSE.2022.3176725
Tanudjaya, C. P., & Doorman, M. (2020). Examining Higher Order Thinking in Indonesian Lower Secondary Mathematics Classrooms. Journal on Mathematics Education, 11(2), 277–300. https://doi.org/10.22342/JME.11.2.11000.277-300
Tu, S., Li, C. X., Zeng, D., & Shepherd, B. E. (2023). Rank intraclass correlation for clustered data. Statistics in Medicine, 42, 4333–4348. https://doi.org/10.1002/sim.9864
Veziari, Y., Kumar, S. S., & Leach, M. M. (2020). Evaluating the reliability of the oBSTACLES Instrument. Advances in Integrative Medicine. https://doi.org/10.1016/j.aimed.2020.02.007
Wijnen, F., Walma van der Molen, J., & Voogt, J. (2021). Measuring primary school teachers' attitudes towards stimulating higher-order thinking (SHOT) in students: Development and validation of the SHOT questionnaire. Thinking Skills and Creativity, 42(May), 100954. https://doi.org/10.1016/j.tsc.2021.100954
Wilson, D. M., & Narasuman, S. (2020). Investigating Teachers' Implementation and Strategies on Higher Order Thinking Skills in School Based Assessment Instruments. Asian Journal of University Education, 16(1), 70–84. https://doi.org/10.24191/ajue.v16i1.8991
Wilson, M. R., Bathia, S., Morell, L., Gochyyev, P., Koo, B. W., & Smith, R. (2022). Seeking a better balance between efficiency and interpretability: Comparing the likert response format with the Guttman response format. Psychological Methods. https://doi.org/10.1037/met0000462
Zainil, M., Kenedi, A. K., Indrawati, T., Handrianto, C., & others. (2023). The Influence of a STEM-Based Digital Classroom Learning Model and High-Order Thinking Skills on the 21st-Century Skills of Elementary School Students in Indonesia. Journal of Education and E-Learning Research, 10(1), 29–35. https://doi.org/10.20448/jeelr.v10i1.4336
Zapata-Ospina, J. P., & García-Valencia, J. (2020). Validity based on content: A challenge in health measurement scales. Journal of Health Psychology, 27, 481–493. https://doi.org/10.1177/1359105320953477
Copyright (c) 2025 Jurnal Pendidikan Jasmani Indonesia

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Jurnal Pendidikan Jasmani Indonesia is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Based on a work at https://journal.uny.ac.id/index.php/jpji.