Item Analysis of a Critical Thinking Skills Test on PLC Programming for Prospective Teachers

Puput Wanarti Rusimamto, Department of Electrical Engineering, Universitas Negeri Surabaya, Indonesia, Indonesia
Munoto Munoto, Department of Electrical Engineering, Universitas Negeri Surabaya, Indonesia, Indonesia
Muchlas Samani, Department of Mechanical Engineering, Universitas Negeri Surabaya, Indonesia, Indonesia
Lilik Anifah, Department of Informatics Engineering, Universitas Negeri Surabaya, Indonesia, Indonesia


This study aimed at developing a test instrument to asses prospective vocational teachers’ critical thinking skills on Programmable Logic Controller (PLC) programming. This research and development study produced the test instrument that had been trialled to 68 Indonesian electrical engineering education prospective teachers at Universitas Negeri Surabaya. The method used was Research and Development by referring to the revised Bloom method and the adjusted Facione model. The instrument consisted of 40 items that were further analyzed using a classical test and item response approaches. Students' responses were analyzed using the computer program of a Test Analysis Program and ConQest. The item difficulty of classical test theory was represented by p value revealed based on prospective teachers’ correct answers. Parameter b referred to location parameter that conveyed the position of the item’s characteristic curve in relation to the ability scales. The benefit of this study was it can measure the level of critical skills, especially on the subject of PLC programming. The existing instruments only measure PLC programming skills in general but have not yet specifically reached the measurement of critical skills level.


critical thinking skills, PLC programming, test item analysis

Full Text:



J.H. Lupinacci," Addressing 21st Century Challenges in Education", Journal on Transforming Professional Practice, Vol. 2, pp 20-28, 2017.

National Education Association, “Preparing 21st Century Students for a Global Society. An Educator’s Guide to the ‘Four Cs,’” 2010.

K. Pendidikan and D. A. N. Kebudayaan, “spektrum SMK,” no. 021, 2017.

A.R. Kiran, et al., "The Principle of Programmable Logic Controller and its role in Automation", International Journal of Engineering Trends and Technology- Vol. 4, Issue 3, 2013.

D. F. Halpern, “Teaching Critical Thinking for Transfer Across Domains,” Am. Psychol., vol. 53, no. 4, pp. 449–455, 1997.

G.J.R. Kumar, et al., " Industrial Internet of Things Based Programmable Logic Controller", International Journal of Innovative Technology and Exploring Engineering (IJITEE), Vol. 8 Issue-7, May, 2019.

O. Bingol, K. Tasdelen, "Web-based Smart Home Automation: PLC controlled Implementation", Acta Polytechnica Hungarica Vol. 11, No. 3, 2014.

R.D. Nacorda, "Computer- Assisted Programmable Logic Controller Simulator", International Journal of Recent Technology and Engineering (IJRTE), Vol.7, Issue-6, March 2019.

J. Butterworth, G. Thwaites Thinking Skills Butterworth, and G. Thwaites, Critical Thinking and Problem Solving Thinking Skills Thinking Skills Critical Thinking and Problem Solving Second edition. 2013.

Heather A. Butler, “Halpern Critical Thinking Assessment Predicts Real-World Outcomes of Critical Thinking,” Appl. Cogn. Psychol., vol. 26, no. 5, pp. 721–729, 2012.

P. A. Facione, N. C. Facione, N. P. A. Facione, and C. Noreen, “Critical Thinlung Ability: A Measurement Tool,” vol. 5, no. 2, pp. 5–6, 1994.

S. Živkovic, “A Model of Critical Thinking as an Important Attribute for Success in the 21st Century,” Procedia - Soc. Behav. Sci., vol. 232, no. April, pp. 102–108, 2016.

O. Sarigoz, “Assessment of the High School Students’ Critical Thinking Skills,” Procedia - Soc. Behav. Sci., vol. 46, pp. 5315–5319, 2012.

E. P. Douglas, “Defining and Measuring Critical Thinking in Engineering,” Procedia - Soc. Behav. Sci., vol. 56, no. Ictlhe, pp. 153–159, 2012.

S. M. Wechsler et al., “Creative and critical thinking: Independent or overlapping components?,” Think. Ski. Creat., vol. 27, pp. 114–122, 2018.

K. Changwong, et al., "Critical thinking skill development: Analysis of a new learning management model for Thai high schools", Journal of International Studies Vol.11, No.2, 2018.

V. Rimiene, " Assessing and Developing Students' Critical Thingking", J Psychology Learning & Teaching, Vol.1 No. 1, March 1, 2002.

M. Karakoc, " The Significance of Critical Thinking Ability in terms of Education ", International Journal of Humanities and Social Science Vol. 6, No. 7; July 2016.

N.H. Fuad, et al., " Improving Junior High Schools’ Critical Thinking Skills Based on Test Three Different Models of Learning ", International Journal of Instruction, Vol.10, No.1, 2017.

P. Rusimamto, E. Ekohariadi, and M. Munoto, “Assessing Programmable Logic Controller Skill of Electrical Engineering Student,” vol. 201, no. Aptekindo, pp. 148–153, 2018.

G. P. Brooks, Test Analysis Program. 2014.

M. L. Wu, R. J. Adams, M. R. Wilson, and A. C. for E. R. (ACER), ACER conquest : generalised item response modelling software. Melbourne: ACER Press, 1998.

C. K. Parsons and C. L. Hulin, “An empirical comparison of item response theory and hierarchical factor analysis in applications to the measurement of job satisfaction,” J. Appl. Psychol., vol. 67, no. 6, pp. 826–834, 1982.

T. G. Bond, “Validity and assessment : a Rasch measurement perspective Whose validity is more important ?,” Metodol. las Ciencias del Comport., vol. 5, no. 2, pp. 179–194, 2004.

J. M. Linacre, “Rasch model estimation: further topics.,” J. Appl. Meas., vol. 5, no. 1, pp. 95–110, 2004.

R. J. Adams and S.-T. Khoo, Quest : the interactive test analysis system (Version 2.1). Australian Council for Educational Research, Camberwell, Vic, 1996.

J. P. Keeves and G. N. Masters, Advances in measurement in educational research and assessment. Oxford: Pergamon, 1999.



  • There are currently no refbacks.

Copyright (c) 2019 Jurnal Pendidikan Teknologi dan Kejuruan

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.


Online (e-ISSN): 2477-2410 || Printed (p-ISSN): 0854-4735

Jurnal Pendidikan Teknologi Kejuruan by was distributed under a Creative Commons Attribution 4.0 International License.

View My Stats

Supported by:

Jurnal Ilmiah Magister Managemen

Social Media: