A learning outcome assessment information system to facilitate Outcome-Based Education (OBE) implementation

Berlian Kushari, Universitas Islam Indonesia, Indonesia
Lukman Septiadi, Universitas Islam Indonesia, Indonesia

Abstract


Assessment is an integral part of an outcome-based education (OBE) system. It helps ensuring student learning and ultimately attaining the expected outcomes at the time of graduation. Records of assessment results enable a study program to conduct continual improvement of its education activities. This paper reports the development of an information system and technology that helped Civil Engineering Program of Islamic University of Indonesia to ensure Program Learning Outcomes (PLO) attainment by its students in its gear towards obtaining an international accreditation. The system was implemented as an online web application that includes students, faculty, student advisors, and program manager as the users. The system allows to, firstly, define the PLOs, their performance indicators (PI), and the scoring system of PLO attainment, including setting up of required minimum attainment level. Secondly, for each PLO, a road map that defines the structural relationship between all PLO PIs and the selected courses throughout the semesters in which those indicators are to be measured (i.e. as course learning outcomes) must be defined. Once these relationships are firmly fixed and mapped, the system is ready to assist the program manager, student advisors, and individual students to conduct monitoring and evaluation (self-evaluation in student’s case) of program and course learning outcomes achievement. System’s important features are highlighted along with discussion on development strategies, current operational status, as well as challenges for future development.

Keywords


information system; learning outcomes assessment; outcome-based education; development strategy

Full Text:

PDF

References


ABET Engineering Accreditation Commission. (2020). Criteria for accrediting engineering programs. https://www.abet.org/accreditation/accreditation-criteria/criteria-for-accrediting-engineering-programs-2019-2020/.

Froyd, J. E., Wankat, P. C., & Smith, K. A. (2012). Five major shifts in 100 years of engineering education. Proceedings of the IEEE, 100 (Special Centennial Issue), 1344-1360. https://doi.org/ 10.1109/JPROC.2012.2190167.

Holland, D., Walsh, C. J., & Bennett, G. J. (2013). Tools for assessing student learning in mechanical design courses. In DS 76: Proceedings of E&PDE 2013, the 15th International Conference on Engineering and Product Design Education, Dublin, Ireland.

Indonesian Accreditation Board for Engineering Education (IABEE). (2016). Accreditation criteria for engineering programs, version 2016, Jakarta: Institution of Engineers Indonesia (PII), available: http://iabee.or.id/.

Indonesian Accreditation Board for Engineering Education (IABEE). (2020). Accreditation criteria for engineering programs, version 2020, Jakarta: Institution of Engineers Indonesia (PII), available: http://iabee.or.id/

International Engineering Alliance (IEA) and European Network for Engineering Education (ENAEE). (2015). Best Practice in Accreditation of Engineering Programmes: An Exemplar. available: http://www.ieagreements.org/

International Engineering Alliance (IEA), (2013). Graduate attributes and professional competencies. http://www.ieagreements.org/

International Engineering Alliance (IEA), (2021). Graduate attributes and professional competencies, IEA – WFEO – UNESCO. http://www.ieagreements.org/

Jadhav, M. R., Kakade, A. B., & Patil, M. S. (2018). ICT and active teaching-learning-assessment process in the engineering education. Journal of Engineering Education Transformations, 31(3), 58-62. https://doi.org/10.16920/jeet/2018/v31i3/120758.

Japan Accreditation Board for Engineering Education (JABEE). (2019). Japan engineer education certification criteria – common criteria. http://jabee.org/

Japan Accreditation Board for Engineering Education (JABEE). (2013). Japan engineer education certification criteria – common criteria. http://jabee.org/

Johnson, V. E. (1997). An alternative to traditional GPA for evaluating student performance. Statistical Science, 12(4), 251-278. https://doi.org/10.1214/ss/1030037959.

Jones, D. K., & Abdallah, M. (2016). Successful Use of Performance Indicators to Assess Student Outcomes Paper presented at 2016 ASEE Annual Conference & Exposition, New Orleans, Louisiana. https://doi.org/10.18260/p.25961.

Jones, D. K. (2013). New rubrics for assessment of skills in mechanical design. In Proceedings of the ASEE Northeast Section Conference, Norwich University, Northfield VT.

Kidd, P. T. (2011). Enterprise information systems: Aligning and integrating strategy, technology, organisation, and people. In Enterprise information systems: Concepts, methodologies, tools and applications (pp. 314-328). IGI Global. https://doi.org/10.4018/978-1-61692-852-0.ch201.

Lam, B. H. & Tsui, K. T. (2016). Curriculum mapping as deliberation – examining the alignment of subject learning outcomes and course curricula. Studies in Higher Education, 41(8) 1371-1388. https://doi.org/10.1080/03075079.2014.968539.

Lei, P. E., Bassiri, D., & Schultz, E. M. (2001). Alternatives to grade point average as a measure of academic achievement in college. ACT Research Report.

Ministry of Research, Technology, and Higher Education (Morthe) of the Republic of Indonesia, Ministerial. (2015). Regulation No. 44/2015 on National Standards for Higher Education

Naqvi, S. R., Akram, T., Haider, S. A., Khan, W., Kamran, M., Muhammad, N., & Qadri N. N. (2019). Learning outcomes and assessment methodology: Case study of an undergraduate engineering project. The International Journal of Electrical Engineering & Education, 56(2) 140–162. https://doi.org/10.1177/002072091879010.

Pestovs, P., Zarina, S., Badjanova, J., Illisko, D., and Popova, L. (2020). Aligning course assessment methods to program assessment strategy in higher Education. Proceedings of EDLEARN20 Conference, pp. 6366-6372. https://doi.org/10.21125/edulearn.2020.1670.

Qadir, J., Shafi, A., Al-Fuqaha, A., Taha, A. E. M., Yau, K. L. A., Ponciano, J., Hussain, S., Imran, M. A., Muhammad, S. S., Bin Rais, R. N., Rashid, M., & Tan, B. L. (2020). Outcome-based engineering education: A global report of international OBE accreditation and assessment practices" EdArXiv. https://doi.org/10.18260/1-2--35020.

Rainer, R. K., Prince, B., Splettstoesser-Hogeterp, I., Sanchez-Rodriguez, C., & Ebrahimi, S. (2020). Introduction to information systems. John Wiley & Sons.

Rogers, G. (2017). Student Outcomes and Performance Indicators, (revised ed.), ABET. http://www. abet. org/wp-content/uploads/2015/04/programoutcomes-and-performance-indicators. pdf.

Rogers, G. (2006). Using Course or Test Grades for Program Assessment. ABET. https://www.abet.org/wp-content/uploads/2020/09/Using-Course-or-Test-Grades-for-Program-Assessment-09.09.20.pdf.

Shuman, L. J., Besterfield‐Sacre, M., & McGourty, J. (2005). The ABET "professional skills"—Can they be taught? Can they be assessed?. Journal of engineering education, 94(1), 41-55. https://doi.org/10.1002/j.2168-9830.2005.tb00828.x .

Spady, W.G. (1994). Outcome-based education: Critical issues and answers. American Association of School Administrators.

Sudana, I. M., Pathmantara, S., Febiharsa, D., & Gandisa, B. (2020). The use of information system to manage vocational assessment in facing the 5.0 digital society. Jurnal Pendidikan Teknologi dan Kejuruan, 26(2), 149-154. https://doi.org/10.21831/jptk.v26i2.29924.

Veltri, N. F., Webb, N. W., Matveev, A. G., & Zapatero, E. G. (2011). Curriculum mapping as a tool for continuous improvement of IS Curriculum. Journal of Information Systems Education, 22(1), 31-42. https://aisel.aisnet.org/jise/vol22/iss1/4.

Zeid, O. A. A., Omar, F. K., & Alkhalil, J. (2017). Assessment tools for the evaluation of the level of attainment of a student outcome related to entrepreneurial Activities. International Journal for Innovation Education and Research, 5(4), 17-27.




DOI: https://doi.org/10.21831/jptk.v28i2.42339

Refbacks

  • There are currently no refbacks.


Copyright (c) 2022 Jurnal Pendidikan Teknologi dan Kejuruan

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.

 

Online (e-ISSN): 2477-2410 || Printed (p-ISSN): 0854-4735

Jurnal Pendidikan Teknologi Kejuruan by http://journal.uny.ac.id/index.php/jptk was distributed under a Creative Commons Attribution 4.0 International License.

View My Stats

Supported by:

Jurnal Ilmiah Magister Managemen

Social Media: