Usability Evaluation of E-Learning Besmart Using SUS at Yogyakarta State University

Abstract

Information Technology (IT) plays a crucial role in enhancing the performance of educational institutions, particularly in higher education. The implementation of IT aims to improve the quality of education, administrative efficiency, and information accessibility for students and staff. The success of an information system is measured by its ability to provide a positive user experience, which includes ease of use, usefulness, and overall satisfaction. A primary example of IT implementation in higher education is e-learning, which allows students to access lecture materials, assignments, and other resources online. Yogyakarta State University has developed an educational platform named Besmart to leverage IT within the campus environment, supporting academic activities such as uploading lecture materials, assignments, and related information. However, several challenges were encountered during its implementation, affecting students due to operational difficulties and understanding the platform's features. This study evaluates the Besmart e-learning platform using the System Usability Scale (SUS) questionnaire to assess its usability. The research involved 20 student respondents who were already familiar with using Besmart. The evaluation was conducted by distributing questionnaires and interviewing users to formulate improvement recommendations. The results showed an average SUS score of 58, indicating a Marginal Low level of acceptance. The adjective rating categorized the platform as "Good" with a grade scale of E. Users suggested that the e-learning platform needs additional features such as notifications for new materials and assignments, as well as an upgraded, more appealing interface. These findings provide valuable insights to enhance the usability of the Besmart platform to better meet user needs and improve the overall learning experience.