ANALISIS EFEKTIVITAS APLIKASI MYITS THESIS MENGGUNAKAN CONFIRMATORY FACTOR ANALYSIS UNTUK PENINGKATAN LAYANAN PENYELENGGARAAN UJIAN PADA PROGRAM DOKTOR ILMU KOMPUTER

Lina - Ambarwati, Adifa Widyadhani Chanda D'layla, Ahmad Saikhu

Abstract


In the global era, Information Systems in higher education institutions are a must. Institut Teknologi Sepuluh Nopember (ITS) continuously makes efforts to develop information systems for various academic and non-academic services for the lecturer and students. One of the academic services developed at ITS is myITS Thesis application. myITS Thesis is one of the applications prepared for the management of scholars Final Project. The Computer Science Doctoral Program (PDIK) has implemented the application for examination services including qualification hearings progress, seminars, and closed dissertation hearings. This study aims to measure the effectiveness of using the myITS Thesis application in managing PDIK dissertation research services to stakeholders, especially PDIK scholars. Measurements were carried out by surveying through questionnaires with PDIK participants who used the application in the 2023/2024 academic year. The effectiveness of the application is measured through five factors, namely System Quality (KS), Information Quality(KI), System Use(PS), User Satisfaction(KP), and Individual Impact(DI). The five factors are measured through 30 Question Indicators to 55 respondents. The results of the questionnaire survey were processed using descriptive analysis and CFA modeling. CFA is used to measure validity and reliability through Standardized Loading Factor (SLF), Cronbach Alpha (CA), and Composite Reliability (CR) values. It is concluded from the modeling results based on validity and reliability measurements that the KS factor is valid with CA value=0.931 and reliable with CR value=0.73, the KI factor is valid with CA value=0.923 and reliable with CR value=0.706, the PS factor is valid with CA value=0.95 and reliable with CR value=0.734. While the KP factor is valid with CA value=0.972 and reliable with CR value= 0.814. Therefore, the myITS Thesis application has been quite effective in improving exam administration services.

Keywords: questionnaire, descriptive analysis, PDIK, myITS Thesis, CFA modeling


Full Text:

PDF

References


V. Setyo Nugroho and F. Wahyu Christanto, “Analisis Keamanan Website Dengan Information System Security Assessment Framework (Issaf) Dan Open Web Application Security Project (Owasp) Website Security Analysis With Information System Security Assessment Framework (Issaf) And Open Web Application Security Project (Owasp),” 2023.

Institut Teknologi Sepuluh Nopember, “My ITS Thesis,” https://thesis.its.ac.id/.

Ningsih, Setia, Hendra, Dukalang, Arsal, and Armayani, “Pemodelan Structurual Equation Model Partial Least Square (SEM-PLS) pada Minat Bertransaksi Menggunakan Aplikasi OVO,” Jambura Journal of Probability and Statistics, vol. 3, no. 2, Nov. 2022.

A. W. Gatian, “Is user satisfaction a valid measure of system effectiveness?,” Information & Management, vol. 26, no. 3, pp. 119–131, Mar. 1994, doi: 10.1016/0378-7206(94)90036-1.

I. E. Diavastis, K. A. Chrysafis, and G. C. Papadopoulou, “Determinants of Accounting Information Systems Success: The Case of the Greek Hotel Industry,” International Journal of Financial Studies, vol. 12, no. 2, p. 42, Apr. 2024, doi: 10.3390/ijfs12020042.

Puspitawati and Lilis, “The Analysis Of Effectiveness Measurement In Accounting Information Systems Through Competence Factor Of Information System User,” International Journal of Applied Business and Economic Research, vol. 16, no. 2, 2016.

A. Heinrich and A. N. Probohudono, “Pengaruh Sistem Pengendalian Intern Pemerintah (SPIP) dan Pemanfaatan Teknologi Informasi terhadap Kualitas Laporan Keuangan Pemerintah Daerah,” KONSTELASI: Konvergensi Teknologi dan Sistem Informasi, vol. 3, no. 2, pp. 411–424, Dec. 2023, doi: 10.24002/konstelasi.v3i2.7150.

I. M. Ali, Y. Y. Jusoh, R. Abdullah, and Y. A. Ahmed, “Exploring the performance measures of big data analytics systems,” International Journal of ADVANCED AND APPLIED SCIENCES, vol. 10, no. 1, pp. 92–104, Jan. 2023, doi: 10.21833/ijaas.2023.01.013.

J. E. Scott, “The measurement of information systems effectiveness,” ACM SIGMIS Database: the DATABASE for Advances in Information Systems, vol. 26, no. 1, pp. 43–61, Feb. 1995, doi: 10.1145/206476.206484.

B. Bakshi, S. Polasky, and L. E. Frelich, “Using structural equation models (SEM) to link climate change, forest composition, deer, and outdoor recreation,” Ecological Modelling, vol. 493, p. 110731, Jul. 2024, doi: 10.1016/j.ecolmodel.2024.110731.

Z. Yan and K. Fan, “A multi-entity reinforced main path analysis: Heterogeneous network embedding considering knowledge proximity,” Journal of Informetrics, vol. 18, no. 4, p. 101593, Nov. 2024, doi: 10.1016/j.joi.2024.101593.

W. Wider et al., “Service quality (SERVQUAL) model in private higher education institutions: A bibliometric analysis of past, present, and future prospects,” Social Sciences & Humanities Open, vol. 9, p. 100805, 2024, doi: 10.1016/j.ssaho.2024.100805.

R. A. Rebualos, J. J. Hidayat, A. A. N. P. Redi, A. M. Rozamuri, and J. D. German, “Analysis of service quality in engineering design department through SERVQUAL framework,” Procedia Comput Sci, vol. 234, pp. 1570–1577, 2024, doi: 10.1016/j.procs.2024.03.159.

S. Mardiana, J. H. Tjakraatmadja, A. Aprianingsih, and J. H. Tjakraatmadja, “DeLone-McLean Information System Success Model Revisited: The Separation of Intention to Use-Use and the Integration of Technology Acceptance Models International Journal of Economics and Financial Issues DeLone-McLean Information System Success Model Revisited: The Separation of Intention to Use-Use and the Integration of Technology Acceptance Models,” International Journal of Economics and Financial Issues, no. 5, pp. 10–11, 2015, [Online]. Available: http:www.econjournals.com

L. de la Roche et al., “Brief report: A confirmatory factor analysis of the Child Behavior Checklist in a large sample of autistic youth,” Research in Autism Spectrum Disorders, vol. 118, p. 102487, Oct. 2024, doi: 10.1016/j.rasd.2024.102487.

M. H. Huda, Y. Rustina, F. T. Waluyanti, C.-L. Dennis, and S.-Y. Kuo, “Psychometric evaluation of the Indonesian version of paternal breastfeeding self-efficacy scale- short form: A confirmatory factor analysis,” Midwifery, vol. 139, p. 104182, Dec. 2024, doi: 10.1016/j.midw.2024.104182.

R. B. Kline, Beyond significance testing: Reforming data analysis methods in behavioral research. Washington: American Psychological Association, 2004. doi: 10.1037/10693-000.

H. Balogun, H. Alaka, S. Ajayi, and C. N. Egwim, “Critical factors for assessing building deconstructability: Exploratory and confirmatory factor analysis,” Cleaner Engineering and Technology, vol. 21, p. 100790, Aug. 2024, doi: 10.1016/j.clet.2024.100790.

M. Alavi, D. C. Visentin, D. K. Thapa, G. E. Hunt, R. Watson, and M. Cleary, “Chi‐square for model fit in confirmatory factor analysis,” Journal of Advanced Nursing, vol. 76, no. 9, pp. 2209–2211, Sep. 2020, doi: 10.1111/jan.14399.

D. D. Gunzler and N. Morris, “A tutorial on structural equation modeling for analysis of overlapping symptoms in co‐occurring conditions using MPlus,” Statistics in Medicine, vol. 34, no. 24, pp. 3246–3280, Oct. 2015, doi: 10.1002/sim.6541.

Sutiah and Supriyono, “Enhancing Online Learning Quality: A Structural Equation Modeling Analysis of Educational Technology Implementation during the COVID-19 Pandemic,” Telematics and Informatics Reports, p. 100175, Nov. 2024, doi: 10.1016/j.teler.2024.100175.

M. W. Browne and R. Cudeck, “Alternative Ways of Assessing Model Fit,” Sociol Methods Res, vol. 21, no. 2, pp. 230–258, Nov. 1992, doi: 10.1177/0049124192021002005.

W. Kulachai, “Evaluating the Employee Engagement Scale through confirmatory factor analysis in Thai local administration settings,” Cogent Soc Sci, vol. 10, no. 1, Dec. 2024, doi: 10.1080/23311886.2024.2414883.

A. Counsell, R. A. Cribbie, and D. B. Flora, “Evaluating equivalence testing methods for measurement invariance,” Nov. 08, 2024. doi: 10.32920/27637680.v1.

D. Iacobucci, “Structural equations modeling: Fit Indices, sample size, and advanced topics,” Journal of Consumer Psychology, vol. 20, no. 1, pp. 90–98, Jan. 2010, doi: 10.1016/j.jcps.2009.09.003.

G. Coluccio, S. Muñoz-Herrera, E. Adriasola, and E. Escobar, “Leadership Development in Women STEM Students: The Interplay of Task Behaviors, Self-Efficacy, and University Training,” Behavioral Sciences, vol. 14, no. 11, p. 1087, Nov. 2024, doi: 10.3390/bs14111087.

H. Mabkhot, Y. Semlali, H. M. Gelaidan, N. A. A. Abdelwahed, and H. Shaari, “Unveiling Green Entrepreneurial Intentions and Behaviour Among Saudi Arabian Youth: Insights and Implications,” Nov. 19, 2024. doi: 10.21203/rs.3.rs-5181009/v1.

C. Fornell and D. F. Larcker, “Evaluating Structural Equation Models with Unobservable Variables and Measurement Error,” Journal of Marketing Research, vol. 18, no. 1, p. 39, Feb. 1981, doi: 10.2307/3151312.

B. Nguyen-Viet and C. Thanh Tran, “Sustaining organizational customers’ consumption through corporate social responsibility and green advertising receptivity: the mediating role of green trust,” Cogent Business & Management, vol. 11, no. 1, Dec. 2024, doi: 10.1080/23311975.2023.2287775.

Akbar, Yoepy Aprigosantri, Kamisutara, Made, “Pengembangan Sistem Informasi Monitoring dan Evaluasi Perjanjian Kerja Waktu Tertentu”, vol. 6 No. 2, p. 87-98, DOI;10.21107/nero.v6i2.221.




DOI: https://doi.org/10.21107/nero.v9i2.28201

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 Lina - Ambarwati, Adifa Widyadhani Chanda D'layla, Ahmad Saikhu