PRE-PROCESSED LATENT SEMANTIC ANALYSIS FOR AUTOMATIC ESSAY GRADING

Ruth Ema Febrita, Wayan Firdaus Mahmudy

Abstract


In education, essay is considered as the best tool to evaluate student’s high order thinking and understanding. In the other hand, manual processing and grading essay answers by a teacher need much time and tending to subjectivity grading. Meanwhile automatic essay grading in e-learning system find the difficulties in comparing model or key answer to student’s answer because student’s can answer the question with so various way. That means a right answer also can be so various, while they have same semantic meaning. This paper proposed automatically score the essay using Latent Semantic Analysis. But before the texts being scored, they will be pre-processed using stop words removal and synonym checking. Calibration process implemented for dealing with the various possible right answer. Implementation of this approach using Java Programming Language and WordNet as lexical database that needed to search the synonyms of every given words. The accuracy obtained by this method is 54.9289%.


Keywords


Automatic Grading; Essay Grading; Latent Semantic Analysis; preprocessed LSA

References


D. Wiliam, “What is assessment for learning?,” Studies in Educational Evaluation., vol. 37, no. 1, pp. 3–14, 2011.

M. Nakayama, H. Yamamoto, and R. Santiago, “The role of essay tests assessment in e-learning : A Japanese case study,” Electronic Journal of e-Learning, vol. 8, no. 2, pp. 173–178, 2010.

K. Scouller, “The influence of assessment method on students’ learning approaches: Multiple choice question examination versus assignment essay,” Higher Education, pp. 453–272, 1998.

S. Brown and P. Knight, Assessing learners in higher education. London: Kogan Page, 1994.

K. Zen, D. N. F. A. Iskandar, and O. Linang, “Using latent semantic analysis for automated grading programming assignments,” 2011 International Conference on Semantic Technology and Information Retrieval, {STAIR} 2011, June 28, 2011 - June 29, 2011, no. June, pp. 82–88, 2011.

A. A. P. Ratna, H. Artajaya, and B. A. Adhi, “GLSA based online essay grading system,” Proceeding. 2013 IEEE International Conference on Teaching, Assessment and Learning for Engineering, TALE 2013, no. August, pp. 358–361, 2013.

G. R. Perera, D. N. Perera, and A. R. Weerasinghe, “A dynamic semantic space modelling approach for short essay grading,” 15th International Conference on Advance ICT Emerging Regions ICTer 2015 - Conference Proceeding., pp. 43–49, 2016.

T. K. Landauer, D. S. McNamara, S. Dennis, and W. Kintsch, Handbook of Latent Semantic Analysis, vol. 1. 2011.

W. Song and S. C. Park, “Genetic algorithm for text clustering based on latent semantic indexing,” Computers and Mathematics with Application, vol. 57, no. 11–12, pp. 1901–1907, 2009.

A. Tripathy, A. Agrawal, and S. K. Rath, “Classification of sentiment reviews using n-gram machine learning approach,” Expert Systems with Application, vol. 57, pp. 117–126, 2016.

Y. He, S. C. Hui, and T. T. Quan, “Automatic summary assessment for intelligent tutoring systems,” Computers and Education, vol. 53, no. 3, pp. 890–899, 2009.

A. OluAde-Ibijola, I. Wakama, and J. Chioma Amadi, “An Expert System for Automated Essay Scoring (AES) in Computing using Shallow NLP Techniques for Inferencing,” International Journal of Computer Application, vol. 51, no. 10, pp. 37–45, 2012.

B. Galitsky, “Machine learning of syntactic parse trees for search and classification of text,” Engineering Application of Artificial Intelligence, vol. 26, no. 3, pp. 1072–1091, 2013.

Princeton University, “About Wordnet,” Wordnet, 2010.




DOI: http://dx.doi.org/10.21107/kursor.v8i4.2752

Refbacks

  • There are currently no refbacks.


    Informatika - UTM