Multi-criteria based Item Recommendation Methods

Noor Ifada, Syafrurrizal Naridho, Mochammad Kautsar Sophan


This paper comprehensively investigates and compares the performance of various multi-criteria based item recommendation methods. The development of the methods consists of three main phases: predicting rating per criterion; aggregating rating prediction of all criteria; and generating the top-  item recommendations. The multi-criteria based item recommendation methods are varied and labelled based on what approach is implemented to predict the rating per criterion, i.e., Collaborative Filtering (CF), Content-based (CB), and Hybrid. For the experiments, we generate two variations of datasets to represent the normal and cold-start conditions on the multi-criteria item recommendation system. The empirical analysis suggests that Hybrid and CF are best implemented on the normal and cold-start item conditions, respectively. On the other hand, CB should never be (solely) implemented in a multi-criteria based item recommendation system on any conditions.


Collaborative Filtering; Content-based; Hybrid; Multi-criteria recommendation method

Full Text:



Adomavicius, G., Manouselis, N., & Kwon, Y. (2011). Multi-criteria recommender systems. In Recommender systems handbook (pp. 769-803): Springer, Boston.

Adomavicius, G., & Tuzhilin, A. (2005). Toward the Next Generation of Recommender Systems: A Survey of the State-of-the-art and Possible Extensions. IEEE Transactions on Knowledge and Data Engineering, 17(6), 734-749. doi:10.1109/tkde.2005.99

Aggarwal, C. C. (2016). Recommender Systems: The Textbook. Switzerland: Springer International Publishing.

Bilge, A., & Yargıç, A. (2017). Improving accuracy of multi-criteria collaborative filtering by normalizing user ratings. Anadolu Üniversitesi Bilim Ve Teknoloji Dergisi A-Uygulamalı Bilimler ve Mühendislik, 18(1), 225-237.

Burke, R. (2007). Hybrid Web Recommender Systems. In The adaptive web (pp. 377-408): Springer Berlin Heidelberg.

Fuchs, M., & Zanker, M. (2012). Multi-criteria ratings for recommender systems: an empirical analysis in the tourism domain. Paper presented at the International Conference on Electronic Commerce and Web Technologies.

Jannach, D., Karakaya, Z., & Gedikli, F. (2012). Accuracy improvements for multi-criteria recommender systems. Paper presented at the 13th ACM Conference on Electronic Commerce.

Lakiotaki, K., Matsatsinis, N. F., & Tsoukias, A. (2011). Multicriteria user modeling in recommender systems. IEEE Intelligent Systems, 26(2), 64-76.

Lops, P., Gemmis, M., & Semeraro, G. (2011). Content-based Recommender Systems: State of the Art and Trends. In Recommender Systems Handbook (pp. 73-105): Springer US.

Manouselis, N., & Costopoulou, C. (2007). Analysis and classification of multi-criteria recommender systems. World Wide Web, 10(4), 415-441.

Su, X., & Khoshgoftaar, T. M. (2009). A Survey of Collaborative Filtering Techniques. Advances in Artificial Intelligence, 2009(January), 4:2-4:2.

Uluyagmur, M., Cataltepe, Z., & Tayfur, E. (2012). Content-Based Movie Recommendation Using Different Feature Sets. Paper presented at the World Congress on Engineering and Computer Science Vol I, San Francisco, USA.

Zhang, Z.-K., Zhou, T., & Zhang, Y.-C. (2011). Tag-Aware Recommender Systems: A State-of-the-Art Survey. Journal of Computer Science and Technology, 26(5), 767-777. doi:10.1007/s11390-011-0176-1




  • There are currently no refbacks.

Copyright (c) 2019 Noor Ifada, Syafrurrizal Naridho, Mochammad Kautsar Sophan

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.