Evaluation of collaborative filtering algorithms using a small dataset

Roda, Fabio, Liberti, Leo and Raimondi, Franco (2011) Evaluation of collaborative filtering algorithms using a small dataset. In: WEBIST 2011, http://www.webist.org/WEBIST2011/.

Full text is not in this repository.

Abstract

In this paper we report our experience in the implementation of three collaborative filtering algorithms (user-based k-nearest neighbour, Slope One and TMW, our original algorithm) to provide a recommendation service on an existing website.
We carry out the comparison by means of a typical metric, namely the accuracy (RMSE). Usually, evaluations for these kinds of algorithms are carried out using off-line analysis, withholding values from a dataset, and trying to predict them again using the remaining portion of the dataset (the so-called "leave-n-out approach"). We adopt a "live" method on an existing website: when a user rates an item, we also store in parallel thepredictions of the algorithms on the same item. We got some unexpected results. In the next sections we describe the algorithms, the benchmark, the testing method, and discuss the outcome of this exercise.
Our contribution is a report of the initial phase of a Recommender Systems project with a focus on some possible difficulties on the interpretation of the initial results.

Item Type: Conference or Workshop Item (Paper)
Research Areas: A. > School of Science and Technology > Computer Science
A. > School of Science and Technology > Computer Science > Foundations of Computing group
A. > School of Science and Technology > Computer Science > SensoLab group
A. > School of Science and Technology > Computer Science > Artificial Intelligence group
A. > School of Science and Technology > Computer Science > Intelligent Environments group
Item ID: 10482
Useful Links:
Depositing User: Franco Raimondi
Date Deposited: 05 Jun 2013 11:48
Last Modified: 13 Oct 2016 14:26
URI: https://eprints.mdx.ac.uk/id/eprint/10482

Actions (login required)

Edit Item Edit Item