Abstract
Recommender systems are widely used to cope with the problem of information overload and, consequently, many recommendation methods have been developed. However, no one technique is best for all users in all situations. To combat this, we have previously developed a market-based recommender system that allows multiple agents (each representing a different recommendation method or system) to compete with one another to present their best recommendations to the user. In our system, the marketplace encourages good recommendations by rewarding the corresponding agents according to the users’ ratings of their suggestions. Moreover, we have shown this incentivises the agents to bid in a manner that ensures only the best recommendations are presented. To do this effectively, however, each agent needs to classify its recommendations into different internal quality levels, learn the users’ interests and adapt its bidding behaviour for the various internal quality levels accordingly. To this end, in this paper, we develop a reinforcement learning and Boltzmann exploration strategy that the recommending agents can exploit for these tasks. We then demonstrate that this strategy helps the agents to effectively obtain information about the users’ interests which, in turn, speeds up the market convergence and enables the system to rapidly highlight the best recommendations.
This research is funded in part by QinetiQ and the EPSRC Magnitude project (reference GR/N35816).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Resnick, P., Varian, H.R.: Recommender Systems. Communications of the ACM 40, 56–58 (1997)
Herlocker, J., Konstan, J., Terveen, L., Riedl, J.: Evaluating collaborative filtering recommender systems. ACM Transactions on Information Systems 22, 5–53 (2004)
Wei, Y.Z., Moreau, L., Jennings, N.R.: Recommender systems: A market-based design. In: Proceedings of International Conference on Autonomous Agents and Multi Agent Systems (AAMAS 2003), Melbourne, pp. 600–607 (2003)
Wei, Y.Z., Moreau, L., Jennings, N.R.: Market-based recommendations: Design, simulation and evaluation. In: Giorgini, P., Henderson-Sellers, B., Winikoff, M. (eds.) AOIS 2003. LNCS, vol. 3030, pp. 22–29. Springer, Heidelberg (2003)
Mitchell, T.: Machine Learning. McGraw-Hill, New York (1997)
Kaelbling, L.P., Littman, M.L., Moore, A.W.: Reinforcement learning: A survey. Journal of Artificial Intelligence Research 4, 237–285 (1996)
Thorndike, E.L.: Animal intelligence: An experimental study of the associative processes in animals. Psychological Monographs 2 (1898)
Konstan, J.A., Miller, B.N., Maltz, D., Herlocker, J.L., Gordon, L.R., Riedl, J.: Grouplens: Applying collaborative filtering to usenet news. Communications of the ACM 40, 77–87 (1997)
Bohte, S., Gerding, E., Poutré, H.L.: Market-based recommendation: Agents that compete for consumer attention. ACM Transactions on Internet Technology 4, 420–448 (2004)
Mooney, R.J., Roy, L.: Content-based book recommending using learning for text categorization. In: Proceedings of the 5th ACM Conference on Digital Libraries, TX, US, pp. 195–204 (2000)
Shardanand, U., Maes, P.: Social information filtering: algorithms for automating “word of mouth”. In: Proceedings of Conference on human factors in computing systems, pp. 210–217 (1995)
Montaner, M., Lopez, B., Dela, J.L.: A taxonomy of recommender agents on the internet. Artificial Intelligence Review 19, 285–330 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wei, Y.Z., Moreau, L., Jennings, N.R. (2005). Market-Based Recommender Systems: Learning Users’ Interests by Quality Classification. In: Bresciani, P., Giorgini, P., Henderson-Sellers, B., Low, G., Winikoff, M. (eds) Agent-Oriented Information Systems II. AOIS 2004. Lecture Notes in Computer Science(), vol 3508. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11426714_4
Download citation
DOI: https://doi.org/10.1007/11426714_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-25911-4
Online ISBN: 978-3-540-31946-7
eBook Packages: Computer ScienceComputer Science (R0)