De-biasing user preference ratings in recommender systems completed research paper

Gediminas Adomavicius, Jesse Bockstedt, Shawn Curley, Jingjing Zhang

Research output: Contribution to conferencePaper

Abstract

Prior research has shown that online recommendations can lead to significant distortion of users' preference ratings and economic behavior. Specifically, the self-reported preference rating that is submitted by a user to a recommender system can be affected by the previously observed system's recommendation. This research explores two approaches to removing anchoring biases from self-reported consumer ratings. The first proposed approach is based on a computational post-hoc de-biasing algorithm that systematically adjusts the user-submitted ratings that are known to be biased. The second approach is a user-interface-driven solution that tries to minimize anchoring biases at rating collection time. Our empirical investigation explicitly demonstrates the impact of biased vs. unbiased ratings on recommender systems' predictive performance. It also indicates that the post-hoc algorithmic de-biasing approach is very problematic, most likely due to the fact that the anchoring effects can manifest themselves very differently for different users and items. This further emphasizes the importance of proactively avoiding anchoring biases at the time of rating collection. Further, through laboratory experiments, we demonstrate that certain interface designs of recommender systems are more advantageous than others in effectively reducing anchoring biases.

Original languageEnglish (US)
StatePublished - Jan 1 2014
Event24th Annual Workshop on Information Technologies and Systems: Value Creation from Innovative Technologies, WITS 2014 - Auckland, New Zealand
Duration: Dec 17 2014Dec 19 2014

Other

Other24th Annual Workshop on Information Technologies and Systems: Value Creation from Innovative Technologies, WITS 2014
CountryNew Zealand
CityAuckland
Period12/17/1412/19/14

    Fingerprint

Cite this

Adomavicius, G., Bockstedt, J., Curley, S., & Zhang, J. (2014). De-biasing user preference ratings in recommender systems completed research paper. Paper presented at 24th Annual Workshop on Information Technologies and Systems: Value Creation from Innovative Technologies, WITS 2014, Auckland, New Zealand.