TY - JOUR
T1 - Recommender systems, ground truth, and preference pollution
AU - Adomavicius, Gediminas
AU - Bockstedt, Jesse C.
AU - Curley, Shawn P.
AU - Zhang, Jingjing
N1 - Publisher Copyright:
© 2022 The Authors.
PY - 2022/6/1
Y1 - 2022/6/1
N2 - Interactions between individuals and recommender systems can be viewed as a continuous feedback loop, consisting of pre-consumption and post-consumption phases. Pre-consumption, systems provide recommendations that are typically based on predictions of user preferences. They represent a valuable service for both providers and users as decision aids. After item consumption, the user provides post-consumption feedback (e.g., a preference rating) to the system, often used to improve the system’s subsequent recommendations, completing the feedback loop. There is a growing understanding that this feedback loop can be a significant source of unintended consequences, introducing decisionmaking biases that can affect the quality of the “ground truth” preference data, which serves as the key input to modern recommender systems. This paper highlights two forms of bias that recommender systems inherently inflict on the “ground truth” preference data collected from users after item consumption: non-representativeness of such preference data and so-called “preference pollution,” which denotes an unintended relationship between system recommendations and the user’s post-consumption preference ratings. We provide an overview of these issues and their importance for the design and application of next-generation recommendation systems, including directions for future research.
AB - Interactions between individuals and recommender systems can be viewed as a continuous feedback loop, consisting of pre-consumption and post-consumption phases. Pre-consumption, systems provide recommendations that are typically based on predictions of user preferences. They represent a valuable service for both providers and users as decision aids. After item consumption, the user provides post-consumption feedback (e.g., a preference rating) to the system, often used to improve the system’s subsequent recommendations, completing the feedback loop. There is a growing understanding that this feedback loop can be a significant source of unintended consequences, introducing decisionmaking biases that can affect the quality of the “ground truth” preference data, which serves as the key input to modern recommender systems. This paper highlights two forms of bias that recommender systems inherently inflict on the “ground truth” preference data collected from users after item consumption: non-representativeness of such preference data and so-called “preference pollution,” which denotes an unintended relationship between system recommendations and the user’s post-consumption preference ratings. We provide an overview of these issues and their importance for the design and application of next-generation recommendation systems, including directions for future research.
UR - http://www.scopus.com/inward/record.url?scp=85134160364&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85134160364&partnerID=8YFLogxK
U2 - 10.1002/aaai.12055
DO - 10.1002/aaai.12055
M3 - Article
AN - SCOPUS:85134160364
SN - 0738-4602
VL - 43
SP - 177
EP - 189
JO - AI Magazine
JF - AI Magazine
IS - 2
ER -