When Algorithms Err: Differential Impact of Early vs. Late Errors on Users’ Reliance on Algorithms

Antino Kim, Mochen Yang, Jingjing Zhang

Research output: Contribution to journalArticlepeer-review

2 Scopus citations

Abstract

Errors are a natural part of predictive algorithms, but may discourage users from relying on algorithms. We conduct two experiments to demonstrate that reliance on a predictive algorithm following a substantial error is affected by (i) when the error occurs and (ii) how the algorithm is used in the decision-making process. We find that the impact of an error on reliance depends on whether the error occurs early (i.e., when users first start using the algorithm) or late (i.e., after users have used the algorithm for an extended period). While an early error results in substantial and persistent reliance reduction, a late error affects reliance only temporarily and to a lesser extent. However, when users have more control over how to use the algorithm's predictions, error timing ceases to have a significant impact. Our work advances the understanding of algorithm aversion and informs the practical design of algorithmic decision-making systems.

Original languageEnglish (US)
Article number3557889
JournalACM Transactions on Computer-Human Interaction
Volume30
Issue number1
DOIs
StatePublished - Mar 18 2023

Bibliographical note

Publisher Copyright:
© 2023 Association for Computing Machinery.

Keywords

  • Algorithmic reliance
  • decision support
  • laboratory experiment
  • prediction error
  • timing of error

Fingerprint

Dive into the research topics of 'When Algorithms Err: Differential Impact of Early vs. Late Errors on Users’ Reliance on Algorithms'. Together they form a unique fingerprint.

Cite this