Multiple timescales of normalized value coding underlie adaptive choice behavior

Jan Zimmermann, Paul W. Glimcher, Kenway Louie

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Adaptation is a fundamental process crucial for the efficient coding of sensory information. Recent evidence suggests that similar coding principles operate in decision-related brain areas, where neural value coding adapts to recent reward history. However, the circuit mechanism for value adaptation is unknown, and the link between changes in adaptive value coding and choice behavior is unclear. Here we show that choice behavior in nonhuman primates varies with the statistics of recent rewards. Consistent with efficient coding theory, decision-making shows increased choice sensitivity in lower variance reward environments. Both the average adaptation effect and across-session variability are explained by a novel multiple timescale dynamical model of value representation implementing divisive normalization. The model predicts empirical variance-driven changes in behavior despite having no explicit knowledge of environmental statistics, suggesting that distributional characteristics can be captured by dynamic model architectures. These findings highlight the importance of treating decision-making as a dynamic process and the role of normalization as a unifying computation for contextual phenomena in choice.

Original languageEnglish (US)
Article number3206
JournalNature communications
Volume9
Issue number1
DOIs
StatePublished - Dec 1 2018
Externally publishedYes

Fingerprint

Choice Behavior
Psychological Adaptation
Reward
coding
Decision making
Statistics
Decision Making
decision making
Dynamic models
Brain
Primates
statistics
Networks (circuits)
primates
History
dynamic models
brain
histories
sensitivity

PubMed: MeSH publication types

  • Journal Article
  • Research Support, N.I.H., Extramural

Cite this

Multiple timescales of normalized value coding underlie adaptive choice behavior. / Zimmermann, Jan; Glimcher, Paul W.; Louie, Kenway.

In: Nature communications, Vol. 9, No. 1, 3206, 01.12.2018.

Research output: Contribution to journalArticle

@article{6390c4d6ce4e47bab41e63ec627e7fe2,
title = "Multiple timescales of normalized value coding underlie adaptive choice behavior",
abstract = "Adaptation is a fundamental process crucial for the efficient coding of sensory information. Recent evidence suggests that similar coding principles operate in decision-related brain areas, where neural value coding adapts to recent reward history. However, the circuit mechanism for value adaptation is unknown, and the link between changes in adaptive value coding and choice behavior is unclear. Here we show that choice behavior in nonhuman primates varies with the statistics of recent rewards. Consistent with efficient coding theory, decision-making shows increased choice sensitivity in lower variance reward environments. Both the average adaptation effect and across-session variability are explained by a novel multiple timescale dynamical model of value representation implementing divisive normalization. The model predicts empirical variance-driven changes in behavior despite having no explicit knowledge of environmental statistics, suggesting that distributional characteristics can be captured by dynamic model architectures. These findings highlight the importance of treating decision-making as a dynamic process and the role of normalization as a unifying computation for contextual phenomena in choice.",
author = "Jan Zimmermann and Glimcher, {Paul W.} and Kenway Louie",
year = "2018",
month = "12",
day = "1",
doi = "10.1038/s41467-018-05507-8",
language = "English (US)",
volume = "9",
journal = "Nature Communications",
issn = "2041-1723",
publisher = "Nature Publishing Group",
number = "1",

}

TY - JOUR

T1 - Multiple timescales of normalized value coding underlie adaptive choice behavior

AU - Zimmermann, Jan

AU - Glimcher, Paul W.

AU - Louie, Kenway

PY - 2018/12/1

Y1 - 2018/12/1

N2 - Adaptation is a fundamental process crucial for the efficient coding of sensory information. Recent evidence suggests that similar coding principles operate in decision-related brain areas, where neural value coding adapts to recent reward history. However, the circuit mechanism for value adaptation is unknown, and the link between changes in adaptive value coding and choice behavior is unclear. Here we show that choice behavior in nonhuman primates varies with the statistics of recent rewards. Consistent with efficient coding theory, decision-making shows increased choice sensitivity in lower variance reward environments. Both the average adaptation effect and across-session variability are explained by a novel multiple timescale dynamical model of value representation implementing divisive normalization. The model predicts empirical variance-driven changes in behavior despite having no explicit knowledge of environmental statistics, suggesting that distributional characteristics can be captured by dynamic model architectures. These findings highlight the importance of treating decision-making as a dynamic process and the role of normalization as a unifying computation for contextual phenomena in choice.

AB - Adaptation is a fundamental process crucial for the efficient coding of sensory information. Recent evidence suggests that similar coding principles operate in decision-related brain areas, where neural value coding adapts to recent reward history. However, the circuit mechanism for value adaptation is unknown, and the link between changes in adaptive value coding and choice behavior is unclear. Here we show that choice behavior in nonhuman primates varies with the statistics of recent rewards. Consistent with efficient coding theory, decision-making shows increased choice sensitivity in lower variance reward environments. Both the average adaptation effect and across-session variability are explained by a novel multiple timescale dynamical model of value representation implementing divisive normalization. The model predicts empirical variance-driven changes in behavior despite having no explicit knowledge of environmental statistics, suggesting that distributional characteristics can be captured by dynamic model architectures. These findings highlight the importance of treating decision-making as a dynamic process and the role of normalization as a unifying computation for contextual phenomena in choice.

UR - http://www.scopus.com/inward/record.url?scp=85051461384&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85051461384&partnerID=8YFLogxK

U2 - 10.1038/s41467-018-05507-8

DO - 10.1038/s41467-018-05507-8

M3 - Article

VL - 9

JO - Nature Communications

JF - Nature Communications

SN - 2041-1723

IS - 1

M1 - 3206

ER -