Volatility Facilitates Value Updating in the Prefrontal Cortex

Neuron. 2018 Aug 8;99(3):598-608.e4. doi: 10.1016/j.neuron.2018.06.033. Epub 2018 Jul 19.

Abstract

Adaptation of learning and decision-making might depend on the regulation of activity in the prefrontal cortex. Here we examined how volatility of reward probabilities influences learning and neural activity in the primate prefrontal cortex. We found that animals selected recently rewarded targets more often when reward probabilities of different options fluctuated across trials than when they were fixed. Additionally, neurons in the orbitofrontal cortex displayed more sustained activity related to the outcomes of their previous choices when reward probabilities changed over time. Such volatility also enhanced signals in the dorsolateral prefrontal cortex related to the current but not the previous location of the previously rewarded target. These results suggest that prefrontal activity related to choice and reward is dynamically regulated by the volatility of the environment and underscore the role of the prefrontal cortex in identifying aspects of the environment that are responsible for previous outcomes and should be learned.

Keywords: anterior cingulate cortex; decision-making; orbitofrontal cortex; prefrontal cortex; reinforcement learning; reward; uncertainty.

Publication types

  • Research Support, N.I.H., Extramural

MeSH terms

  • Animals
  • Decision Making / physiology*
  • Learning / physiology*
  • Macaca mulatta
  • Male
  • Prefrontal Cortex / physiology*
  • Reward*