en
Scientific article
English

Neural correlates of risk prediction error during reinforcement learning in humans

Published inNeuroImage, vol. 47, no. 4, p. 1929-1939
Publication date2009
Abstract

Behavioral studies have shown for decades that humans are sensitive to risk when making decisions. More recently, brain activities have been shown to be correlated with risky choices. But an important gap needs to be filled: How does the human brain learn which decisions are risky? In cognitive neuroscience, reinforcement learning has never been used to estimate reward variance, a common measure of risk in economics and psychology. It is thus unknown which brain regions are involved in risk learning. To address this question, participants completed a decision-making task during fMRI. They chose repetitively from four decks of cards and each selection was followed by a stochastic payoff. Expected reward and risk differed among the decks. Participants' aim was to maximize payoffs. Risk and reward prediction errors were calculated after each payoff based on a novel reinforcement learning model. For reward prediction error, the strongest correlation was found with the BOLD response in the striatum. For risk prediction error, the strongest correlation was found with the BOLD responses in the insula and inferior frontal gyrus. We conclude that risk and reward prediction errors are processed by distinct neural circuits during reinforcement learning. Additional analyses revealed that the BOLD response in the inferior frontal gyrus was more pronounced for risk aversive participants, suggesting that this region also serves to inhibit risky choices.

Keywords
  • Brain/physiology
  • Choice Behavior/physiology
  • Female
  • Humans
  • Magnetic Resonance Imaging/methods
  • Male
  • Reinforcement (Psychology)
  • Risk-Taking
  • Task Performance and Analysis
  • Young Adult
Research group
Citation (ISO format)
D’ACREMONT, Mathijs et al. Neural correlates of risk prediction error during reinforcement learning in humans. In: NeuroImage, 2009, vol. 47, n° 4, p. 1929–1939. doi: 10.1016/j.neuroimage.2009.04.096
Main files (1)
Article (Published version)
accessLevelRestricted
Identifiers
ISSN of the journal1053-8119
555views
0downloads

Technical informations

Creation16.03.2010 12:52:00
First validation16.03.2010 12:52:00
Update time14.03.2023 15:25:06
Status update14.03.2023 15:25:06
Last indexation15.01.2024 19:37:11
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack