Journal Article10.1016/J.NEUNET.2020.03.005
Dynamic resource allocation during reinforcement learning accounts for ramping and phasic dopamine activity.
Minryung R. Song,Sang Wan Lee +1 more
18
TL;DR: The role of dopamine is elucidated in a broader context, providing a potential explanation for the diverse repertoire of dopamine activity that cannot be explained solely by prediction error.
read more
About: This article is published in Neural Networks. The article was published on 01 Jun 2020. The article focuses on the topics: Temporal difference learning.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Prolonged dopamine signalling in striatum signals proximity and value of distant rewards
Mark W. Howe,Patrick L. Tierney,Stefan G. Sandberg,Paul E. M. Phillips,Ann M. Graybiel +4 more
- 01 Aug 2013
TL;DR: An extended mode of reward-predictive dopamine signalling in the striatum that emerged as rats moved towards distant goals could provide sustained motivational drive, a control mechanism that may be important for normal behaviour and that can be impaired in a range of neurologic and neuropsychiatric disorders.
327
Dopamine Receptor Subtypes, Physiology and Pharmacology: New Ligands and Concepts in Schizophrenia.
TL;DR: The review summarizes the recent advances in the field, addressing the relevance of emerging new targets in schizophrenia in particular in relation to the dopamine – glutamate NMDA systems interactions.
Dopamine, Updated: Reward Prediction Error and Beyond.
TL;DR: A major challenge is to reconcile RPE theory with other current theories of dopamine function to account for dopamine's role in movement, motivation, and goal-directed planning.
94
Advances in modeling learning and decision-making in neuroscience.
Anne G.E. Collins,Amitai Shenhav +1 more
TL;DR: In this article, the authors review the recent history of computational modeling of learning and decision-making, and how these models have been used to advance understanding of prefrontal cortex function, and discuss how such models have advanced from their origins in basic algorithms of updating and action selection to increasingly account for complexities in the cognitive processes required for learning, and the representations over which they operate.
59
References
A Neural Substrate of Prediction and Reward
TL;DR: Findings in this work indicate that dopaminergic neurons in the primate whose fluctuating output apparently signals changes or errors in the predictions of future salient and rewarding events can be understood through quantitative theories of adaptive optimizing control.
A model for Pavlovian learning: Variations in the effectiveness of conditioned but not of unconditioned stimuli.
John M. Pearce,Geoffrey Hall +1 more
TL;DR: A new model is proposed that deals with the explanation of cases in which learning does not occur in spite of the fact that the conditioned stimulus is a signal for the reinforcer by specifying that certain procedures cause a conditioned stimulus to lose effectiveness.
3K
The debate over dopamine’s role in reward: the case for incentive salience
TL;DR: Dopamine’s contribution appears to be chiefly to cause ‘wanting’ for hedonic rewards, more than ‘liking’ or learning for those rewards.
The role of the basal ganglia in habit formation
Henry H. Yin,Barbara J. Knowlton +1 more
TL;DR: Recent work combining modern behavioural assays and neurobiological analysis of the basal ganglia has begun to yield insights into the neural basis of habit formation.
2.3K
Dopamine in Motivational Control: Rewarding, Aversive, and Alerting
TL;DR: It is proposed that dopamine neurons come in multiple types that are connected with distinct brain networks and have distinct roles in motivational control, and it is hypothesized that these dopaminergic pathways for value, salience, and alerting cooperate to support adaptive behavior.
2.2K