The capacity to predict future events permits a creature to detect, model, and manipulate the causal structure of its interactions with its environment. Behavioral experiments suggest that learning is driven by changes in the expectations about future salient events such as rewards and punishments. Physiological work has recently complemented these studies by identifying dopaminergic neurons in the primate whose fluctuating output apparently signals changes or errors in the predictions of future salient and rewarding events. Taken together, these findings can be understood through quantitative theories of adaptive optimizing control.

/pdf/a-neural-substrate-of-prediction-and-reward-2tj1zqgoih.pdf

A Neural Substrate of Prediction and Reward

Theoretical neuroscience provides a quantitative basis for describing what nervous systems do, determining how they function, and uncovering the general principles by which they operate This text introduces the basic mathematical and computational methods of theoretical neuroscience and presents applications in a variety of areas including vision, sensory-motor integration, development, learning, and memory The book is divided into three parts Part I discusses the relationship between sensory stimuli and neural responses, focusing on the representation of information by the spiking activity of neurons Part II discusses the modeling of neurons and neural circuits on the basis of cellular and synaptic biophysics Part III analyzes the role of plasticity in development and learning An appendix covers the mathematical methods used, and exercises are available on the book's Web site

Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems

• Recent research on schizophrenia has demonstrated that in this disorder the brain is not, strictly speaking, normal. The findings suggest that nonspecific histopathology exists in the limbic system, diencephalon, and prefrontal cortex, that the pathology occurs early in development, and that the causative process is inactive long before the diagnosis is made. If these findings are valid and not epiphenomena, then the pathogenesis of schizophrenia does not appear to fit either traditional metabolic, posttraumatic, or neurodegenerative models of adult mental illness. The data are more consistent with a neurodevelopmental model in which a fixed "lesion" from early in life interacts with normal brain maturational events that occur much later. Based on neuro-ontological principles and insights from animal research about normal brain development, it is proposed that the appearance of diagnostic symptoms is linked to the normal maturation of brain areas affected by the early developmental pathology, particularly the dorsolateral prefrontal cortex. The course of the illness and the importance of stress may be related to normal maturational aspects of dopaminergic neural systems, particularly those innervating prefrontal cortex. Some implications for future research and treatment are considered.

Implications of normal brain development for the pathogenesis of schizophrenia

The central theme of the "segregated circuits" hypothesis is that structural convergence and functional integration occurs within, rather than between, each of the identified circuits Admittedly, the anatomical evidence upon which this scheme is based remains incomplete The hypothesis continues to be predicated largely on comparisons of anterograde and retrograde labeling studies carried out in different sets of animals Only in the case of the "motor" circuit has evidence for the continuity of the loop been demonstrated directly in individual subjects; for the other circuits, such continuity is inferred from comparisons of data on different components of each circuit obtained in separate experiments Because of the marked compression of pathways leading from cortex through basal ganglia to thalamus, comparisons of projection topography across experimental subjects may be hazardous Definitive tests of the hypothesis of maintained segregation await additional double- and multiple-label tract-tracing experiments wherein the continuity of one circuit, or the segregation of adjacent circuits, can be examined directly in individual subjects It is worthy of note, however, that the few studies to date that have employed this methodology have generated results consistent with the segregated circuits hypothesis Moreover, single cell recordings in behaving animals have shown striking preservation of functional specificity at the level of individual neurons throughout the "motor" and "oculomotor" circuits It is difficult to imagine how such functional specificity could be maintained in the absence of strict topographic specificity within the sequential projections that comprise these two circuits This is not to say, however, that we expect the internal structure of functional channels (eg, the "arm" channel within the "motor" circuit) to have cable-like, point-to-point topography When the grain of analysis is sufficiently fine, anatomical studies have shown repeatedly that the terminal fields of internuclear projections (eg, to striatum, pallidum, nigra, thalamus, etc) often appear patchy and highly divergent, suggesting that neighboring groups of projection cells tend to influence interdigitating clusters of postsynaptic neurons While more intricate and complex than simple point-to-point topography, however, this type arrangement should also be capable of maintaining functional specificity As discussed briefly above, it is not yet clear to what extent the inputs to the "motor" circuit from the different precentral motor fields (eg, MC, SMA, APA) are integrated in their passage through the circuit It now appears that at the level of the putamen such inputs remain segregated(ABSTRACT TRUNCATED AT 400 WORDS)

Basal ganglia-thalamocortical circuits: parallel substrates for motor, oculomotor, "prefrontal" and "limbic" functions.

The basal ganglia: focused selection and inhibition of competing motor programs.

VISUALLY guided reaching requires complex neural transformations to link visual and proprioceptive inputs with appropriate motor outputs1,2. Despite the complexity of these transformations, hand–eye coordination in humans is remarkably flexible, as demonstrated by the ease with which reaching can be adapted to distortions in visual feedback. If subjects attempt to reach to visual targets while wearing displacing prisms, they initially misreach in the direction of visual displacement. Given feedback about their reaching errors, however, they quickly adapt to the visual distortion. This is shown by the gradual resumption of accurate reaching while the prisms remain in place, and by the immediate onset of reaching errors in the opposite direction after the prisms have been removed3. Despite an abundance of psy-chophysical data on adaptation to prisms, the functional localization of this form of sensorimotor adaptation is uncertain. Here we use positron emission tomography (PET) to localize changes in regional cerebral blood flow (rCBF) in subjects who performed a prism-adaptation task as well as a task that controlled for the sensory, motor and cognitive conditions of the adaptation experiment. Difference images that reflected the net effects of the adaptation process showed selective activation of posterior parietal cortex contralateral to the reaching limb.

Role of posterior parietal cortex in the recalibration of visually guided reaching.

Parkinson's disease (PD) is the second most common movement disorder. The characteristic motor impairments - bradykinesia, rigidity, and resting tremor - result from degenerative loss of midbrain dopamine (DA) neurons in the substantia nigra, and are responsive to symptomatic treatment with dopaminergic medications and functional neurosurgery. PD is also the second most common neurodegenerative disorder. Viewed from this perspective, PD is a disorder of multiple functional systems, not simply the motor system, and of multiple neurotransmitter systems, not merely that of DA. The characteristic pathology - intraneuronal Lewy body inclusions and reduced numbers of surviving neurons - is similar in each of the targeted neuron groups, suggesting a common neurodegenerative process. Pathological and experimental studies indicate that oxidative stress, proteolytic stress, and inflammation figure prominently in the pathogenesis of PD. Yet, whether any of these mechanisms plays a causal role in human PD is unknown, because to date we have no proven neuroprotective therapies that slow or reverse disease progression in patients with PD. We are beginning to understand the pathophysiology of motor dysfunction in PD, but its etiopathogenesis as a neurodegenerative disorder remains poorly understood.

Biology of Parkinson's disease: pathogenesis and pathophysiology of a multisystem neurodegenerative disorder.

Shen, Liming and Garrett E. Alexander. Neural correlates of a spatial sensory-to-motor transformation in primary motor cortex. J. Neurophysiol. 77: 1171–1194, 1997. Primary motor cortex (MC) has be...

Neural Correlates of a Spatial Sensory-To-Motor Transformation in Primary Motor Cortex

The motor circuitry of the basal ganglia is organized in parallel with basal ganglia circuits involved in oculomotor, associative, and limbic functions. These circuits comprise reentrant pathways that originate in various neocortical domains and pass through the basal ganglia before returning, by way of the thalamus, to select portions of the frontal lobe. Recent progress in characterizing the anatomy and physiology of these pathways has provided new insights into the pathophysiology of basal ganglia-related movement disorders and enhanced our understanding of the normal role of the basal ganglia in movement control and adaptive motor behavior.

Basal ganglia-thalamocortical circuits: their role in control of movements.

For effective sensorimotor processing must there be explicit representations and reconciliation of differing frames of reference

Handle everyday research tasks with reliable, citation-backed results

Your personal Research Agent to handle research tasks with citation-backed results

Popular Tasks used by Researchers

How can I help with your research?

Meet SciSpace

Get more enhanced response by uploading the PDFs you want me to reference.

No relevant PDFs in your library

SciSpace is the AI research assistant for academics. Run systematic literature reviews on 280M+ papers, and write papers with cited sources. Trusted by 1M+ students, PhDs & researchers.

SciSpace | AI for Research

Analyze PDFs

Code & Manuscripts

Funding & Grants

Literature & Patents

Medical & Clinical Data

Systematic Review

Visualize & Present

Web & Data

Build a Google Scholar-like website for your research.

Build a website

Create charts and images for your research

Create a Chart

Write a paper for submission to a journal

Draft a manuscript

Patent Search

Design eye-catching scientific posters in minutes.

Scientific Poster Generation

Systematic Literature Review

One task is running at the moment. Your messages will be shown right after.

Drag and drop or click here to browse

Loved by <highlight>1 million+</highlight> researchers

Extract a list of specific topics and their sources from unstructured text

Topics

Compare and analyze relevant papers that matches with your search

Papers

Get insights from PDFs and bookmarked papers from your library

My library

Recent searches

Try searching for:

Catch AI-generated content in scholarly and non-scholarly content

{ai} Detector

Ai Writer

Get PDF Summaries, highlighted text explanations 

Chat with PDF

Effortlessly create in-text citations and bibliographies in APA and 2,500 other formats

Citation generator

Get explanations, summaries, and answers on academic papers

Ease up your research workflow with {scispace}'s cohort of exciting AI tools

Elevate your academic writing skills and convey your ideas the way you want

Paraphraser

Explore our range of reading and writing tools

Your file is being prepared and should be ready in a few minutes. If it's a large file, it might take a bit longer. You can close this window, and we'll email you the file when it's done.

You have reached a maximum limit of <strong>{limit}</strong> columns in the table. Remove at least <strong>1</strong> column to add or create another one.

Garrett E. Alexander

Author Tools

Chat about Author