Active Inference, homeostatic regulation and adaptive behavioural control.

TL;DR: In this paper , an etiological pathway from allostatic overload to depression via active inference is established, and the authors identify the systems that underwrite goal-directed behavior and the neuroendocrine and immunological systems as the hierarchical controller that regulates energy resources.

Abstract: Abstract Predictive Processing has been proposed as the single unifying computation underlying all of cognition, and proponents argue that all psychological phenomena can be explained as consequences of this principle. This theoretical framework has inspired many cognitive scientists and neuroscientists, but it currently has no developmental mechanism that would explain how infants begin to perceive and learn about the world. Rather, it treats human cognition as if it exists in a fully developed adult with a history of observations and world knowledge. In its current formulation, Predictive Processing only allows for perception of incoming stimuli given the existence of expectations based on previous experiences and as such does not allow for an infant to ever make a first observation. In this paper, we propose a possible starting point from which the infant can begin to develop predictive models, as well as a toolkit necessary to allow the infant to perform the range of cognitive operations on predictive models necessary for learning. The starting point we propose is a set of low‐precision, low level‐of‐detail predictions with little or no hierarchical structure, which is very rapidly updated to reflect the infant's early environment. The toolkit contains a range of operations referred to collectively as structure learning, which are applied to models in order to allow for building adult‐like hierarchical models. These modifications are necessary for developmental scientists to be able to adopt the Predictive Processing framework and benefit from its advantages, but also for Predictive Processing to be able to explain all human cognition, which inherently must include development.

TL;DR: It is proposed that cognitive control stems from the active maintenance of patterns of activity in the prefrontal cortex that represent goals and the means to achieve them, which provide bias signals to other brain structures whose net effect is to guide the flow of activity along neural pathways that establish the proper mappings between inputs, internal states, and outputs needed to perform a given task.

TL;DR: This paper presents and proves in detail a convergence theorem forQ-learning based on that outlined in Watkins (1989), showing that Q-learning converges to the optimum action-values with probability 1 so long as all actions are repeatedly sampled in all states and the action- values are represented discretely.

TL;DR: Findings in this work indicate that dopaminergic neurons in the primate whose fluctuating output apparently signals changes or errors in the predictions of future salient and rewarding events can be understood through quantitative theories of adaptive optimizing control.