Decision making under uncertainty is challenging for any autonomous agent. The challenge increases when the environment’s stochastic properties change over time, i.e., when the environment is volatile. In order to efficiently adapt to volatile environments, agents must primarily rely on recent outcomes to quickly change their decision strategies; in other words, they need to increase their knowledge plasticity. On the contrary, in stable environments, knowledge stability must be preferred to preserve useful information against noise. Here we propose that in mammalian brain, the locus coeruleus (LC) is one of the nuclei involved in volatility estimation and in the subsequent control of neural plasticity. During a reinforcement learning task, LC activation, measured by means of pupil diameter, coded both for environmental volatility and learning rate. We hypothesize that LC could be responsible, through norepinephrinic modulation, for adaptations to optimize decision making in volatile environments. We also suggest a computational model on the interaction between the anterior cingulate cortex (ACC) and LC for volatility estimation.


    Access

    Download


    Export, share and cite



    Title :

    The influence of the noradrenergic system on optimal control of neural plasticity


    Contributors:

    Publication date :

    2013-01-01


    Remarks:

    FRONTIERS IN BEHAVIORAL NEUROSCIENCE ; ISSN: 1662-5153



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Noradrenergic control of circadian rhythms in Cebus albifrons

    Winget, C. M. / Vernikos-Danellis, J. / Sakellaris, P. C. | NTRS | 1973


    Neural Control and Synaptic Plasticity for Adaptive Obstacle Avoidance of Autonomous Drones

    Pedersen, Christian Koed / Manoonpong, Poramate | British Library Conference Proceedings | 2018



    Temporal fusion: a basis for neural plasticity in visual pathways

    Navabi, H. | British Library Conference Proceedings | 1999


    Neural optimal control of flexible spacecraft slew maneuver

    Nayeri, M.Reza Dehghan | Online Contents | 2004