A tutorial on the free-energy framework for modelling perception and learning.

Bogacz R

This paper presents an easy to follow tutorial on a theory describing information processing in a part of the brain called the cerebral cortex. This theory (known as the “predictive coding model” or “free-energy framework”) assumes that the cortex learns a statistical model of the outside world on the basis of sensory information it receives, and then uses this model to interpret the information.

Scientific Abstract

This paper provides an easy to follow tutorial on the free-energy framework for modelling perception developed by Friston, which extends the predictive coding model of Rao and Ballard. These models assume that the sensory cortex infers the most likely values of attributes or features of sensory stimuli from the noisy inputs encoding the stimuli. Remarkably, these models describe how this inference could be implemented in a network of very simple computational elements, suggesting that this inference could be performed by biological networks of neurons. Furthermore, learning about the parameters describing the features and their uncertainty is implemented in these models by simple rules of synaptic plasticity based on Hebbian learning. This tutorial introduces the free-energy framework using very simple examples, and provides step-by-step derivations of the model. It also discusses in more detail how the model could be implemented in biological neural circuits. In particular, it presents an extended version of the model in which the neurons only sum their inputs, and synaptic plasticity only depends on activity of pre-synaptic and post-synaptic neurons.

A tutorial on the free-energy framework for modelling perception and learning.
A tutorial on the free-energy framework for modelling perception and learning.
Citation

2017.J Math Psychol, 76(Pt B):198-211.

Related Content
Publication
Salvatori T, Song Y, Yordanov Y, Millidge B, Sha L, Emde C, Xu Z, Bogacz R, Lukasiewicz T
2024. The Twelveth International Conference on Learning Representations
Publication
Salvatori T, Song Y, Hong Y, Sha L, Frieder S, Xu Z, Bogacz R, Lukasiewicz T
2021. Adv. Neural Inf. Process Syst., 34:3874-3886.
Publication
Millidge B, Song Y, Salvatori T, Lukasiewicz T, Bogacz R
2023. The Eleventh International Conference on Learning Representations
Publication
Tang M, Salvatori T, Millidge B, Song Y, Lukasiewicz T, Bogacz R

2023. PLoS Comput Biol, 19(4)e1010719.

Publication
Richards BA, Lillicrap TP, Beaudoin P, Bengio Y, Bogacz R, Christensen A, Clopath C, Costa RP, de Berker A, Ganguli S, Gillon CJ, Hafner D, Kepecs A, Kriegeskorte N, Latham P, Lindsay GW, Miller KD, Naud R, Pack CC, Poirazi P, Roelfsema P, Sacramento J, Saxe A, Scellier B, Schapiro AC, Senn W, Wayne G, Yamins D, Zenke F, Zylberberg J, Therien D, Kording KP
2019. Nat. Neurosci., 22:1761-1770.