A tutorial on the free-energy framework for modelling perception and learning.

This paper presents an easy to follow tutorial on a theory describing information processing in a part of the brain called the cerebral cortex. This theory (known as the “predictive coding model” or “free-energy framework”) assumes that the cortex learns a statistical model of the outside world on the basis of sensory information it receives, and then uses this model to interpret the information.

Scientific Abstract

This paper provides an easy to follow tutorial on the free-energy framework for modelling perception developed by Friston, which extends the predictive coding model of Rao and Ballard. These models assume that the sensory cortex infers the most likely values of attributes or features of sensory stimuli from the noisy inputs encoding the stimuli. Remarkably, these models describe how this inference could be implemented in a network of very simple computational elements, suggesting that this inference could be performed by biological networks of neurons. Furthermore, learning about the parameters describing the features and their uncertainty is implemented in these models by simple rules of synaptic plasticity based on Hebbian learning. This tutorial introduces the free-energy framework using very simple examples, and provides step-by-step derivations of the model. It also discusses in more detail how the model could be implemented in biological neural circuits. In particular, it presents an extended version of the model in which the neurons only sum their inputs, and synaptic plasticity only depends on activity of pre-synaptic and post-synaptic neurons.

A tutorial on the free-energy framework for modelling perception and learning.
A tutorial on the free-energy framework for modelling perception and learning.
Citation

2017.J Math Psychol, 76(Pt B):198-211.

Related Content
Publication
Author
Salvatori T
Yordanov Y
Millidge B
Sha L
Emde C
Xu Z
Lukasiewicz T
2024. The Twelveth International Conference on Learning Representations
Publication
Author
Salvatori T
Hong Y
Sha L
Frieder S
Xu Z
Lukasiewicz T
2021. Adv. Neural Inf. Process Syst., 34:3874-3886.
Publication
Author
Millidge B
Salvatori T
Lukasiewicz T
2023. The Eleventh International Conference on Learning Representations
Publication
Author
Salvatori T
Millidge B
Lukasiewicz T

2023. PLoS Comput Biol, 19(4)e1010719.

Publication
Author
Richards BA
Lillicrap TP
Beaudoin P
Bengio Y
Christensen A
Clopath C
Costa RP
de Berker A
Ganguli S
Gillon CJ
Hafner D
Kepecs A
Kriegeskorte N
Latham P
Lindsay GW
Miller KD
Naud R
Pack CC
Poirazi P
Roelfsema P
Sacramento J
Saxe A
Scellier B
Schapiro AC
Senn W
Wayne G
Yamins D
Zenke F
Zylberberg J
Therien D
Kording KP
2019. Nat. Neurosci., 22:1761-1770.