concept

predictive coding

Also known as: predictive coding hierarchy, predictive coding theory, predictive coding models

Facts (13)

Sources

A Survey of Incorporating Psychological Theories in LLMs - arXiv arxiv.org arXiv 5 facts

claimPredictive coding is used to analogize LLMs' next-token prediction, although current research emphasizes hierarchical, multi-scale brain mechanisms rather than simple predictive coding.

referenceRajesh PN Rao and Dana H Ballard proposed a functional interpretation of extra-classical receptive-field effects in the visual cortex through predictive coding in their 1999 paper published in Nature Neuroscience.

claimCaucheteux et al. (2023) provided evidence of a predictive coding hierarchy within the human brain while subjects were listening to speech.

claimAraujo et al. (2021) structures sentences to enable anticipation of subsequent content, leveraging predictive coding to improve semantic coherence through expectation-driven processing.

referenceRao and Ballard's theory of predictive coding (1999) proposes anticipatory processing based on prior knowledge, providing a framework for structuring sequential information.

Attention and consciousness - SelfAwarePatterns selfawarepatterns.com SelfAwarePatterns Jun 12, 2022 3 facts

claimIn predictive coding models, sensory predictions are heavily influenced by the current task and the focus of attention.

claimWilliam James claimed that volition and attention are identical, a perspective that aligns with modern predictive coding views.

claimPredictive coding theory posits that perception is an act of prediction that is fine-tuned by error correction signals originating from the senses.

Classification Schemes of Altered States of Consciousness - ORBi orbi.uliege.be ORBi 2 facts

referenceSterzer, P., Adams, R.A., Fletcher, P., Frith, C., Lawrie, S.M., Muckli, L., Petrovic, P., Uhlhaas, P., Voss, M., and Corlett, P.R. (2018) detailed the predictive coding account of psychosis.

claimBastos et al. (2012) proposed canonical microcircuits for predictive coding in the brain.

The cognitive neuroscience of self-awareness: Current framework ... pubmed.ncbi.nlm.nih.gov PubMed 2 facts

referenceThe paper 'Predictive coding is a consequence of energy efficiency in recurrent neural networks' published in Patterns (2022) posits that predictive coding arises as a result of energy efficiency requirements in recurrent neural networks.

claimSelf-awareness can be conceptualized as an emergent property observed in different cognitive complexity levels within a predictive coding approach.

LLM Hallucination Detection and Mitigation: State of the Art in 2026 zylos.ai Zylos Jan 27, 2026 1 fact

referenceThe paper 'Predictive Coding and Information Bottleneck for Hallucination Detection,' published on arXiv, explores using predictive coding and information bottleneck principles to detect hallucinations in large language models.