# Complementary Learning Systems theory and HTM as a theory of the hippocampus

**URL:** <https://discourse.numenta.org/t/complementary-learning-systems-theory-and-htm-as-a-theory-of-the-hippocampus/2636>\
**Category:** Tangential Theories\
**Tags:** hippocampus, sparsity, one-shot-learning, replay\
**Created:** [August 4, 2017, 6:48am UTC](https://discourse.numenta.org/t/complementary-learning-systems-theory-and-htm-as-a-theory-of-the-hippocampus/2636 "2017-08-04T06:48:57Z")\
**Posts on this page:** 13\
**Page:** 1

<div class="post-metadata">

**Author:** ![jakebruce](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/jakebruce/32/996_2.png) [@jakebruce](https://discourse.numenta.org/u/jakebruce)\
**Post date:** [August 4, 2017, 6:48am UTC](https://discourse.numenta.org/t/complementary-learning-systems-theory-and-htm-as-a-theory-of-the-hippocampus/2636/1 "2017-08-04T06:48:57Z")

</div>

HTM is intended to be a theory of the neocortex. But in some ways the algorithm seems to apply more appropriately to the hippocampus. In particular, both HTM and the hippocampus learn from experience online, and very quickly. In many theories and experiments, the neocortex on the other hand appears to learn gradually.

I recently reviewed this paper [1] summarizing and extending Complementary Learning Systems theory. Briefly, the theory can be summarized as follows. The neocortex has relatively dense activity and connections with weights that are generally updated slowly, whereas the hippocampus has very sparse activity and connections with weights that are updated rapidly. The hippocampus learns episodic memories in a one-shot fashion, which are then replayed to the neocortex gradually during and interleaved with experience, and during sleep and rest, in order to gradually update the less-plastic synapses in the neocortex.

This is supported by the observed sparsity in the various regions (~10% in many upper regions of neocortex, ~4% in CA1 of hippocampus, ~2.5% in CA3 of hippocampus, ~0.5-1% in dentate gyrus of hippocampus), the highly-plastic synapses in the hippocampus compared to the neocortex, the severe learning impairments of hippocampus-lesioned animals, and theoretical problems with attempting to support both generalization ability and fast learning free from catastrophic interference (also called catastrophic forgetting).

In many respects the hippocampus can be seen as a primordial neocortex from which the true neocortex evolved, and there is preserved structural similarity between the two (at least in CA3/CA1) in terms of lamination and cell types and so on.

It’s clear to me as someone who does a lot of “traditional” machine learning that some sort of high-plasticity episodic memory needs to be combined with a low-plasticity generalizing memory, so I do expect intelligent online learning agents to eventually require both of these. But can a fast-learning system like HTM successfully generalize while preserving its one-shot capability? I’m leaning toward HTM being an effective theory of CA3/CA1, with slower-updating neocortex (while surely preserving some of the insights of HTM) ultimately having more in common with current deep networks.

Thoughts? I recommend reading the paper in any case, it’s a great modern look on a long-standing theory of the systems-level learning mechanisms in animals.

* * *

[1] Kumaran, Dharshan, Demis Hassabis, and James L. McClelland. “What learning systems do intelligent agents need? Complementary learning systems theory updated.” _Trends in cognitive sciences_ 20.7 (2016): 512-534.

---

<div class="post-metadata">

**Author:** ![Glenn\_Gasner](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/glenn_gasner/32/1361_2.png) [@Glenn\_Gasner](https://discourse.numenta.org/u/Glenn_Gasner)\
**Post date:** [August 4, 2017, 12:38pm UTC](https://discourse.numenta.org/t/complementary-learning-systems-theory-and-htm-as-a-theory-of-the-hippocampus/2636/2 "2017-08-04T12:38:30Z")

</div>

First, great post. My hippocampus has no rapid, one shot thoughts to add yet. Here’s a [link to the cited paper](https://pdfs.semanticscholar.org/84dc/cdefebec40941af9d0cd4d415d7f2e5f1959.pdf) for anyone else curious.

---

<div class="post-metadata">

**Author:** ![DellAnnaLuca](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/dellannaluca/32/3465_2.png) [@DellAnnaLuca](https://discourse.numenta.org/u/DellAnnaLuca)\
**Post date:** [August 4, 2017, 12:51pm UTC](https://discourse.numenta.org/t/complementary-learning-systems-theory-and-htm-as-a-theory-of-the-hippocampus/2636/3 "2017-08-04T12:51:34Z")

</div>

Thank you for the link to such an interesting paper.

I noticed one point worth highlighting: the hippocampal memories lack structure.  
This point makes me wonder: could it be that the hippocampus is the way to quickly absorb yet-unstructured data (data to make sense of), and that the “replaying” of such memories does not only serve to solidify them to the cortex, but also to make sense of them?  
This would match my understanding that the hippocampus is “called” when there is a piece of perception the cortex doesn’t manage to make sense of.

This might be useful because most current applications of HTM learn from a flow of the same type of data. In real life, this is true for sensorial areas but not for higher areas - often we have to learn from a single episode that happened in our life. This would allow cortical synapses to learn a lot from a single piece of sensorial data.

---

<div class="post-metadata">

**Author:** ![Charles\_Rosenbauer](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/charles_rosenbauer/32/5134_2.png) [@Charles\_Rosenbauer](https://discourse.numenta.org/u/Charles_Rosenbauer)\
**Post date:** [August 5, 2017, 4:54am UTC](https://discourse.numenta.org/t/complementary-learning-systems-theory-and-htm-as-a-theory-of-the-hippocampus/2636/4 "2017-08-05T04:54:36Z")

</div>

Looks interesting. That would explain a lot. I haven’t gotten a chance to read through the paper yet, but thanks for the reference. I’ve tried coming up with a hippocampal model myself, but I’ve been much more focused on the Basal Ganglia, and I haven’t read much on the exact properties of hippocampal neurons aside from that they seem to be similar to cortical neurons. What about the different pathways in the hippocampus though? Any ideas on what they’re doing?

I remember that at one point I had some idea that one of the regions may form something similar to a D-latch in digital logic (proximal inputs acting like the data input, apical acting like the write input), but it’s been quite a while since I’ve looked too much into it, and I’ll have to recheck how much of that lines up with the neuroscience.

Taking a quick look at some online hippocampal diagrams, it seems like the pathways generally go EC -\> DG -\> CA3 -\> CA1 -\> EC. Based on the sparsity measurements you mentioned, that would mean that the hippocampus converts the cortical output to an extremely sparse SDR right away, and then gradually creates more dense representations before sending it back to the cortex.

---

<div class="post-metadata">

**Author:** ![jakebruce](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/jakebruce/32/996_2.png) [@jakebruce](https://discourse.numenta.org/u/jakebruce)\
**Post date:** [August 6, 2017, 11:42pm UTC](https://discourse.numenta.org/t/complementary-learning-systems-theory-and-htm-as-a-theory-of-the-hippocampus/2636/5 "2017-08-06T23:42:24Z")

</div>

> [@Charles\_Rosenbauer](#):
>
> Taking a quick look at some online hippocampal diagrams, it seems like the pathways generally go EC → DG → CA3 → CA1 → EC. Based on the sparsity measurements you mentioned, that would mean that the hippocampus converts the cortical output to an extremely sparse SDR right away, and then gradually creates more dense representations before sending it back to the cortex.

That’s precisely correct. The sparsity of the regions appears to correlate also with the plasticity of their synapses, so in addition to being re-densified in the return to the cortex, the representations get “re-generalized” by using less-plastic synapses that can structure the data in a more parametric (as opposed to episodic) way.

> [@Charles\_Rosenbauer](#):
>
> What about the different pathways in the hippocampus though? Any ideas on what they’re doing?

In addition to the pathway you mentioned, there’s a pathway that skips the DG, going right from EC to CA3. This is considered a slower pathway, so one idea of its function is that patterns in EC, if novel, will trigger a fast sparsification in DG and the forming of a new episodic memory sequence in CA3 (_pattern separation_). If on the other hand a pattern is familiar, the connection from EC to CA3 will activate before DG has a chance to respond, reactivating the familiar old episodic memory sequence (_pattern completion_). A detailed spiking model of this theory is presented in [2], which calls this a “race to learn”.

* * *

[2] Nolan, Christopher R., et al. “The race to learn: spike timing and STDP can coordinate learning and recall in CA3.” _Hippocampus_ 21.6 (2011): 647-660.

---

<div class="post-metadata">

**Author:** ![DellAnnaLuca](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/dellannaluca/32/3465_2.png) [@DellAnnaLuca](https://discourse.numenta.org/u/DellAnnaLuca)\
**Post date:** [August 15, 2017, 11:36am UTC](https://discourse.numenta.org/t/complementary-learning-systems-theory-and-htm-as-a-theory-of-the-hippocampus/2636/6 "2017-08-15T11:36:12Z")

</div>

Related: [this new paper](http://sci-hub.io/10.1016/j.neulet.2017.07.061) just got published "Building concepts one episode at a time: The hippocampus and concept formation” (unfortunately I forgot who brought it to my attention).

---

<div class="post-metadata">

**Author:** ![fine2100](https://avatars.discourse-cdn.com/v4/letter/f/c5a1d2/32.png) [@fine2100](https://discourse.numenta.org/u/fine2100)\
**Post date:** [October 2, 2017, 5:17pm UTC](https://discourse.numenta.org/t/complementary-learning-systems-theory-and-htm-as-a-theory-of-the-hippocampus/2636/7 "2017-10-02T17:17:30Z")

</div>

hi  
You should look at TVA theory by professor Claus Bundesen at the Copenhagen University Psychology. He has created exactly the race formulas for object foreground and background.

---

<div class="post-metadata">

**Author:** ![Bitking](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/bitking/32/3099_2.png) [@Bitking](https://discourse.numenta.org/u/Bitking)\
**Post date:** [March 5, 2018, 1:59pm UTC](https://discourse.numenta.org/t/complementary-learning-systems-theory-and-htm-as-a-theory-of-the-hippocampus/2636/8 "2018-03-05T13:59:17Z")

</div>

Dead link. Everything I could find online was behind a paywall.

---

<div class="post-metadata">

**Author:** ![Falco](https://avatars.discourse-cdn.com/v4/letter/f/8797f3/32.png) [@Falco](https://discourse.numenta.org/u/Falco)\
**Post date:** [June 27, 2023, 8:41pm UTC](https://discourse.numenta.org/t/complementary-learning-systems-theory-and-htm-as-a-theory-of-the-hippocampus/2636/9 "2023-06-27T20:41:28Z")

</div>

Earlier this year @jhawkins reviewed that paper in a research meeting.

[![](https://img.youtube.com/vi/SIFWscdP7zU/maxresdefault.jpg ""Complementary Learning Systems Theory Updated" Paper Review | Jeff Hawkins | Research | Numenta") ](https://www.youtube.com/watch?v=SIFWscdP7zU)

At 6:26 Jeff mentions another paper that gives an alternative to memory consolidation from the hippocampus. I wonder if this is the one he meant (by [Alison R. Preston](https://pubmed.ncbi.nlm.nih.gov/?term=Preston%20AR%5BAuthor%5D) and [Howard Eichenbaum](https://pubmed.ncbi.nlm.nih.gov/?term=Eichenbaum%20H%5BAuthor%5D)):

> **[Interplay of hippocampus and prefrontal cortex in memory](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3789138/)**
>
> Recent studies on the hippocampus and the prefrontal cortex have considerably advanced our understanding of the distinct roles of these brain areas in the encoding and retrieval of memories, and of how they interact in the prolonged process by which...

---

<div class="post-metadata">

**Author:** ![Bitking](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/bitking/32/3099_2.png) [@Bitking](https://discourse.numenta.org/u/Bitking)\
**Post date:** [February 1, 2026, 6:10pm UTC](https://discourse.numenta.org/t/complementary-learning-systems-theory-and-htm-as-a-theory-of-the-hippocampus/2636/10 "2026-02-01T18:10:25Z")

</div>

Ok, I get the hippocampus and cortex as two memory systems.

But we have to bring in the other major learning system: The cerebellum.

---

<div class="post-metadata">

**Author:** ![BrainVx](https://avatars.discourse-cdn.com/v4/letter/b/ed8c4c/32.png) [@BrainVx](https://discourse.numenta.org/u/BrainVx)\
**Post date:** [February 5, 2026, 3:30am UTC](https://discourse.numenta.org/t/complementary-learning-systems-theory-and-htm-as-a-theory-of-the-hippocampus/2636/11 "2026-02-05T03:30:57Z")

</div>

Does that exclude the basal ganglia from that learning system ?

The hippocampus may detect surprise, however does the basal ganglia detect the lack of a prediction (anxiety broadcast release) without the need to learn with the neocortex ? The lack of a good prediction in a multi column HTM network would require some type of cross column detection of a missing next output from a column ? In biology 20 correct column activations and 2 missing is not necessarily an error as such, just a degree of uncertainty or a missed throw ? Is the basal ganglia learning column desynchronisation as predictability declines ? Is that predictability contextual based (column depentent or agnostic ?)

Is that the case if you view that all HTM columns have to be interlinked and temporally coherent. What if they are not as temporally coherent as the current approach to HTM assumes ?

---

<div class="post-metadata">

**Author:** ![Bitking](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/bitking/32/3099_2.png) [@Bitking](https://discourse.numenta.org/u/Bitking)\
**Post date:** [February 5, 2026, 4:12am UTC](https://discourse.numenta.org/t/complementary-learning-systems-theory-and-htm-as-a-theory-of-the-hippocampus/2636/12 "2026-02-05T04:12:25Z")

</div>

If you look at _William H. Calvin_’s theoretical neuroscience work — particularly the ideas he’s developed around distributed _cerebral codes_ and _Darwinian_ mechanisms in cortex — there’s a strong conceptual resonance with _Hierarchical Temporal Memory_ even though the traditions come from different communities (neuroscience vs AI).

In Calvin’s model, cortex doesn’t rely on single “grandmother” neurons or simple lookup tables. Rather, representations emerge from large populations of local elements interacting in parallel, with stochastic variations and competitive selection shaping which patterns stabilize and propagate. Over time, local operations — copying, variation, and selection among slightly different pattern variants — tend to produce _distributed representations_ that are both sparse and meaningful across the network. This is why Calvin often uses the metaphor of a “Darwin Machine” in cortex: each local microcircuit can be seen as generating and competing variations, and the winners form the building blocks of higher-level concepts.

This contrasts with classical neural models where learning is purely gradient descent or static clustering (e.g., standard K-means). Instead, Calvin’s view is that the cortex itself _discovers_ good representations through a bottom-up, locally competitive process that naturally yields distributed encoding — similar in spirit to how _sparse distributed representations (SDRs)_ underpin HTM. SDRs in HTM are not arbitrary dense vectors; they are high-dimensional patterns where semantic meaning is distributed across a small active subset of bits. That distributed structure gives HTM robustness and overlap semantics.

What I find compelling in **William H. Calvin** ’s work is that the _basic computational unit_ is effectively the same as in HTM: the **mini-column**. In both frameworks, learning and representation are not properties of individual neurons, but of small, repeating cortical modules that participate in larger population codes.

Where Calvin’s proposal diverges is _not_ in the unit itself, but in **how competition and coordination occur between nearby mini-columns**.

In standard HTM, the Spatial Pooler can be viewed (loosely) as implementing a form of k-means-like competition: inhibition selects a sparse subset of columns based on overlap scores, with a largely algorithmic notion of “winner selection.” In Calvin’s model, the same sparsification pressure arises instead from **biological lateral interactions** , with inhibitory control mediated by interneuron classes (notably chandelier cells) rather than a global or quasi-global normalization step.

This difference matters. K-means-style inhibition is fundamentally _global within a pool_: all columns compete simultaneously against a shared criterion. Chandelier-mediated inhibition, by contrast, is **local, directional, and geometry-constrained**. Competition occurs over the physical span of lateral connections — on the order of ~7 mini-columns — not across the entire representational field. The result is still sparsity, but it is _emergent from local dynamics_, not imposed by a centralized selection rule.

Importantly, this does **not** eliminate distributed representation. Like the Numenta **1000 Brains** model, a stable representation is formed by the collective state of many mini-columns. The key distinction is _how_ lateral connections are used. In the 1000 Brains framework, lateral connections primarily serve to align object models across cortical regions. In Calvin’s formulation, lateral connections are instead intrinsic to the _formation_ of the representation itself — shaping which nearby variants survive through local competition and reinforcement.

So while this can be seen as a modification of the 1000 Brains idea, it preserves the same core principle: **a globally meaningful, distributed representation emerges entirely from local operations**. “Local” here simply means the reach of lateral connectivity between neighboring mini-columns. No column ever needs global knowledge of the representation; it only responds to its inputs and its immediate cortical neighborhood.

From an HTM perspective, this suggests an alternative way to think about the Spatial Pooler: not as a clustering algorithm approximating biology, but as a higher-level abstraction of mechanisms that, in cortex, may be implemented through dense lateral connectivity and biologically plausible inhibitory circuits. The end result — sparse distributed representations with semantic overlap — is the same. The path to get there is different, and arguably closer to cortical reality.

> **[THE CEREBRAL CODE by William H. Calvin (MIT Press 1996)](https://williamcalvin.com/bk9/index.htm)**
>
> Chapter titles: The Representation Problem and the Copying Solution, Cloning in Cerebral Cortex, A Compressed Code Emerges, Managing the Cerebral Commons, Resonating with your Chaotic Memories, Partitioning the Playfield, The Brownian Notion,...

---

<div class="post-metadata">

**Author:** ![bkaz](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/bkaz/32/6455_2.png) [@bkaz](https://discourse.numenta.org/u/bkaz)\
**Post date:** [February 6, 2026, 1:38pm UTC](https://discourse.numenta.org/t/complementary-learning-systems-theory-and-htm-as-a-theory-of-the-hippocampus/2636/13 "2026-02-06T13:38:54Z")

</div>

Gemini on more recent stuff:

**“Natural Continual Learning” (NCL)** paper (Kao, Jensen, et al.) and the related **Attractor Planning** work (Xie et al.). Together, they provide the mathematical “how” for William Calvin’s “Darwin Machine”—explaining how a system can continuously evolve new representations without destroying the old ones (“catastrophic forgetting”).

Here is the breakdown of that work and why it resonates so strongly with the Calvin/HTM perspective:

### 1. The Core Paper: “Natural Continual Learning” (NCL)

**Paper:** _Natural Continual Learning: Success is a Journey, not (just) a Destination_ (Kao, Jensen, et al., NeurIPS 2021; extended analysis 2023/24).

This work attacks the central problem of the “Darwin Machine”: **How do you keep the “winning” clones (memories) stable while using the same hardware to compete for new concepts?**

- **The “Null Space” Projection:** Standard neural networks update all weights to minimize error, often overwriting old tasks. NCL introduces a mechanism that strictly calculates the **“Null Space”** of previous tasks—the directions in synaptic space that _do not_ affect the output of old memories.

- **The Mechanism:** It forces all new learning (the “variation” in Calvin’s sense) to happen _only_ in this Null Space.

- **Biological Equivalent:** They map this to **Metaplasticity** (synaptic stiffness). In the cortex, synapses that code for stable, winning patterns become chemically resistant to change (high stiffness), forcing new learning into the “silent” or less active synapses (high plasticity).

### 2. The “Attractor” Connection (Xie et al.)

**Paper:** _The Geometry of Sequence Working Memory in Prefrontal Cortex_ (Xie et al., 2022/23).

While NCL handles the _synapses_, this work explains the _dynamics_—specifically validating the **hexagonal/grid-like codes** you mentioned.

- **Manifold Attractors:** Xie and colleagues showed that the brain doesn’t store sequences as discrete links (A \\to B \\to C) but as trajectories on a **low-dimensional manifold**.

- **The “Hexagonal” Link:** They found that these manifolds often take the form of **twisted toroids** or grid-like structures. This confirms Calvin’s hunch: the “code” isn’t a single neuron firing; it is a stable, geometric attractor state (a “crystal” of activity) maintained by local lateral inhibition.

- **Significance:** This proves that the “mini-column” competition doesn’t just produce a winner; it produces a **stable location** on a representational map.

###