# Related Papers **URL:** https://discourse.numenta.org/c/science/papers/37.md [Latest](https://discourse.numenta.org/latest.md) · [Categories](https://discourse.numenta.org/categories.md) · [Tags](https://discourse.numenta.org/tags.md) --- ## [About the Related Papers category](https://discourse.numenta.org/t/about-the-related-papers-category/569)
**Author:** [@rhyolight](https://discourse.numenta.org/u/rhyolight)\ **Replies:** 1\ **Last updated:** [May 18, 2018, 1:48pm UTC](https://discourse.numenta.org/t/about-the-related-papers-category/569 "2018-05-18T13:48:28Z")
Discuss papers published about HTM Theory. Anyone may post a new topic here about a published paper that relates to HTM, but: Only one paper per topic, please Paper can be published anywhere like arxiv No blog posts, p… --- ## [Creating Intelligence - A Computational Foundation for AGI](https://discourse.numenta.org/t/creating-intelligence-a-computational-foundation-for-agi/12455)
**Author:** [@POv](https://discourse.numenta.org/u/POv)\ **Replies:** 67\ **Last updated:** [September 23, 2026, 2:11pm UTC](https://discourse.numenta.org/t/creating-intelligence-a-computational-foundation-for-agi/12455 "2026-09-23T14:11:00Z")
Hi everyone, It’s been four years since my Triadic Memory project was discussed here. That topic became the most-replied-to thread on this forum, and I am still incredibly grateful for the discussions we had. Now, I’m… --- ## [Feedback wanted: Hobbist-built Codec for Large Sparse Binary Vectors](https://discourse.numenta.org/t/feedback-wanted-hobbist-built-codec-for-large-sparse-binary-vectors/12507)
**Author:** [@Nik\_Bielski](https://discourse.numenta.org/u/Nik_Bielski)\ **Replies:** 3\ **Last updated:** [July 21, 2026, 10:47am UTC](https://discourse.numenta.org/t/feedback-wanted-hobbist-built-codec-for-large-sparse-binary-vectors/12507 "2026-07-21T10:47:47Z")
My cousins and I have been developing a new codec for very large sparse binary vectors, and the initial results seems promising for parameter free encodings. Initially we thought it might be pretty novel, because the cod… --- ## [Does predictive coding have a future?](https://discourse.numenta.org/t/does-predictive-coding-have-a-future/4364)
**Author:** [@Bitking](https://discourse.numenta.org/u/Bitking)\ **Replies:** 2\ **Last updated:** [September 29, 2025, 2:47pm UTC](https://discourse.numenta.org/t/does-predictive-coding-have-a-future/4364 "2025-09-29T14:47:08Z")
Clearly - in this forum, we take the answer in the affirmative! I think this Paper speaks directly to the theoretical underpinnings of HTM theory. Fristen talks of the difference between predictions and perceptions (I … --- ## [Hierarchical Reasoning Model](https://discourse.numenta.org/t/hierarchical-reasoning-model/11958)
**Author:** [@cezar\_t](https://discourse.numenta.org/u/cezar_t)\ **Replies:** 1\ **Last updated:** [July 23, 2025, 2:16pm UTC](https://discourse.numenta.org/t/hierarchical-reasoning-model/11958 "2025-07-23T14:16:12Z")
HRM excels at tasks that demand extensive search and backtracking. Using only 1,000 input-output examples, without pre-training or CoT supervision, HRM learns to solve problems that are intractable for even the most adv… --- ## [Can a Hebbian-like learning rule be avoiding the curse of dimensionality in sparse distributed data?](https://discourse.numenta.org/t/can-a-hebbian-like-learning-rule-be-avoiding-the-curse-of-dimensionality-in-sparse-distributed-data/11946)
**Author:** [@dmac](https://discourse.numenta.org/u/dmac)\ **Replies:** 1\ **Last updated:** [July 11, 2025, 2:49pm UTC](https://discourse.numenta.org/t/can-a-hebbian-like-learning-rule-be-avoiding-the-curse-of-dimensionality-in-sparse-distributed-data/11946 "2025-07-11T14:49:14Z")
Can a Hebbian-like learning rule be avoiding the curse of dimensionality in sparse distributed data? Maria Osório, Luis Sa-Couto & Andreas Wichert, 2024 https://doi.org/10.1007/s00422-024-00995-y Abstract It is genera… --- ## [Three Tiers Transformers Brains](https://discourse.numenta.org/t/three-tiers-transformers-brains/11773)
**Author:** [@SeanOConnor](https://discourse.numenta.org/u/SeanOConnor)\ **Replies:** 0\ **Last updated:** [March 11, 2025, 3:00am UTC](https://discourse.numenta.org/t/three-tiers-transformers-brains/11773 "2025-03-11T03:00:15Z")
Maybe this paper is interesting. https://arxiv.org/abs/2503.04848 The limitations about learning grammers might be due to artifical neural networks being heirachical associative memory, I kind of would imagine. --- ## [Clone-structured cognitive graphs (CSCG)](https://discourse.numenta.org/t/clone-structured-cognitive-graphs-cscg/9739)
**Author:** [@fcred](https://discourse.numenta.org/u/fcred)\ **Replies:** 9\ **Last updated:** [August 15, 2024, 12:43pm UTC](https://discourse.numenta.org/t/clone-structured-cognitive-graphs-cscg/9739 "2024-08-15T12:43:37Z")
I do not know if everyone is familiar with Dileep George’s paper Clone-structured graph representations enable flexible learning and vicarious evaluation of cognitive maps. In any case, he recently gave a seminar at the… --- ## [Google's Sparse Autoencoder](https://discourse.numenta.org/t/googles-sparse-autoencoder/11439)
**Author:** [@CollinsEM](https://discourse.numenta.org/u/CollinsEM)\ **Replies:** 0\ **Last updated:** [August 3, 2024, 12:42pm UTC](https://discourse.numenta.org/t/googles-sparse-autoencoder/11439 "2024-08-03T12:42:41Z")
New research from Google. Apparently they are coming around to sparse representations. --- ## [STREAMER: Streaming Representation Learning and Event Segmentation in a Hierarchical Manner A](https://discourse.numenta.org/t/streamer-streaming-representation-learning-and-event-segmentation-in-a-hierarchical-manner-a/11132)
**Author:** [@cezar\_t](https://discourse.numenta.org/u/cezar_t)\ **Replies:** 23\ **Last updated:** [December 8, 2023, 12:29pm UTC](https://discourse.numenta.org/t/streamer-streaming-representation-learning-and-event-segmentation-in-a-hierarchical-manner-a/11132 "2023-12-08T12:29:30Z")
My bet this is the next big thing, or at least the architecture/ideas/principles from this work will inspire it. Thanks Numenta for sharing author’s presentation on your channel --- ## [Triadic Memory — A Fundamental Algorithm for Cognitive Computing](https://discourse.numenta.org/t/triadic-memory-a-fundamental-algorithm-for-cognitive-computing/9763)
**Author:** [@cezar\_t](https://discourse.numenta.org/u/cezar_t)\ **Replies:** 282\ **Last updated:** [October 18, 2023, 11:13am UTC](https://discourse.numenta.org/t/triadic-memory-a-fundamental-algorithm-for-cognitive-computing/9763 "2023-10-18T11:13:13Z")
I found this interesting on the whole subject of associative/sparsely distributed memory implementation. It also seems to be optimized for SDRs without using this acronym How does the brain store and compute with cogn… --- ## [RE: Tiiadic Memory: why's everybody so exited?](https://discourse.numenta.org/t/re-tiiadic-memory-whys-everybody-so-exited/11050)
**Author:** [@Bullbash](https://discourse.numenta.org/u/Bullbash)\ **Replies:** 4\ **Last updated:** [October 17, 2023, 11:11pm UTC](https://discourse.numenta.org/t/re-tiiadic-memory-whys-everybody-so-exited/11050 "2023-10-17T23:11:18Z")
Respectfully: a meaningful thread cannot exceed a couple of dozen messages. Now, to memorize a sequence as an SDR a net has to memorize a specific (optimized or not - like bigger or smaller) set of overlapping NOT subst… --- ## [Generative fMRI images to control an agent conditioned on the environment](https://discourse.numenta.org/t/generative-fmri-images-to-control-an-agent-conditioned-on-the-environment/11009)
**Author:** [@Tofara\_Moyo](https://discourse.numenta.org/u/Tofara_Moyo)\ **Replies:** 0\ **Last updated:** [October 9, 2023, 1:44pm UTC](https://discourse.numenta.org/t/generative-fmri-images-to-control-an-agent-conditioned-on-the-environment/11009 "2023-10-09T13:44:52Z")
I have had this idea that i first wrote about in this arxiv paper: Its to use a generative algorithm to produce fake fMri data conditioned on the environment to controll a humanoid robot. I have come some way since th… --- ## [Is Predictive Coding Falsifiable?](https://discourse.numenta.org/t/is-predictive-coding-falsifiable/10991)
**Author:** [@Bitking](https://discourse.numenta.org/u/Bitking)\ **Replies:** 2\ **Last updated:** [September 28, 2023, 11:49am UTC](https://discourse.numenta.org/t/is-predictive-coding-falsifiable/10991 "2023-09-28T11:49:16Z")
This paper pokes at one of the central parts of HTM theory. https://www.sciencedirect.com/science/article/abs/pii/S0149763423003731?via%3Dihub --- ## [Backpropagation and the brain](https://discourse.numenta.org/t/backpropagation-and-the-brain/10186)
**Author:** [@JarvisGoBrr](https://discourse.numenta.org/u/JarvisGoBrr)\ **Replies:** 3\ **Last updated:** [January 23, 2023, 1:21pm UTC](https://discourse.numenta.org/t/backpropagation-and-the-brain/10186 "2023-01-23T13:21:42Z")
So, I found out about this paper where they are proposing a theory for how the brain may be implementing an approximation to backprop, I personally like this theory a lot. They propose that instead of propagating gradie… --- ## [Sequence learning, prediction, and replay in networks of spiking neurons](https://discourse.numenta.org/t/sequence-learning-prediction-and-replay-in-networks-of-spiking-neurons/9130)
**Author:** [@younes\_bouhadjar](https://discourse.numenta.org/u/younes_bouhadjar)\ **Replies:** 4\ **Last updated:** [August 3, 2022, 8:07pm UTC](https://discourse.numenta.org/t/sequence-learning-prediction-and-replay-in-networks-of-spiking-neurons/9130 "2022-08-03T20:07:40Z")
Our work on extending the temporal memory (TM) component of HTM is now available at \[2111.03456\] Sequence learning, prediction, and replay in networks of spiking neurons. In this work, we demonstrate that the principle m… --- ## [Markov Brains: A Technical Introduction](https://discourse.numenta.org/t/markov-brains-a-technical-introduction/9792)
**Author:** [@markNZed](https://discourse.numenta.org/u/markNZed)\ **Replies:** 10\ **Last updated:** [July 2, 2022, 9:59pm UTC](https://discourse.numenta.org/t/markov-brains-a-technical-introduction/9792 "2022-07-02T21:59:08Z")
@jhawkins the authors throw some flowers your way in this paper, “The development of MBs owes a great deal to the insights of Jeff Hawkins (discussed for example in his book “On Intelligence” (Hawkins and Blakeslee, 2004… --- ## [Related knowledge with HTM?](https://discourse.numenta.org/t/related-knowledge-with-htm/9733)
**Author:** [@q228503](https://discourse.numenta.org/u/q228503)\ **Replies:** 4\ **Last updated:** [May 23, 2022, 9:08pm UTC](https://discourse.numenta.org/t/related-knowledge-with-htm/9733 "2022-05-23T21:08:36Z")
Hi, I am preparing to write my master thesis.It’s about HTM hardware design and simulation data transmission by AXI on FPGA, thus I need to write some similar machine learning or devolop background about HTM. I searche… --- ## [Learning Cognitive Map Representations for Navigation by Sensory-Motor Integration](https://discourse.numenta.org/t/learning-cognitive-map-representations-for-navigation-by-sensory-motor-integration/9497)
**Author:** [@hideokuze](https://discourse.numenta.org/u/hideokuze)\ **Replies:** 6\ **Last updated:** [March 27, 2022, 5:45pm UTC](https://discourse.numenta.org/t/learning-cognitive-map-representations-for-navigation-by-sensory-motor-integration/9497 "2022-03-27T17:45:58Z")
Thoughts this paper might be of some interest How to transform a mixed flow of sensory and motor information into memory state of self-location and to build map representations of the environment are central questions … --- ## [Do learned reference frames in GridCellNet lack generalization capability?](https://discourse.numenta.org/t/do-learned-reference-frames-in-gridcellnet-lack-generalization-capability/9454)
**Author:** [@Aharter](https://discourse.numenta.org/u/Aharter)\ **Replies:** 0\ **Last updated:** [February 18, 2022, 8:37pm UTC](https://discourse.numenta.org/t/do-learned-reference-frames-in-gridcellnet-lack-generalization-capability/9454 "2022-02-18T20:37:53Z")
Hi guys, I’m a master student at Bielefeld University and this is my first post, happy to be here :slight\_smile: I am currently trying to develop a deep understanding of the very interesting paper Grid Cell Path Integra… --- ## [\[Paper\] Neural circuit policies enabling auditable autonomy](https://discourse.numenta.org/t/paper-neural-circuit-policies-enabling-auditable-autonomy/7945)
**Author:** [@LuizCoutinho](https://discourse.numenta.org/u/LuizCoutinho)\ **Replies:** 2\ **Last updated:** [October 15, 2021, 12:18am UTC](https://discourse.numenta.org/t/paper-neural-circuit-policies-enabling-auditable-autonomy/7945 "2021-10-15T00:18:30Z")
Abstract A central goal of artificial intelligence in high-stakes decision-making applications is to design a single algorithm that simultaneously expresses generalizability by learning coherent representations of their… --- ## [Grid and Place Cells in the Neocortex. Citation?](https://discourse.numenta.org/t/grid-and-place-cells-in-the-neocortex-citation/8953)
**Author:** [@howard.goldowsky](https://discourse.numenta.org/u/howard.goldowsky)\ **Replies:** 15\ **Last updated:** [October 1, 2021, 10:50am UTC](https://discourse.numenta.org/t/grid-and-place-cells-in-the-neocortex-citation/8953 "2021-10-01T10:50:46Z")
During some recent podcasts, Jeff Hawkins has said a few times that there is now evidence that Grid and Place cells exist in the neocortex. Yet I can’t find any published references to this. Can someone please point me t… --- ## [Long short-term memory and learning-to-learn in networks of spiking neurons](https://discourse.numenta.org/t/long-short-term-memory-and-learning-to-learn-in-networks-of-spiking-neurons/8989)
**Author:** [@maxerbubba](https://discourse.numenta.org/u/maxerbubba)\ **Replies:** 0\ **Last updated:** [September 26, 2021, 4:54pm UTC](https://discourse.numenta.org/t/long-short-term-memory-and-learning-to-learn-in-networks-of-spiking-neurons/8989 "2021-09-26T16:54:45Z")
Since y’all are interested in sparsity, I came across this 2018 paper from Wolfgang Maass (I’ve been on a Maass kick recently). They reference “DEEP R” from a prior paper, which gives this spiking model a ~1% boost in ac… --- ## [Biologically constrained theorizing. Yes!](https://discourse.numenta.org/t/biologically-constrained-theorizing-yes/8787)
**Author:** [@Curious\_Mike](https://discourse.numenta.org/u/Curious_Mike)\ **Replies:** 1\ **Last updated:** [July 24, 2021, 7:03am UTC](https://discourse.numenta.org/t/biologically-constrained-theorizing-yes/8787 "2021-07-24T07:03:22Z")
Fantastic validation - I would say - of Numenta’s overall approach and perspective. https://www.nature.com/articles/s41583-021-00473-5 “We highlight recent advances in developing bio­logically grounded cognitive theori… --- ## [Teaching RNNs to infer global temporal structure from local examples](https://discourse.numenta.org/t/teaching-rnns-to-infer-global-temporal-structure-from-local-examples/8626)
**Author:** [@CollinsEM](https://discourse.numenta.org/u/CollinsEM)\ **Replies:** 0\ **Last updated:** [June 2, 2021, 10:00pm UTC](https://discourse.numenta.org/t/teaching-rnns-to-infer-global-temporal-structure-from-local-examples/8626 "2021-06-02T22:00:54Z")
Teaching recurrent neural networks to infer global temporal structure from local examples Abstract The ability to store and manipulate information is a hallmark of computational systems. Whereas computers are carefully e… --- ## [Paper referenced in A Thousand Brains: A New Theory of Intelligence](https://discourse.numenta.org/t/paper-referenced-in-a-thousand-brains-a-new-theory-of-intelligence/8502)
**Author:** [@markNZed](https://discourse.numenta.org/u/markNZed)\ **Replies:** 7\ **Last updated:** [June 1, 2021, 11:25pm UTC](https://discourse.numenta.org/t/paper-referenced-in-a-thousand-brains-a-new-theory-of-intelligence/8502 "2021-06-01T23:25:15Z")
Hi @jhawkins , in the HLC call a group of us are discussing A Thousand Brains: A New Theory of Intelligence The following section from the book mentions a published paper which describes how voting happens quickly and re… --- ## [A Theory of How Columns in the Neocortex Enable Learning the Structure of the World](https://discourse.numenta.org/t/a-theory-of-how-columns-in-the-neocortex-enable-learning-the-structure-of-the-world/2524)
**Author:** [@rhyolight](https://discourse.numenta.org/u/rhyolight)\ **Replies:** 122\ **Last updated:** [May 24, 2021, 10:51am UTC](https://discourse.numenta.org/t/a-theory-of-how-columns-in-the-neocortex-enable-learning-the-structure-of-the-world/2524 "2021-05-24T10:51:04Z")
Fresh off the press from bioarxiv… --- ## [Grid Cell Path Integration For Movement-Based Visual Object Recognition](https://discourse.numenta.org/t/grid-cell-path-integration-for-movement-based-visual-object-recognition/8456)
**Author:** [@Oblynx](https://discourse.numenta.org/u/Oblynx)\ **Replies:** 4\ **Last updated:** [April 26, 2021, 11:04pm UTC](https://discourse.numenta.org/t/grid-cell-path-integration-for-movement-based-visual-object-recognition/8456 "2021-04-26T23:04:15Z")
Hi there! I started reading the preprint of the latest Numenta paper on grid cells, and early on they mention an encoder for MNIST images (figure 2). The encoder is a CNN with a k-winners layer, whose activations are th… --- ## [Continuous online sequence learning with an unsupervised neural network model](https://discourse.numenta.org/t/continuous-online-sequence-learning-with-an-unsupervised-neural-network-model/573)
**Author:** [@rhyolight](https://discourse.numenta.org/u/rhyolight)\ **Replies:** 14\ **Last updated:** [April 17, 2021, 5:29pm UTC](https://discourse.numenta.org/t/continuous-online-sequence-learning-with-an-unsupervised-neural-network-model/573 "2021-04-17T17:29:59Z")
\[image\] By @ycui, @subutai, & @jhawkins Please discuss this paper below. --- ## [A Fast Spatial Pool Learning Algorithm of Hierarchical Temporal Memory Based on Minicolumn’s Self-Nomination](https://discourse.numenta.org/t/a-fast-spatial-pool-learning-algorithm-of-hierarchical-temporal-memory-based-on-minicolumn-s-self-nomination/8354)
**Author:** [@CollinsEM](https://discourse.numenta.org/u/CollinsEM)\ **Replies:** 2\ **Last updated:** [March 26, 2021, 2:24pm UTC](https://discourse.numenta.org/t/a-fast-spatial-pool-learning-algorithm-of-hierarchical-temporal-memory-based-on-minicolumn-s-self-nomination/8354 "2021-03-26T14:24:32Z")
Abstract As a new type of artificial neural network model, HTM has become the focus of current research and application. The sparse distributed representation is the basis of the HTM model, but the existing spatial poo… [Next page](https://discourse.numenta.org/c/science/papers/37.md?page=1)