# Latest

**URL:** https://discourse.numenta.org/latest.md?no_subcategories=false&page=1

[Latest](https://discourse.numenta.org/latest.md) · [Categories](https://discourse.numenta.org/categories.md) · [Tags](https://discourse.numenta.org/tags.md)

**Page:** 2

---

## [Richer than ReLU](https://discourse.numenta.org/t/richer-than-relu/12364)

<div class="topic-metadata">

**Author:** [@SeanOConnor](https://discourse.numenta.org/u/SeanOConnor)\
**Replies:** 1\
**Last updated:** [May 9, 2026, 10:08pm UTC](https://discourse.numenta.org/t/richer-than-relu/12364 "2026-05-09T22:08:57Z")

</div>

ReLU is great and all that but you are just zeroing channels based on decisions (x\>0?) You could created interactions between the decisions and use those for weight matrix interaction. https://archive.org/details/hd-dh…

---

## [Column selection in ReLU neural networks induces associative memory](https://discourse.numenta.org/t/column-selection-in-relu-neural-networks-induces-associative-memory/12360)

<div class="topic-metadata">

**Author:** [@SeanOConnor](https://discourse.numenta.org/u/SeanOConnor)\
**Replies:** 6\
**Last updated:** [April 27, 2026, 7:28am UTC](https://discourse.numenta.org/t/column-selection-in-relu-neural-networks-induces-associative-memory/12360 "2026-04-27T07:28:25Z")

</div>

I seem to be on some kind of documentation spree. https://archive.org/details/column-selection-in-re-lu-networks-as-hashing These could be helpful: https://archive.org/details/associative-memory-as-a-hashed-linear-rea…

---

## [Data dependent operator selection layers](https://discourse.numenta.org/t/data-dependent-operator-selection-layers/12359)

<div class="topic-metadata">

**Author:** [@SeanOConnor](https://discourse.numenta.org/u/SeanOConnor)\
**Replies:** 0\
**Last updated:** [April 22, 2026, 9:55pm UTC](https://discourse.numenta.org/t/data-dependent-operator-selection-layers/12359 "2026-04-22T21:55:50Z")

</div>

I mentioned a while ago the notion of a very basic neural network being the product of data dependent matrix choices. Eg. A₄B₃B₂A₁x for data dependent choices of A or B. I kinda extended the idea here. https://archive.…

---

## [Two Pathway ReLU neural networks](https://discourse.numenta.org/t/two-pathway-relu-neural-networks/12358)

<div class="topic-metadata">

**Author:** [@SeanOConnor](https://discourse.numenta.org/u/SeanOConnor)\
**Replies:** 0\
**Last updated:** [April 20, 2026, 1:14pm UTC](https://discourse.numenta.org/t/two-pathway-relu-neural-networks/12358 "2026-04-20T13:14:00Z")

</div>

I created this document. https://archive.org/details/2-pathway-re-lu-big-picture It is says a number of things. An ordinary ReLU neural network breaks down the input space into a number of piece-wise linear regions. H…

---

## [WHD Mixing With Two Path ReLU](https://discourse.numenta.org/t/whd-mixing-with-two-path-relu/12356)

<div class="topic-metadata">

**Author:** [@SeanOConnor](https://discourse.numenta.org/u/SeanOConnor)\
**Replies:** 0\
**Last updated:** [April 19, 2026, 1:32am UTC](https://discourse.numenta.org/t/whd-mixing-with-two-path-relu/12356 "2026-04-19T01:32:28Z")

</div>

One reason the fast Walsh Hadamard transform may be useful in neural networks is more efficient (less correlated) parameter usage. Looked at here from the 2 path ReLU perspective: https://archive.org/details/technical-n…

---

## [Decision Matrices, Rank, And Information Flow In Neural Networks](https://discourse.numenta.org/t/decision-matrices-rank-and-information-flow-in-neural-networks/12355)

<div class="topic-metadata">

**Author:** [@SeanOConnor](https://discourse.numenta.org/u/SeanOConnor)\
**Replies:** 0\
**Last updated:** [April 17, 2026, 12:31pm UTC](https://discourse.numenta.org/t/decision-matrices-rank-and-information-flow-in-neural-networks/12355 "2026-04-17T12:31:05Z")

</div>

Decision Matrices, Rank, And Information Flow In Neural Networks: https://archive.org/details/decision-matrices-rank-and-information-flow-in-neural-networks You can click on uploaded by for related documents.

---

## [Fast Walsh Hadamard transform for global mixing in neural networks](https://discourse.numenta.org/t/fast-walsh-hadamard-transform-for-global-mixing-in-neural-networks/12352)

<div class="topic-metadata">

**Author:** [@SeanOConnor](https://discourse.numenta.org/u/SeanOConnor)\
**Replies:** 1\
**Last updated:** [April 11, 2026, 4:25am UTC](https://discourse.numenta.org/t/fast-walsh-hadamard-transform-for-global-mixing-in-neural-networks/12352 "2026-04-11T04:25:05Z")

</div>

I suppose this is getting exhausting https://archive.org/details/fast-walsh-hadamard-transform-in-neural-networks-clean-view The idea is you can make local computations in a neural network layer global with a fast tran…

---

## [Gated Linear Associative Memory](https://discourse.numenta.org/t/gated-linear-associative-memory/12300)

<div class="topic-metadata">

**Author:** [@SeanOConnor](https://discourse.numenta.org/u/SeanOConnor)\
**Replies:** 18\
**Last updated:** [April 9, 2026, 10:54pm UTC](https://discourse.numenta.org/t/gated-linear-associative-memory/12300 "2026-04-09T22:54:21Z")

</div>

I wrote this about a weight matrix being simple linear associative memory and then ReLU functions acting as gates resulting in context based sub-selection of weights in the weight matrix. So then you are really getting …

---

## [HTM Interactive Explainer](https://discourse.numenta.org/t/htm-interactive-explainer/12350)

<div class="topic-metadata">

**Author:** [@Chris\_Misztur](https://discourse.numenta.org/u/Chris_Misztur)\
**Replies:** 7\
**Last updated:** [April 9, 2026, 9:16am UTC](https://discourse.numenta.org/t/htm-interactive-explainer/12350 "2026-04-09T09:16:09Z")

</div>

Here is an interactive resource that helped me wrap my head around the various stages and components of HTM.

---

## [Proposed theory of consciousness](https://discourse.numenta.org/t/proposed-theory-of-consciousness/12297)

<div class="topic-metadata">

**Author:** [@Aidan\_Busby](https://discourse.numenta.org/u/Aidan_Busby)\
**Replies:** 4\
**Last updated:** [March 18, 2026, 8:07pm UTC](https://discourse.numenta.org/t/proposed-theory-of-consciousness/12297 "2026-03-18T20:07:16Z")

</div>

Hello all- I have recently been developing a relational-ontology based framework of consciousness. I would appreciate any feedback/constructive criticism (or destructive, I suppose, if anyone has serious objections) of …

---

## [The Geometry inside a neural network - artificial or biological](https://discourse.numenta.org/t/the-geometry-inside-a-neural-network-artificial-or-biological/12267)

<div class="topic-metadata">

**Author:** [@SeanOConnor](https://discourse.numenta.org/u/SeanOConnor)\
**Replies:** 4\
**Last updated:** [March 13, 2026, 10:10am UTC](https://discourse.numenta.org/t/the-geometry-inside-a-neural-network-artificial-or-biological/12267 "2026-03-13T10:10:55Z")

</div>

There have been a number of papers about the emergence of geometric form inside neural networks over the past few years: Here is one of the later ones: Reddit - The heart of the internet

---

## [Tiny Recursion Models](https://discourse.numenta.org/t/tiny-recursion-models/12289)

<div class="topic-metadata">

**Author:** [@MTIzNDU2Nzg5](https://discourse.numenta.org/u/MTIzNDU2Nzg5)\
**Replies:** 0\
**Last updated:** [February 13, 2026, 5:27am UTC](https://discourse.numenta.org/t/tiny-recursion-models/12289 "2026-02-13T05:27:29Z")

</div>

---

## [Fused layer neural network](https://discourse.numenta.org/t/fused-layer-neural-network/12202)

<div class="topic-metadata">

**Author:** [@SeanOConnor](https://discourse.numenta.org/u/SeanOConnor)\
**Replies:** 3\
**Last updated:** [February 10, 2026, 1:36pm UTC](https://discourse.numenta.org/t/fused-layer-neural-network/12202 "2026-02-10T13:36:10Z")

</div>

SWNet16 neural network: https://archive.org/details/sw-net-16-b Fuses multiple width 16 CReLU layers into one larger layer using the one-to-all connectivity of a fast transform. Then stacks those layers into a neural n…

---

## [Complementary Learning Systems theory and HTM as a theory of the hippocampus](https://discourse.numenta.org/t/complementary-learning-systems-theory-and-htm-as-a-theory-of-the-hippocampus/2636)

<div class="topic-metadata">

**Author:** [@jakebruce](https://discourse.numenta.org/u/jakebruce)\
**Replies:** 12\
**Last updated:** [February 6, 2026, 1:38pm UTC](https://discourse.numenta.org/t/complementary-learning-systems-theory-and-htm-as-a-theory-of-the-hippocampus/2636 "2026-02-06T13:38:54Z")

</div>

HTM is intended to be a theory of the neocortex. But in some ways the algorithm seems to apply more appropriately to the hippocampus. In particular, both HTM and the hippocampus learn from experience online, and very qui…

---

## [Qualia Disqualified](https://discourse.numenta.org/t/qualia-disqualified/8723)

<div class="topic-metadata">

**Author:** [@EEProf](https://discourse.numenta.org/u/EEProf)\
**Replies:** 52\
**Last updated:** [February 2, 2026, 7:26pm UTC](https://discourse.numenta.org/t/qualia-disqualified/8723 "2026-02-02T19:26:00Z")

</div>

Here you go, chew on this: It’s not hard to see how philosophers have tied themselves into such knots over qualia. They started where anyone with any sense would start: with their strongest and clearest intuitions about…

---

## [SDR Transformer](https://discourse.numenta.org/t/sdr-transformer/12250)

<div class="topic-metadata">

**Author:** [@aamir121a](https://discourse.numenta.org/u/aamir121a)\
**Replies:** 6\
**Last updated:** [January 31, 2026, 1:04pm UTC](https://discourse.numenta.org/t/sdr-transformer/12250 "2026-01-31T13:04:19Z")

</div>

My POC on replacing the dense embedding layer with SDR . Works by being trained in math and logic. Transform Qwen Transformer to SDR Qwen transformer

---

## [Using HTM for logical deduction/induction and prediction of sentences](https://discourse.numenta.org/t/using-htm-for-logical-deduction-induction-and-prediction-of-sentences/12195)

<div class="topic-metadata">

**Author:** [@Aidan\_Busby](https://discourse.numenta.org/u/Aidan_Busby)\
**Replies:** 8\
**Last updated:** [January 27, 2026, 2:35pm UTC](https://discourse.numenta.org/t/using-htm-for-logical-deduction-induction-and-prediction-of-sentences/12195 "2026-01-27T14:35:14Z")

</div>

Hello all, I have recently been experimenting with the HTM.core code to train an HTM network to learn the logic behind a corpus of sentences. Currently, they look like this: “If A is in X, where is A?” Here is my trai…

---

## [Machines That Invent Logic: Self-Discovering Symbolic Abstractions from Unlabeled Primitives](https://discourse.numenta.org/t/machines-that-invent-logic-self-discovering-symbolic-abstractions-from-unlabeled-primitives/12239)

<div class="topic-metadata">

**Author:** [@Davis\_Sai](https://discourse.numenta.org/u/Davis_Sai)\
**Replies:** 0\
**Last updated:** [January 26, 2026, 5:11pm UTC](https://discourse.numenta.org/t/machines-that-invent-logic-self-discovering-symbolic-abstractions-from-unlabeled-primitives/12239 "2026-01-26T17:11:42Z")

</div>

title:Machines That Invent Logic: Self-Discovering Symbolic Abstractions from Unlabeled Primitives author: Tofara Moyo abstract Wepresent a self-discovering abstraction engine that invents its own symbolic language fr…

---

## [A Self-Discovering Abstraction Engine via Variational Symmetry, Typed Program Induction, and Neural-Symbolic Compilation](https://discourse.numenta.org/t/a-self-discovering-abstraction-engine-via-variational-symmetry-typed-program-induction-and-neural-symbolic-compilation/12206)

<div class="topic-metadata">

**Author:** [@Davis\_Sai](https://discourse.numenta.org/u/Davis_Sai)\
**Replies:** 0\
**Last updated:** [January 25, 2026, 4:03am UTC](https://discourse.numenta.org/t/a-self-discovering-abstraction-engine-via-variational-symmetry-typed-program-induction-and-neural-symbolic-compilation/12206 "2026-01-25T04:03:01Z")

</div>

A Self-Discovering Abstraction Engine via Variational Symmetry, Typed Program Induction, and Neural-Symbolic Compilation author : Tofara Moyo abstract We present a general-purpose abstraction engine capable of discover…

---

## [Shared brain structure among different intelligent species](https://discourse.numenta.org/t/shared-brain-structure-among-different-intelligent-species/12201)

<div class="topic-metadata">

**Author:** [@sean](https://discourse.numenta.org/u/sean)\
**Replies:** 3\
**Last updated:** [January 22, 2026, 4:53pm UTC](https://discourse.numenta.org/t/shared-brain-structure-among-different-intelligent-species/12201 "2026-01-22T16:53:42Z")

</div>

I just finished reading “A Thousand Brains” by Jeff Hawkins - great book (here is my review)! He identifies cortical columns in the human neocortex as the key part of intelligence, which implement reference frames (to fo…

---

## [SDR classification](https://discourse.numenta.org/t/sdr-classification/12177)

<div class="topic-metadata">

**Author:** [@spitfire](https://discourse.numenta.org/u/spitfire)\
**Replies:** 27\
**Last updated:** [January 11, 2026, 1:49am UTC](https://discourse.numenta.org/t/sdr-classification/12177 "2026-01-11T01:49:50Z")

</div>

Hi, I’m trying to building a swipe keyboard recognizer. My data has Time, X, Y stroke recordings. So I can either give a timeseries, or a 2d image between each word. I also have a labeled dictionary to go with stroke …

---

## [Open-source text SDR encoder?](https://discourse.numenta.org/t/open-source-text-sdr-encoder/12127)

<div class="topic-metadata">

**Author:** [@sean](https://discourse.numenta.org/u/sean)\
**Replies:** 10\
**Last updated:** [December 22, 2025, 1:30pm UTC](https://discourse.numenta.org/t/open-source-text-sdr-encoder/12127 "2025-12-22T13:30:50Z")

</div>

Anyone knows of an open-source SDR encoder for text (ideally multilingual)? I am cooking sth. up myself using bag of words and self-organizing maps but would like to see existing methods

---

## [🚀 Meet Monty 2026: Online Meetup Invitation Dec 17th @ 9AM PST](https://discourse.numenta.org/t/meet-monty-2026-online-meetup-invitation-dec-17th-9am-pst/12174)

<div class="topic-metadata">

**Author:** [@codeallthethingz](https://discourse.numenta.org/u/codeallthethingz)\
**Replies:** 4\
**Last updated:** [December 19, 2025, 11:59pm UTC](https://discourse.numenta.org/t/meet-monty-2026-online-meetup-invitation-dec-17th-9am-pst/12174 "2025-12-19T23:59:31Z")

</div>

Hi HTM Community :waving\_hand: I’m Will, the community manager over at the Thousand Brains Project. We’d like to invite you all to a meetup next week (which will be recorded and posted on YouTube if you can’t make it) w…

---

## [The End of the Transistor? The Chip That Thinks Like a Brain](https://discourse.numenta.org/t/the-end-of-the-transistor-the-chip-that-thinks-like-a-brain/12141)

<div class="topic-metadata">

**Author:** [@Peter2](https://discourse.numenta.org/u/Peter2)\
**Replies:** 1\
**Last updated:** [December 9, 2025, 9:26am UTC](https://discourse.numenta.org/t/the-end-of-the-transistor-the-chip-that-thinks-like-a-brain/12141 "2025-12-09T09:26:07Z")

</div>

---

## [Interactive Visualization of Discrete Cortical Circuits (DCC)](https://discourse.numenta.org/t/interactive-visualization-of-discrete-cortical-circuits-dcc/12136)

<div class="topic-metadata">

**Author:** [@jacobeverist](https://discourse.numenta.org/u/jacobeverist)\
**Replies:** 0\
**Last updated:** [December 4, 2025, 7:42pm UTC](https://discourse.numenta.org/t/interactive-visualization-of-discrete-cortical-circuits-dcc/12136 "2025-12-04T19:42:30Z")

</div>

Hello all! I just wanted to share a project I’ve been working on for some time. I cross-posted this over at the TBT forum since I’m not sure where the conversation is these days. Just a bit about me. I was introduced…

---

## [HTM for fall detection](https://discourse.numenta.org/t/htm-for-fall-detection/10803)

<div class="topic-metadata">

**Author:** [@Tresor](https://discourse.numenta.org/u/Tresor)\
**Replies:** 5\
**Last updated:** [December 4, 2025, 1:56pm UTC](https://discourse.numenta.org/t/htm-for-fall-detection/10803 "2025-12-04T13:56:12Z")

</div>

Hello, I have an idea of using HTM for FALL DETECTION I am facing issue of installing HTM dependencies such as NUPIC. The HTM does not support python3 its only using Python 2 and it s seems to be difficult of installin…

---

## [A conceptual proposal similar to Reference Frames: The Abstractive Thinking Model (ATM)](https://discourse.numenta.org/t/a-conceptual-proposal-similar-to-reference-frames-the-abstractive-thinking-model-atm/12125)

<div class="topic-metadata">

**Author:** [@Jonathan\_Monclare](https://discourse.numenta.org/u/Jonathan_Monclare)\
**Replies:** 3\
**Last updated:** [November 27, 2025, 11:38am UTC](https://discourse.numenta.org/t/a-conceptual-proposal-similar-to-reference-frames-the-abstractive-thinking-model-atm/12125 "2025-11-27T11:38:22Z")

</div>

Hi everyone, my name is Jonathan Monclare. I am an AI enthusiast coming from a non-traditional background. Since I lack professional technical skills and engineering knowledge, I attempted to approach this from a diffe…

---

## [Tried feeding Grok the forum with a question](https://discourse.numenta.org/t/tried-feeding-grok-the-forum-with-a-question/12113)

<div class="topic-metadata">

**Author:** [@BrainVx](https://discourse.numenta.org/u/BrainVx)\
**Replies:** 2\
**Last updated:** [November 20, 2025, 12:00am UTC](https://discourse.numenta.org/t/tried-feeding-grok-the-forum-with-a-question/12113 "2025-11-20T00:00:33Z")

</div>

Thought this might be of interest and stoke some ideas. Having used Grok for a number of different areas (legal, code, physics, conceptual, etc.) I thought I would see what Grok made of the site and the posts in relatio…

---

## [Free ML, Web Development, Data, Computer Science Books for All](https://discourse.numenta.org/t/free-ml-web-development-data-computer-science-books-for-all/8694)

<div class="topic-metadata">

**Author:** [@Bitking](https://discourse.numenta.org/u/Bitking)\
**Replies:** 4\
**Last updated:** [October 14, 2025, 12:28pm UTC](https://discourse.numenta.org/t/free-ml-web-development-data-computer-science-books-for-all/8694 "2025-10-14T12:28:43Z")

</div>

Because education should be free…( download today!!) Who does not like great free books?

---

## [Does predictive coding have a future?](https://discourse.numenta.org/t/does-predictive-coding-have-a-future/4364)

<div class="topic-metadata">

**Author:** [@Bitking](https://discourse.numenta.org/u/Bitking)\
**Replies:** 2\
**Last updated:** [September 29, 2025, 2:47pm UTC](https://discourse.numenta.org/t/does-predictive-coding-have-a-future/4364 "2025-09-29T14:47:08Z")

</div>

Clearly - in this forum, we take the answer in the affirmative! I think this Paper speaks directly to the theoretical underpinnings of HTM theory. Fristen talks of the difference between predictions and perceptions (I …

[Previous page](https://discourse.numenta.org/latest.md?no_subcategories=false)

[Next page](https://discourse.numenta.org/latest.md?no_subcategories=false&page=2)