# A Radically New Theory of how the Brain Represents and Computes with Probabilities

**URL:** https://discourse.numenta.org/t/a-radically-new-theory-of-how-the-brain-represents-and-computes-with-probabilities/4450
**Category:** Related Papers
**Tags:** papers
**Created:** [August 30, 2018, 10:14pm UTC](https://discourse.numenta.org/t/a-radically-new-theory-of-how-the-brain-represents-and-computes-with-probabilities/4450 "2018-08-30T22:14:30Z")
**Posts on this page:** 8
**Page:** 1

<div class="post-metadata">

### Author: ![nbro](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/nbro/32/2864_2.png) [@nbro](https://discourse.numenta.org/u/nbro)
#### Post date: [August 30, 2018, 10:14pm UTC](https://discourse.numenta.org/t/a-radically-new-theory-of-how-the-brain-represents-and-computes-with-probabilities/4450/1 "2018-08-30T22:14:30Z")

</div>

I found this paper [A Radically New Theory of how the Brain Represents and Computes with Probabilities](https://arxiv.org/abs/1701.07879) (by Rod Rinkus, Neurithmic Systems & Brandeis University). The terminology the author uses isn’t exactly the same used in the HTM community. However, from what I understood, this theory is similar to the HTM theory (e.g. the usage of the SDRs and the binary nature of neuron spikes).

Furthermore, in the “acknowledgement” section the author writes

> I’d like to thank the people who have encouraged me to pursue this theory over the years, including  
> Dan Bullock, **Jeff Hawkins** , John Lisman, Josh Alspector, Tom McKenna, Andrew Browning, and Dan  
> Hammerstrom.

For now, I do not plan to read this paper, and so I will not try to compare this theory to the HTM theory, but, if someone is interested, I think it would be useful and interesting task to do so, at least the salient differences or key points of the “Sparsey” network.

---

<div class="post-metadata">

### Author: ![acatovic](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/acatovic/32/4553_2.png) [@acatovic](https://discourse.numenta.org/u/acatovic)
#### Post date: [August 31, 2018, 5:34pm UTC](https://discourse.numenta.org/t/a-radically-new-theory-of-how-the-brain-represents-and-computes-with-probabilities/4450/2 "2018-08-31T17:34:21Z")

</div>

Thanks for sharing @nbro! I did some quick searching around - I can see papers related to his SDR based algorithm dating from mid 90s. The current model which as you say is called Sparsey, is referred to earlier as TEMECOR. There are definitely similarities to HTM - SDRs, Hebbian learning, some kind of columnar structure, etc.

You’re right, it would be interesting to understand what the differences are, and what the current status is. Even the MNIST results are very similar (91% accuracy, one-shot learning): [http://www.sparsey.com/MNIST\_Results.html](http://www.sparsey.com/MNIST_Results.html)

---

<div class="post-metadata">

### Author: ![rhyolight](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/rhyolight/32/3922_2.png) [@rhyolight](https://discourse.numenta.org/u/rhyolight)
#### Post date: [September 5, 2018, 9:51pm UTC](https://discourse.numenta.org/t/a-radically-new-theory-of-how-the-brain-represents-and-computes-with-probabilities/4450/3 "2018-09-05T21:51:14Z")

</div>

~~I believe Rod Rinkus worked for Jeff Hawkins at the Redwood Neuroscience Institute.~~

Correction: Rod did not work for Jeff, but they have known each other for a long time.

---

<div class="post-metadata">

### Author: ![Bitking](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/bitking/32/3099_2.png) [@Bitking](https://discourse.numenta.org/u/Bitking)
#### Post date: [September 5, 2018, 11:20pm UTC](https://discourse.numenta.org/t/a-radically-new-theory-of-how-the-brain-represents-and-computes-with-probabilities/4450/4 "2018-09-05T23:20:01Z")

</div>

I see much of what we are doing here in Rod Rinkus’s work.

He does have some very interesting insights; I do find the hex-grid arrangement of his computing components (MACs) to be particulary heart-warming.

These diagrams are mesmerizing:  
[http://www.sparsey.com/NotionalMappingSparseyToCortex.html](http://www.sparsey.com/NotionalMappingSparseyToCortex.html)

Note that this work is more in alignment with the “traditional” hierarchical arrangement of scene digestion. The H of the hierarchy is loud and proud in this work.

I could be wrong but I see that the current Numenta model diverges from this as the interpretation of what is coded; I see one as egocentric and one as allocentric. Does anyone else see this or am I missing the point?

---

<div class="post-metadata">

### Author: ![rod](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/rod/32/4857_2.png) [@rod](https://discourse.numenta.org/u/rod)
#### Post date: [January 16, 2020, 2:27pm UTC](https://discourse.numenta.org/t/a-radically-new-theory-of-how-the-brain-represents-and-computes-with-probabilities/4450/5 "2020-01-16T14:27:07Z")

</div>

Hi Mark, thanks for the props regarding my work and figures. I only just saw your post. Yes, lots of sims with Numenta, but also many diffs. I haven’t focused on egocentric vs. allocentric distinction yet, but broadly, I see allocentric as emerging progressively up through the cortical hierarchy. Allocentric  
coordinates are just a particular kind of invariance and they are created by the same principles that explain, e.g., tuning of complex vs. simple cell tuning fns in V1. So, progressively more allocentric reps will emerge at higher cortical levels, e.g., entorhinal/hippocampal.

---

<div class="post-metadata">

### Author: ![Bitking](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/bitking/32/3099_2.png) [@Bitking](https://discourse.numenta.org/u/Bitking)
#### Post date: [January 16, 2020, 2:44pm UTC](https://discourse.numenta.org/t/a-radically-new-theory-of-how-the-brain-represents-and-computes-with-probabilities/4450/6 "2020-01-16T14:44:38Z")

</div>

Welcome to the community!  
Do poke around and see what we are doing; all sorts of discussion on the the brain, AI, and how they fit together.  
I am curious about what you may think of my musings and where we overlap in thinking. Much of it is concentrated on this thread:

> [@Basic system level diagram of the brain](https://discourse.numenta.org/t/basic-system-level-diagram-of-the-brain/5834):
>
> HTM seeks to model and understand what is going on in your head. I tossed this drawing together from memory so it is sure to be missing some connections. I skipped the thalamic connections all together as this was already a very complicated drawing. Also not shown are the connections between the limbic system and the stream passing through the brain stem and the cerebellum. These are important but not necessary to illustrate the basic cortical/limbic data flows. The blue maps are cortex compose…

---

<div class="post-metadata">

### Author: ![rod](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/rod/32/4857_2.png) [@rod](https://discourse.numenta.org/u/rod)
#### Post date: [January 16, 2020, 3:15pm UTC](https://discourse.numenta.org/t/a-radically-new-theory-of-how-the-brain-represents-and-computes-with-probabilities/4450/7 "2020-01-16T15:15:48Z")

</div>

Thanks Mark, I’ll take a look.

-Rod

---

<div class="post-metadata">

### Author: ![Bitking](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/bitking/32/3099_2.png) [@Bitking](https://discourse.numenta.org/u/Bitking)
#### Post date: [January 16, 2020, 6:26pm UTC](https://discourse.numenta.org/t/a-radically-new-theory-of-how-the-brain-represents-and-computes-with-probabilities/4450/8 "2020-01-16T18:26:29Z")

</div>

> [@rod](#):
>
> So, progressively more allocentric reps will emerge at higher cortical levels, e.g., entorhinal/hippocampal.

I am not sure if I understand what you are saying. This is the way that I express the generation of the frame of reference “out there.”

> [@Question on Condensing Neural Processing](https://discourse.numenta.org/t/question-on-condensing-neural-processing/4379/15):
>
> I have what I am sure is a crazy idea how the transform from sensor-egocentric space to allocentric transforms works but I will share it here for public amusement: The senses are put into relative space by “decorating” the posture control system. Say what? We all possess an elaborate body sensing system that is hardwired to combine every joint and muscle from the ground all the way to the vestibular sensing / ocular pointing system. This has been trained and tuned every day of your life as a …
