# Does the HTM model have a solution to the binding problem?

**URL:** <https://discourse.numenta.org/t/does-the-htm-model-have-a-solution-to-the-binding-problem/4165>\
**Category:** Numenta Theory\
**Tags:** binding\
**Created:** [July 9, 2018, 8:58pm UTC](https://discourse.numenta.org/t/does-the-htm-model-have-a-solution-to-the-binding-problem/4165 "2018-07-09T20:58:26Z")\
**Posts on this page:** 7\
**Page:** 2

<div class="post-metadata">

**Author:** ![Bitking](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/bitking/32/3099_2.png) [@Bitking](https://discourse.numenta.org/u/Bitking)\
**Post date:** [July 11, 2018, 2:28pm UTC](https://discourse.numenta.org/t/does-the-htm-model-have-a-solution-to-the-binding-problem/4165/21 "2018-07-11T14:28:07Z")

</div>

Thank you for checking into this.  
Now I will have to find versions without paywalls.  
It still gives me some starting points to dig further.

---

<div class="post-metadata">

**Author:** ![keghn\_feem](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/keghn_feem/32/3743_2.png) [@keghn\_feem](https://discourse.numenta.org/u/keghn_feem)\
**Post date:** [July 11, 2018, 2:44pm UTC](https://discourse.numenta.org/t/does-the-htm-model-have-a-solution-to-the-binding-problem/4165/22 "2018-07-11T14:44:34Z")

</div>

For a nub. What is binding problem?

---

<div class="post-metadata">

**Author:** ![Bitking](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/bitking/32/3099_2.png) [@Bitking](https://discourse.numenta.org/u/Bitking)\
**Post date:** [July 11, 2018, 2:48pm UTC](https://discourse.numenta.org/t/does-the-htm-model-have-a-solution-to-the-binding-problem/4165/23 "2018-07-11T14:48:09Z")

</div>

> **[Binding problem](https://en.wikipedia.org/wiki/Binding_problem)**
>
> The binding problem is a term used at the interface between neuroscience, cognitive science and philosophy of mind that has multiple meanings.
> Firstly, there is the segregation problem: a practical computational problem of how brains segregate elements in complex patterns of sensory input so that they are allocated to discrete "objects". In other words, when looking at a blue square and a yellow circle, what neural mechanisms ensure that the square is perceived as blue and the circle as yellow, ...

> **[Neuroscience: Toward Unbinding the Binding Problem](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2857400/)**
>
> How the brain ‘binds’ information to create a coherent perceptual experience is an enduring question. Recent research in the psychophysics of perceptual binding and developments in fMRI analysis techniques are bringing us closer to an ...

> **[The neural binding problem(s)](https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3538094/)**
>
> The famous Neural Binding Problem (NBP) comprises at least four distinct problems with different computational and neural requirements. This review discusses the current state of work on General Coordination, Visual Feature-Binding, Variable Binding,...

---

<div class="post-metadata">

**Author:** ![rhyolight](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/rhyolight/32/3922_2.png) [@rhyolight](https://discourse.numenta.org/u/rhyolight)\
**Post date:** [July 11, 2018, 5:57pm UTC](https://discourse.numenta.org/t/does-the-htm-model-have-a-solution-to-the-binding-problem/4165/24 "2018-07-11T17:57:28Z")

</div>

> [@keghn\_feem](#):
>
> For a nub. What is binding problem?

The biggest problem with “the binding problem” is that it is hard to define. Definitions are more philosophical than scientific.

When I said that HTM was moving in the right direction, it is because I can see how objects can be learned in completely unique spaces while being composed of sub-objects, which I believe is related.

---

<div class="post-metadata">

**Author:** ![Bitking](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/bitking/32/3099_2.png) [@Bitking](https://discourse.numenta.org/u/Bitking)\
**Post date:** [July 11, 2018, 7:39pm UTC](https://discourse.numenta.org/t/does-the-htm-model-have-a-solution-to-the-binding-problem/4165/25 "2018-07-11T19:39:05Z")

</div>

As Matt says - there are multiple aspects to the binding problem.

Speaking simply - how do you combine what this cell over here is seeing or hearing or feeling with other cells to form a larger object and how does the object recognition in different sensory modalities combine to make a “beeping red round thing” and a “quiet green square thing” at two different places at the same time. Each has different shape, color, and sound and over the space of a second or two - may occupy the same space in the visual cortex in sequence.

In the real world you are surrounded with huge numbers of things as you move around and your eyes dart around at the same time. The cortex is bombarded with a flood is bits and pieces of an ever-changing kaleidoscope of sensation. Somehow you both segment these bits into individual objects and combine partial information into discreet objects. All at the same time.

“We” do know that the cells in the EC (entorhinal cortex) signals our location in the environment. It is suspected that we also signal the place of things in the environment in the EC. How does all this “multidimensional thing recognition” get combined and make it’s way to the EC to be signaled? How does the brain keep track of all these discreet objects at the same time without arrays, lists, or any of the usual tools we use in computer programming?

The only tool That I have worked out to date is the combination of columns into a hexagonal grid pattern to signal the extents of a recognized object. The advantage of this over nearest neighbor voting is that is extends the reach of column binding with a spacing of 8 or so columns apart and suppresses the surrounding cells so that you get a very sparse representation very quickly. This space covering hexagonal grid system has much the same conceptual advantage as “nodes of Ranvier” where the geometrical properties enhance the functional speed and span.

I have a fuzzy picture in my mind of the various modality projections into the association areas all overlaying each other, being sampled by the local SDRs in that area, and the hexagonal grid system combining the output from those SDRs sampling different modalities into extended objects.

I am slowly working to model this to see if it really is practical. This is a very large project and is taking a good long time to get the various parts up and running. Since I don’t have anything to show at this time I am continuing to see what other people have to avoid wasting time re-inventing the wheel.

---

<div class="post-metadata">

**Author:** ![keghn\_feem](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/keghn_feem/32/3743_2.png) [@keghn\_feem](https://discourse.numenta.org/u/keghn_feem)\
**Post date:** [July 11, 2018, 11:51pm UTC](https://discourse.numenta.org/t/does-the-htm-model-have-a-solution-to-the-binding-problem/4165/27 "2018-07-11T23:51:45Z")

</div>

my notes.  
The Binding Problem:

i see similarity at 3.09 minutes into this video.  
Semantic Folding::

Thinking out loud.

In both video, A encoder or the activation of a detect NN is routed to SDR bit.

There would be a detector NN for the circle, white field, blue field, and various straight  
lines. Each detector mapped to certain location.

Second video they would be a detector NN for the words, organ, Bach, and other  
words.

In machine learning data is regenerated form the activation of SDR bits, is done  
with a GAN, generative adversarial network. The GAN can generate a compressed  
representation used for memory, and or also do a motor movement.

The regenerated compressed data could be in the format of something like a  
descriptor table could be used.  
There would also be sub descriptor within the main descriptor for letters of world or sub feature in a face.

The mind can not see the SDR, it is in the dark, but it can see the regenerated data.

We can Factoring out variables form a equation in a algebra, features can be factored out from a descriptor table.

So now every thing is target From large object to all the way down to small sub  
features.  
What can be done with all these features?  
Add them or remove them to make a pattern come into existence?

Or use a link list algorithm. NN work great for a link list algorithm. But must use  
source data to make target data . They take input data and generate output data. And  
they must be auto trained. Just select source and target, done.  
I think there is a function in the brain that dose this.  
Like for example. I think of my car and out come a image or direction to my night stand by my bed were the key are. Or as in algebra i think of “x” and get out a six.

---

<div class="post-metadata">

**Author:** ![dmac](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/dmac/32/5842_2.png) [@dmac](https://discourse.numenta.org/u/dmac)\
**Post date:** [July 12, 2018, 12:00am UTC](https://discourse.numenta.org/t/does-the-htm-model-have-a-solution-to-the-binding-problem/4165/28 "2018-07-12T00:00:39Z")

</div>

@Bitking,

I have a hypothesis of how the binding problem is solved:

This hypothesis is based on the two papers:

- Hawkins, Ahmad, Cui, 2017, “Why Does the Neocortex Have Layers and Columns, A Theory of Learning the 3D Structure of the World”
- Emilio Kropff and Alessandro Treves, 2018, “The emergence of grid cells: intelligent design or just adaptation?”

The binding problem is solved by the output layer’s (L2/3) spatial pooler. It accomplishes this by accumulating excitatory input over a significant period of time. This slow response to changes in excitement has a stabilizing effect on the mini-columns. It allows a layer 2/3 mini-column to remain active over several sensation of the same object, and it favors mini-columns which do remain active for several consecutive sensation over sporadically active mini-columns. These effects are then learned, and the mini-column then represent a large contiguous area of the input. This solves the binding problem because an area at the top of a cortical hierarchy should receive sensory input from all of the sensors, and hypothetically be able to represent objects as they move between different sensory areas.

The paper [Kropff and Treves, 2008] is the source of the mechanism which slows down the mini-columns response. The response exponentially approaches the input overlap. The equation for it is:  
`r(t) = r(t-1) + alpha * (InputOverlap - r(t-1))`  
Where `t` is time,  
Where `InputOverlap` is the amount of excitatory input,  
Where `r(t)` is the response, it’s used in the competition to activate,  
Where `alpha` controls how fast mini-columns respond to changes in their input overlap.

I’m working on testing this hypothesis, I’ll tell you all when its a theory.

Dmac

[Previous page](https://discourse.numenta.org/t/does-the-htm-model-have-a-solution-to-the-binding-problem/4165.md?page=1)