I have been messing with stacking multiple layers of Spatial Poolers together and see what happens. I originally thought this is a bad idea, but heck, stacked RBMs are a thing. Why not Stacked Spatial Pooler? The setup is simple. Train a stack of N SpatialPoolers with random values between 0~1. E…

[image] Bitking: Note the reach of a dendrite. This is where the SDR is formed. All of an SDR is formed on a single dendrite; very small in relation to the finished spatial pooler action. I’m curious, are you suggesting that the active columns as SDRs in HTM SP output are not biologically pla…

[image] Jose_Cueto: The kernels (they are many by the way) in CNN extracts features and they are learned in an unsupervised manner AFAIK, the kernels in CNN are learned by gradient descent. How is that unsupervised? Am I missing something?

[image] hsgo: AFAIK, the kernels in CNN are learned by gradient descent. How is that unsupervised? Am I missing something? You are correct. My statement was counterintuitive, sorry ESL I tend to sound naive when I use it. The main business of the CNN is to learn the “best” features by GD an…

[image] Jose_Cueto: I’m curious, are you suggesting that the active columns as SDRs in HTM SP output are not biologically plausible? Connecting to every node in the array is not biologically accurate. I have whined about this in the past but this is defended as being close enough that trainin…

Thanks so much for your explanations. Most of the time when I read them I feel like I’m shrinked and suddenly dragged in a dark room where voices can be heard. I can only listen and try to open my eyes as wide as I can so I can see what I’ve hopefully understood. I think the dark room is neurobiolog…

I have talking about this here for a long time. Check out: [image] Path based SDRs (Dendrite Trees) Numenta Theory In an earlier post, I mentioned that I have been trying to work out how to form the cortical.io retina using HTMs. This effort has led me to work through wha…

BTW: don’t get me wrong - there are all kinds of tools that stray from the biology that accentuate some useful properties to make useful tools. Deep learning springs to mind. My comment is just to point out that this is straying far enough from the biology that it may not be helping to model and u…

As far as the biology being hard to follow - please forgive my sketchy descriptions. I have been studying neurobiology since my teens in the late 1960’s. At this point I don’t remember any part of it being hard to follow. I assume that these details are common knowledge and that we are just quibblin…

[image] Bitking: BTW: don’t get me wrong - there are all kinds of tools that stray from the biology that accentuate some useful properties to make useful tools. Deep learning springs to mind. I know, no worries. However with my knowledge and experience in computing, I do not believe that Neu…

[image] Jose_Cueto: Why does it improve itself? Can you define “improve” at a node level? Without going through ridiculously long SGD chain, or, god forbid, evolution?

Experimenting with stacking Spatial Poolers

Engineering

Bitking August 8, 2019, 5:09am 50

I have talking about this here for a long time. Check out:

Topic		Replies	Views
The HTM Spatial Pooler: a neocortical algorithm for online sparse distributed coding Related Papers	49	4690	November 25, 2019
Basic Spatial Pooler Questions Numenta Theory spatial-pooling , question	25	5018	January 9, 2020
Network of SpatialPoolers Getting Started	15	1281	April 16, 2019
Stable-Enforced Pooling Tangential Theories hierarchy , spatial-pooling , grid , calvin , unsupervised-learnin	38	2315	June 18, 2018
HTM School Episode 7: Spatial Pooling Input Space & Connections YouTube spatial-pooling	33	3336	October 26, 2016

Experimenting with stacking Spatial Poolers

Related topics