Spatial pooler => SDR for NN?

Engineering Machine Learning
1

Has anyone used SDR to feed to NN.
I’m asking something along the lines of converting BoW or word-embedings or randomly-generated-SDR or word2vec passed trough Spatial pooler and then using them to train NN.

text => bow => SP =SDR=> NN => SDR-labels => text-label

It would have to perform better because the SP->SDP should be related i.e. the input to NN already have correlation.

As I’m on this : Is there a standalone implementation of Spatial Pooler ?

2 Likes
2

It sounds like a good idea! I’m in! Just to be clear, how are you planing to encode BoW into SDR?

In which language?
HTM.core have one in C++ and Python, Etaler have one in C++.

3

The MNIST example in htm.core uses SP outputs to train a softmax classifier which is basically a NN.

1 Like
4

If I’m not mistaken, that’s pretty much what the SDRClassifier
does - taking a prediction (series of) SDR and running them
through a single-layer, feed-forward network with softmax
activation.

-R

4 Likes
5

where can I find a description of the SP algorithm ?

1 Like
6

Here, have a look at BAMI (Biological and Machine Intelligence). Page 43

1 Like
7

thanks

1 Like