Has anyone used SDR to feed to NN.
I’m asking something along the lines of converting BoW or word-embedings or randomly-generated-SDR or word2vec passed trough Spatial pooler and then using them to train NN.
text => bow => SP =SDR=> NN => SDR-labels => text-label
It would have to perform better because the SP->SDP should be related i.e. the input to NN already have correlation.
As I’m on this : Is there a standalone implementation of Spatial Pooler ?
If I’m not mistaken, that’s pretty much what the SDRClassifier
does - taking a prediction (series of) SDR and running them
through a single-layer, feed-forward network with softmax
activation.