No influence of learning based on the permanence of proximal connections

[jakebruce]

I’ve had some success by training autoencoders to represent arbitrary data (of arbitrary density) as sparse vectors, and then feeding that in as input to HTM, which may be an option for you. I described the approach here:

Proof of concept: Trainable universal encoder architecture

Howdy everyone. I’ve been thinking about the process of encoding arbitrary high-dimensional data for input to networks such as HTM. For low-dimensional data such as scalars, the traditional hand-crafted encoders probably work pretty well. However, high-dimensional data such as images contain a lot of redundant structure, so encoding them as a concatenation of scalar quantities may be wasteful of computation and memory. I’ve produced a proof-of-concept encoder architecture that uses the methodol…