Trying to understand how to advance HTM

[Paul_Lamb]

I think there are a couple of reasons HTM isn’t currently suited for vision tasks.

One problem is that hierarchy is not yet a part of HTM. The algorithms which are good at vision tend to utilize multi-layer hierarchies.

The second is that vision is really a sensory motor task if I understand it properly. The eyes move over the image to explore it. A coordinate system and scale need to be established from these movements (and through voting between neighboring sensory surfaces).

This quote from Jeff was helpful to me for understanding the idea:

@jhawkins

if you look at an object through a straw you might have to move the straw multiple times before recognizing the object, but with a full retina you can recognize it in one glance. Or, if you touch an unknown object with one finger (no vision) you probably can’t tell what the object is without multiple touches, but if you grab the object with multiple fingers you can often tell what it is in one touch.