Just another visualization, except this one deviates from the standard HTM model. I wanted to make this visualization to see how cells work together without column structure.
The field on the left are the ‘spatial’ cells that connect directly to the input cells that surround the field. The field on the right are the ‘temporal’ cells that connect to the spatial cells. The blue box surrounding the active cells are their neighbors. Cells can only interact with other cells within their neighborhood. The temporal cells have the same neighborhood as the spatial cells, just like as if they were layered. So temporal cells can only connect to spatial cells within their neighborhood.
Each spatial cell has a number of segments that represent a union of various input patterns. Due to Hebbian learning the spatial cells gradually become tuned to specific patterns, similar to SP but without the column structure.
Every cell functions locally and learns due to local activity. Every cell uses STDP. The only difference between the cells is who they connect to. The spatial cells connect to other spatial cells to form temporal memory. (However I’ve removed temporal memory for now just to watch temporal pooling on the right field). The spatial and temporal cells function the same but operate differently because spatial connects to input, and temporal connects to spatial.
The temporal cells gradually pool the spatial cells, and what I like is that the pooling is distributed because of local fields.