Continuing the discussion from Time nuances in reception of inputs:
I’ve recently been pondering the existence of a type of temporal grid cell module (TGCM) that advances in time in a manner similar to how the SDRs of regular spatial grid cell modules (SGCM) shift in response to spatial (or conceptual) shifts in the current input.
The actual representation for a temporal GCM could be an SDR, similar to the spatial GCM; however, since they are advancing with time, they would be highly dynamic. In fact, they would probably manifest themselves as a set of repeating pulses at one or more characteristic frequencies - a specific time scale for each module (e.g. alpha, beta, theta?) similar to the specific length scales in spatial GCMs. These characteristic frequencies could shift slightly to accommodate small variances in the rate at which the temporal sequences arrive at the input. (This could address the timing problem that @jhawkins mentions occasionally.)
These temporal GCMs could also be subject to certain synchronizing events that anchor the representation. However, rather than responding to spatial patterns, a TGCM will synchronize whenever a familiar temporal sequence is recognized. Perhaps there are even time cells analogous to place cells. (This mechanism might be able to address the restart problem with the current temporal memory implementation. @Paul_Lamb.)
I would be interested in hearing your thoughts on this proposal. I’m also open to collaborating on an implementation of this concept to explore its potential further.