Another fundamental question: what might be the number of elements per subsequence?
Initial thought: As we discussed here we kind of agreed that the number of elements in a sequence at any level of the hierarchy is arbitrary but shaped statistically by the noisy inputs. That seems reasonable enough for sensory input, but I can’t see this working for motor output. Unless, of course, the exploration motor outputs are noisy during learning (which we are going for anyway). Hopefully with noisy motor output combined with reinforcement feedback the representations will self-organize from smaller to larger parts (going up the hierarchy) over time because the motor outputs will only get small parts correct at any one moment. These small correct fragments will combine together naturally and the size of the sequences may settle into arbitrary but reasonable sizes.