Paper review of Recurrent Sequence Memory

[Bitking]

@CollinsEM

I think the problem of sequence position can be addressed by simply allowing the network to move forward and backwards through the data. This would most likely require some form of grid cell like representation coupled to a motor output signal. In this scenario, the training set is not simply presented to the network in sequence over and over again, but is instead presented once and the network is allowed to study it as long as necessary

Good! Now you are treading the path laid out by biology.

The lizard brain gets a copy of what is presented to the visual cortex. I think it has a set of archetypes that are built-in and based on what it “sees” it directs the eyes to point at areas of interest.

See this post for some more thoughts about this relationship, in particular, the figure 1 in the linked paper. What is missing is the output connections to the frontal lobe that steer the eyes.to areas of interest:

Thoughts on multiple pathways for sensory input into the neocortex

It seems to be a thing for connectome/cortex researchers to ignore the processing that goes on in the “lower” brain structures. These were/are sufficient to run lizards and amphibians. There is absolutely no reason to think that they re not performing much of their original functions inside of the functioning brain. The lower brain receives a low-resolution image from the eye area “away” from the fovea and directs the eye to point at interesting areas to form identification of an object with a …