On the topic of how the “where” pathway learns locations, and how the “what” pathway makes itself invariant to small amounts of shifting/scaling/rotating, I made this video explaining my favorite hypothesis. This video explains some of the building blocks, but I think you’ll find that it does not explain enough to make a real & useful system.
2 Likes