First of all, such a drawing is a brilliant way to discuss a problem!
But you don’t talk about intelligence in this video nearly at all, only about agent/environment.
What kind of intelligence is inside the agent, how the model of the world is built? It can be done in many different ways, and in some of them what you are talking there will be true (look at the DeepMind’s Atari results), but for some of them, including cortex-base intelligence it’s not.
You can learn an environment, for example by looking at it, then successfully navigate yourself in it using any other modality: touch, smell, hearing, etc. Perhaps it’s not so obvious because our vision is much better sensor then others to explore the environment, but if you do it with a rat, it’s absolutely clear.
2 Likes