As we see, a normal decent size SDR has a astronomically large data representation capacity. And if brain use SDR, then why it uses 25 billion neurons for it? It’s like an “overkill” to me . I know, owr brain is not a designer clothe. But is the number some kind of evolutionary baggage that we don’t want really?
Every neuron has dendrites, and each dendrite can represent one or perhaps a few, SDRs.
Why so many?
To learn EVERYTHING you perceive; to build a predictive model all of the perceptions in your life to the point where you are surprised if a door feels light or heavy when you pull on the handle - that requires a vast memory store.
I always assumed that the human brain must have massive redundancy, patients can survive massively destructive damage to the brain by percentage and suffer only minor symptoms in some cases and even prosper after a hemispherectomy.
The brain is also a noisy place, having massive built in redundancy might help maintain a clean signal too.
I always wonder what the MVP “Minimum Viable Product” is for a human like brain? I guess in the coming decades we are going to find out.
Evolution doesn’t ask what is the most efficient, it asks what will survive.
…or whats good enough
You have to keep in mind that brains don’t just serve to provide consciousness, they also control all the biological systems that support and maintain physical existence - these things are less relevant in terms of building a brain that operates a mechanical body.
Another useful view on it is the Red Queen Hypothesis. The absolute capacity doesn’t matter if a little more additional capacity turned out to be statistically beneficial for the genes (in Dawkinsian sense) that provided for it. The capacity to keep everything at the same time in the head is infinitely complex, as it may require modeling other brains: social structures, interactions, grudges, affairs, cheats, conspiracies, and anything else, which could be beneficial for passing on genes: poetry, music, etc.
Coming back to the Red Queen: it’s sufficient that this delta caused some genes to survive, and the next generations had to start from there.
As brains are costly, they might have actually been decreasing in size recently.