The other point I wonder about is the brain transfer conundrum:
I think the upload scenario is long overdue. Let me counter with another thought experiment:
Imagine we can build a single neuron in an enclosed silicium chip. It performs exactly the same functions at exactly the same speeds as its biological counterpart. It receives input voltages from thousands of inputs and produces an output signal just like the real neuron would. It creates/changes/destroys simulated synapses according to the same rules.
When we implant this electronic neuron instead of the real one, would that still be you? Or even more basic, would your brain operate differently?
If that one neuron represents one bit in a sparse memory, would the electronic version invalidate the SDR? Would the spacial pooler no long work?
Now do that with 1000 neurons. With 10% of your neurons. And with 100% of your neo-cortex. At which point would your brain stop working?
Now lets backtrack a bit. Instead of replacing your neurons, lets build a few million cortical columns’ worth of virtual neurons. And lets connect them through whatever layers with some of your (real) columns and with your thalamus.
Wouldn’t your brain start using this expanded virtual neo-cortex to store new models?