Whitepaper: Avoid extra connections

[dmac]

I’ve encountered this issue before, where the spatial pooler forms an excessive number of synapses. I found that Numenta’s solution could be inadequate for controlling the number of synapses. I then further analyzed the problem and proposed a alternative solution to it.

Synapse Competition

Competition is a common motif in biology & neuroscience. In this post I describe and analyse using a competition to control synapse formation. Written by David McDougall, 2019 Hebbian Learning and Thresholds Synapses in the cortex use Hebbian Learning. Neurons in the cortex use a constant activation threshold to discriminates between cells which recognize their inputs and cells which do not. Naive models of the cortex incorporated just these two features and observed that Hebbian learning has …