Criticism of HTM theory

[Paul_Lamb]

I am certainly not an expert, but I can post some relevant information to a couple of these questions.

@michaelklachko

All of the inputs are binary vectors. Similarly for connections, if the ‘permanence’ value of a synapse is above a threshold, the connection is assigned a value of 1, otherwise 0. As actual system inputs and neural connections are definitely not binary, this makes it pretty hard to model in a biologically plausible neural network.

Jeff posted some relevant details related to this on another thread:

@jhawkins

First when Hebbian learning was first proposed no one believed that new synapses were forming. It is now known that up to 40% of the synapses on a pyramidal cell can change on a daily basis. Some synapses are permanent and others come and go. Second, individual synapses are stochastic, the amount of neurotransmitter released varies dramatically, sometimes none is released. This says to me that any theory of cortical function can’t rely on any accuracy of weight in the synapse. I once read a paper that studied Hebbian plasticity (sorry I don’t recall the author). One of the observations in the paper was that Hebbian learning seemed more to increase the “permanence” of the synapse than how much transmitter it released. Combining all these led to our model.

@michaelklachko

Another potential issue is their distinction of activation due to lateral or feedforward connections. They put a neuron in a ‘predictive state’ if it receives activity over a lateral connection, and an ‘active state’ if it receives activity over feedforward connections. I’m not sure what this translates to in an actual neural model. Maybe lateral connections modulate the STDP from feedforward connections. But it’s another thing that gets glossed over by not ‘getting bogged down in details’ and would need to be sorted out in a more biologically constrained model.

Wikipedia has an article about depolarization. The idea is that there is a large impact on the neuron, but it doesn’t actually fire. I am not a neuroscientist, though, so someone else may have a better explanation or resource than that.

–EDIT–
To pull out what I see as some of the more relevant details for understanding the concept of “predictive state”:

Once the stimuli have reached the cell body, the nerve must integrate the various stimuli before the nerve can respond. The stimuli that have traveled down the dendrites converge at the axon hillock, where they are summed to determine the neuronal response. If the sum of the stimuli reaches a certain voltage, known as the threshold potential, depolarization continues from the axon hillock down the axon.

This first point indicates that depolarization of the cell must reach some threshold level before it will transmit an action. Depolarization can happen without the neuron firing.

Next, from the linked article on Action Potential:

neurotransmitters then bind to receptors on the postsynaptic cell. This binding opens various types of ion channels. This opening has the further effect of changing the local permeability of the cell membrane and, thus, the membrane potential. If the binding increases the voltage (depolarizes the membrane), the synapse is excitatory. If, however, the binding decreases the voltage (hyperpolarizes the membrane), it is inhibitory.

I think understanding that hyperpolarization is inhibitory and depolarization is exitatory, and pairing that up with the idea that depolorization is not a boolean event, I think it is easy to understand a state in which a cell has been depolorized, but at a level which is below the threshold – in this state it is “primed” to fire. This is what is referred to as “predictive state”.