Application of HTM in today’s ML frameworks


#41

Ah, I see there was a misunderstanding at the time. I’m sorry.
Was he saying SP makes sparse connections to the layer after?
I thought it was from the layer before(the input layer for the SP layer).
If not, I’m even more confused. :confused:
EDIT: Wouldn’t the connections turn out to be at least dense as the layer after anyway? I don’t think I get it.


#42

Please be patient. My job is to explain it all to you, but I have to understand it first. :slight_smile:


#43

The funny thing is that DL is actually moving toward a more “binary” activation networks, and it seems to start working lately. https://arxiv.org/abs/1812.11800v2 .