HTM forgets the past and learns from the present


#1

In my arabic language we call human by "insan الإنسان " ( forgets) because the humane can’t remember everything,
can you imagine a human can not forget anything ?
it means that he will always remember all the sad memories (example: the death of his mother) he will live the rest of his life sad, because in some research, sad memories affect the human more than the happy moment.
but he will remember the sad memories but not like the first time, a long of time he will forget the sad memory and he will see a new memory happy and sad but of course the human must remember the basic elements like his name, write, read , … etc.
So my question is how HTM make forget HTM what he has learned in the past, to learn from other more important period of time, but at the same time, he does not forget completly what HTM has learned in the past (remember implicitly).
I will give an example: temperature anomaly detection, HTM must learn the temperature changes of the whole year, for example the temperature in the day is different from the night, the temperature in the whole month is not the same, the temperature between July and January It’s very different.
I want to ask if HTM can learn in a certain period, not only in the first period and take into account the changes of time.
I want anyone to tell me or explain to me in these cases what HTM can do or if HTM can forget a historical learning like the man does.


#2

I can’t address teh HTM forgetting question but I will offer this article that discusses human memory and forgetting over a long time scale.


#3

Thank you for your reply. So, in some cases, we need to make HTM forget some information to learn new things and get better results with the minimum amount of time.


#4

HTM and NuPIC already have ways of forgetting. In Hebbian learning, it is the decrement amount that is used to degrade synapses when patterns are not seen for a long time. There are others ways to do it, like removing old synapses as new ones are created, which I have talked about before when discussing keeping small model sizes.


#5

emmm yes that’s true but how can HTM learn from a sequences, I mean if HTM forget and degrade synapses with a long period of time so why HTM don’t learn from another sequence.
for example::
HTM learn the temperature of the month of May, and after a long period HTM learn the temperature of month of October and after another period HTM learn the temperature of january …ect
I don’t know if you understand what I mean
My problem is if the pattern is change over the time with specific context and HTM can’t learn all those changes ?
sorry for my bad English :roll_eyes::persevere:


#6

I don’t think I understand you. You seem to be talking about hierarchical temporal patterns, but HTM treats these just like long sequences.


#7

yes exactly, ok I’m agree with you but in some cases the sequence is very long and maybe it will influence and give bad results, so we don’t must learn all the sequence, just some of sub-sequences


#8

I see what you are saying. I think you need to run a temporal pooling processes to extract these sub patterns. Unfortunately, we’ve been investigating this concept through sensorimotor integration theory, not scalar stream prediction.


#9

this so bad, but I’m very grateful for your reading and for your answers. thanks matt :slight_smile: