Input data must be ordered?

I am using the hotgym abnormally example. Looks like the input data must be ordered even though it has a timestamp. I tried to change the order of the data in the rec-center-hourly.csv and run it, it generated quite different results. So is there a way to use an unordered sequence as input (with timestamp)? Or I have to sort my input before feeding it into the engine?

1 Like

You have to sort the input by timestamp if you’re including a timestamp.

Thanks Matt! So basically the engine always assume the input data is for NOW no matter what timestamp it actually is?

You must realize that encoding the timestamp is sortof a hack. HTM has an innate sense of temporal flow. One input always comes after another input, and the order is always important. So it’s not really that is assumes each point is for NOW() in time, just that one comes after another.

Just think what it would be like if your sensory organs started sending their inputs out of order into your brain!

I see. But it would be great if the engine takes whatever it sees to generate results, and when the time it sees some earlier data points, it will insert back into the engine and refine the model.

That would only be possible if this ordering module was happening just outside the HTM system. A lot of streaming data frameworks do this, but it sacrifices timeliness for order. But an HTM system doesn’t work like this, and neither does your brain.