How to use DateEncoder for the data which has been generated persecond

[sawandas]

We have a data csv which has the timestamp field increased by 1 second. How to configure the DateEncoder for per second data?

Time Stamp format is 10/4/2014 0:04:01 (MM/DD/YYYY hh:mm:ss)

10/4/2014 0:04:01
10/4/2014 0:04:02
10/4/2014 0:04:03
10/4/2014 0:04:04

Please reply.

Sawan

[learner]

I don’t think you can use the DateEncoder for that purpose; the unit of the timeOfDay parameter is hours, and the argument type is int, so it looks like the smallest resolution possible is one hour.

You could get around it by pre-processing and converting your timestamp to seconds first, then encoding that with a RandomDistributedScalarEncoder.

[rhyolight]

Related:

Why can't I encode time in very small increments with DateEncoder?

This question came up on Github, but I thought I would answer here. The type of patterns that datetime encoding encodes are things like “time of day”, “day of week”, “is weekend”, “minute of hour”, etc. These are human concepts (for the most part), and we are projecting our human organization of time (hours, weeks, minutes) into SDRs. That is great for timing that works at a scale that humans can rationalize about. When you get into sub-second timing, this idea of encoding breaks down. There …