We would not feed these labels into the HTM, no. They would be needed for benchmarking performance of the algorithm.
My point with this comment is that we’ve known for a long time that HTM does provide value to lots of real temporal data streams if you can get the data in the right format, in the right interval, with the right semantics. This has always been the secret black magic of HTM, much like parameter tuning (and hyperparameter tuning) is the black magic of Deep Learning.
I have no doubt that HTM would provide meaningful and valuable anomaly indications from the data streams available to self-driving cars, if the streams were set up optimally for a properly tuned HTM system.