I’m really intrigued by the HTM theory and I’m thinking of implementing a version of the algorithm on Apache Spark. I’m aware of the Apache Flink and Akka implementations but I would like to get my hands dirty and implement a Spark version.
However, I was wondering if there are any known limitations that have prevented others from implementing HTM on Spark.
What I mean by limitations is, if the Spark framework is unable to run HTM at scale, if it’s micro batch (streaming) isn’t suitable at all for HTM etc.
From my point of view I cannot see something that will prevent me from running HTM on spark, even scaling up the algorithm. I might be wrong though…
It’s weird that I couldn’t find any implementations on Spark, just some old mailing list threads…