Hi,
have there been any attempts to build (serious, not toy-scale) language models using HTM? It would seem like a sparse, hierarchical alternative to the (IMO slightly overhyped) transformer architecture would make for an impressive demonstration of HTM’s capabilities. (And before you mention cortical.io: I’m not interested in summarization or sentiment analysis; I’m interested in a cheaper GPT-3.)
But I’ve not yet found any code to that end. I considered writing my own, but I got hopelessly confused by all the different GitHub repos (nupic.torch, nupic.research, htm-community, …). Before I waste my time, could anyone tell me where I should start? Thank you!