Hello, I am new to HTM community. I think its awesome and I would like to build an implementation that is as close to the biological model as possible, from the ground up. I am still thinking about how to code individual aspects and what data structures and abstractions to use to carry out the algo…

Thank you @breznak I have posted a query about implementation aspect but it does make more sense to post this entire question on the forum. I’ll do it soon. I would like to ask you all for advice here the same. Any input is much appreciated.

[image] abshej: Are there any key points you would like to share which are specifically related to coding the implementation? Any hints to avoiding dead ends and memory hogs? Sure, here are a couple of things that come to mind: Encode SDRs as an array of indexes to the “1” bits (versus a …

Thanks @Paul_Lamb , will use some of those insights for re-work in the community nupic.cpp! I definitely want the 1/ Sparse arrays. As the author of HTM in another lang, did you use a variant of the “Connections” class? My Q is for using it in SP: Implement SpatialPooler with Connections backend

Thank you. Will certainly make use of those suggestions. I was aware of 1 since Jeff Hawkins mentioned that in one of his talks. 2 and 3 are certainly interesting. Will try those first.

I had similar idea as to the implementation of SP and TM. But I had arrived at the same conclusion by thinking backwards that every TM columnar layer is essentially an SP and only a single SP unit(minicolumn) will be selected from the TM column as active after selecting winning “cells”.

For some potential dead-ends, read through this thread if you haven’t already. I proposed some potential optimizations, and there was some very good discussion on what the side effects would be.

@abshej Why did you send this as a private message to everyone instead of just using the forum? If you don’t mind, I’m just going to make this a public forum post in #htm-hackers .

My bad, I had a different thought process behind doing so. I don’t mind at all. Please do so.

As far as getting started it may help to know the theory level behind the code first. The Numenta site has an excellent resource page. If you have not seen it look here: https://numenta.com/papers-videos-and-more/ I got a lot out of the BAMI living book there: Biological and Machine Int…

Thank you. I have read some parts of BaMI, HTM white paper and also some neuroscience research papers. Although, frankly, I didn’t finish reading any of them properly. I’ll go through them again. Thanks for the reference to the post. Will surely look into it.

Trying to implement HTM theory using Julia

Engineering

Topic		Replies	Views
Who is currently Building HTM Systems? Engineering question	20	4053	October 1, 2018
How to easily implement your HTM? Engineering	11	1351	March 29, 2019
Another HTM test implementation Engineering	18	1773	April 24, 2017
A flexable framework for HTM algorithms. (And another HTM implementation no one asked for) Implementations htm-implementations	27	2290	March 2, 2019
I've used the backpropagation algorithm to implement HTM Implementations htm-implementations	17	1728	January 23, 2019

Trying to implement HTM theory using Julia

Related topics