I am interested in performing some experiments with different parametric configuration of HTM java on NAB to find out what would be the possible impact on the NAB scores and what parameters of HTM java can give the best scores. For establishing experimental setup to get suitable parameters i want to use genetic algorithm and treating NAB as a fitness function. I have studied NAB and its scoring mechanism , Following are few questions that are in my mind regarding NAB and HTM java
1- I have seen NAB have 3 score (standard, Reward low FP, Reward low FN). According to my understanding standard scores are those which NAB gives algorithm on identifying TP and TN during anomaly window. FP score should be related to false alarms. But NAB gives this score on producing false alarm or not producing false alarms? Same question for FN it should be related to no alarm on anomaly But NAB gives this score to algorithm on finding anomaly or not finding? (these score are basically a credit or dis-credit to be high?)
2- HTM have lots of configurations and I assume all configurations have their own significance as mentioned in HTM manuals. But some configurations would be most critical and they have a strong impact on results. According to my understanding three parameters related to architecture (Input dimension, column dimension, cell per column) are most important. Please suggest me what could be other critical parameters should i consider in my experiments?
(I have performed few experiments on above mentioned three parameters and i got different results)
Please also guide my any other point regarding my understanding and experiment.
@cogmission can you please help me regarding above mentioned queries?
Also I have noticed that when i run on default configurations htm java gives me below scores.
But i have seen below scores in white paper of NAB.
Is this a normal difference of htm java or there is some particular issue in my system.
I am also attaching htm java default parameters. I have print it in a file.