I created this topic on HTM.java forum and I was suggested by @cogmission to try this forum as well.
I am experimenting the prediction capabilities of HTM.java and I run into the following problem.
I am feeding three strings into HTM network in a particular order:
"Dark Side Of The Moon"
"Blowing In The Wind"
"The Piper Of The Gates Of Dawn"
After learning I got the following result:
Record Number: 985, input Value: Blowing In The Wind, anomaly Score: 0.0, predicted value: The Piper Of The Gates Of Dawn
Record Number: 986, input Value: The Piper Of The Gates Of Dawn, anomaly Score: 0.0, predicted value: The Piper Of The Gates Of Dawn
Record Number: 987, input Value: Dark Side Of The Moon, anomaly Score: 0.0, predicted value: The Piper Of The Gates Of Dawn
Record Number: 988, input Value: Blowing In The Wind, anomaly Score: 0.0, predicted value: The Piper Of The Gates Of Dawn
Record Number: 989, input Value: The Piper Of The Gates Of Dawn, anomaly Score: 0.0, predicted value: The Piper Of The Gates Of Dawn
Record Number: 990, input Value: Dark Side Of The Moon, anomaly Score: 1.0, predicted value: The Piper Of The Gates Of Dawn
Record Number: 991, input Value: Blowing In The Wind, anomaly Score: 0.0, predicted value: The Piper Of The Gates Of Dawn
Record Number: 992, input Value: The Piper Of The Gates Of Dawn, anomaly Score: 0.0, predicted value: The Piper Of The Gates Of Dawn
Record Number: 993, input Value: Dark Side Of The Moon, anomaly Score: 0.0, predicted value: The Piper Of The Gates Of Dawn
Record Number: 994, input Value: Blowing In The Wind, anomaly Score: 0.0, predicted value: The Piper Of The Gates Of Dawn
Record Number: 995, input Value: The Piper Of The Gates Of Dawn, anomaly Score: 0.0, predicted value: The Piper Of The Gates Of Dawn
Record Number: 996, input Value: Dark Side Of The Moon, anomaly Score: 0.0, predicted value: The Piper Of The Gates Of Dawn
Record Number: 997, input Value: Blowing In The Wind, anomaly Score: 0.0, predicted value: The Piper Of The Gates Of Dawn
Record Number: 998, input Value: The Piper Of The Gates Of Dawn, anomaly Score: 0.0, predicted value: The Piper Of The Gates Of Dawn
Record Number: 999, input Value: Dark Side Of The Moon, anomaly Score: 0.0, predicted value: The Piper Of The Gates Of Dawn
The anomaly score looks pretty good but the predicted value is the same.
I would expect to have a pretty accurate prediction after 900 cycles.
Here are the configuration parameters:
{
Spatial: {
learn:true
inputDimensions:[64]
potentialRadius:16
potentialPct:0.5
globalInhibition:false
inhibitionRadius:0
localAreaDensity:-1.0
numActiveColumnsPerInhArea:10.0
stimulusThreshold:0.0
synPermInactiveDec:0.01
synPermActiveInc:0.1
synPermConnected:0.1
synPermBelowStimulusInc:0.01
synPermTrimThreshold:0.5
minPctOverlapDutyCycles:0.001
minPctActiveDutyCycles:0.001
dutyCyclePeriod:1000
maxBoost:10.0
spVerbosity:0
}
Temporal: {
columnDimensions:[2048]
cellsPerColumn:32
activationThreshold:13
learningRadius:2048
minThreshold:10
maxNewSynapseCount:20
initialPermanence:0.21
connectedPermanence:0.5
permanenceIncrement:0.1
permanenceDecrement:0.1
tmVerbosity:0
}
Other: {
random:org.numenta.nupic.util.MersenneTwister@2ed2d9cb
seed:42
n:500
w:21
minVal:0.0
maxVal:1000.0
radius:21.0
resolution:1.0
periodic:false
clipInput:false
forced:false
fieldName:UNSET
fieldType:int
encoderType:ScalarEncoder
fieldEncodings:{alarm={clipInput=false, maxVal=0.0, fieldName=alarm, minVal=0.0, periodic=false, forced=false, w=21, radius=0.0, resolution=0.0, fieldType=string, n=500, encoderType=SDRCategoryEncoder}}
hasClassifiers:false
}
}
Any idea what is wrong with my setup?
Thank you for your time,
Pavel Guler