I’ve been working hard to grok HTM theory. If I’m understanding correctly, the mechanism behind “attention” would best be explained by SDRs inhibiting more parts of the brain as they are recruited to model something intensely (the net effect pushing other conscious thoughts out of awareness). Does this sound right (or at least indicate that I’m starting to think out HTM theory correctly)?
1 Like
I tend to think of attention as a behavior designed to reduce uncertainty and/or surprise. That is to say that our attention is directed towards thoughts and/or obtaining sensory inputs that allow us to gather additional data to resolve existing uncertainties or learn new novel sequences.
HTM excels at generating predictive states that are consistent with previously observed patterns. When a novel pattern is observed and columns burst in response to being activated without having been in a predictive state, then the thalamus is gated to flood the cortex with additional signals and information to assist with learning a new sequence.
While these ‘surprise’ events will certainly grab the attention, and focus the agent on learning the new sequence, novelty is not the same as uncertainty. Uncertainty can exist if the system is making multiple predictions that are all plausible given the current context. In that case, attention could be used to generate behaviors that would allow the agent to acquire additional information (input from senses or recall of stored memories) that might reduce the number of simultaneous predictions.
4 Likes
While performing this behavior, many columns are recruited to model observed patterns right? As more parts of the brain are employed, doesn’t this have a inhibitory effect… essentially filtering other unrelated patterns from participating in conscious thought?
I’m imagining the enforced sparcity leaving no room for conscious thought other than what you are actively modeling (Attention).
You might find Graziano’s work on Attention Schema Theory (AST) provocative.
2 Likes
Personally, I found AST quite ground breaking - and a good step away from the Theory of Consciousness to real application. AST predicts things you can test - and he has.
(As an aside, I also enjoyed his starting point from the applied world of proprioception, which itself highlights many non-conscious aspects of how bodies really work, and predicting what happens when it fails).
This is along the lines of how I’m thinking the process works :
Goal investigation → Unrecognised pattern (sub cortical instigator)
Unrecognised pattern → Surprise (SDR mini column inhibition / winner takes all)
Surprise → Attention (thalamic focus / wider column inhibition)
Attention → Working memory (PFC mini column identification)
Working memory → Thought (PFC/other/no idea)
Thought → Goal investigation
All surprise ends up in working memory, just depends on how quickly it fades out… we can’t avoid or block this process.
Surprise is only created in the SDR process once (within 200mS theta wave cycle - borrowing from Max’s hypothesis - then it is no longer a surprise and is then a known pattern) so this surprise is then held in working memory… to fade out or not…
1 Like
Attention is insufficiency of adequate inputs to the brain. Which leads to incomplete or partial thoughts formation that will eventually fades away. If you want to increase attention try to increase the inputs or stop the chaos and gets fresh input…eg. When you are out of focus in your classroom, stop your breath untill you feel the pain in the chest this cause your existing thoughts to disappear, now you have cleared your thoughts, watch the class immediately don’t take any other inputs. I don’t know there may be another way to clean our thoughts but physical pain has more potential clean our thoughts than any other things.
1 Like
I think you are lumping top-down and bottom-up inputs together but when we talk about attention, we usually mean the phenomenon of bottom up inputs content being gated/modulated by top-down expectation.
1 Like
Do you mean like a filter? I think another part of it is surprise. If you read about the burst / tonic firing modes in the thalamus, one way to interpret that is surprise.
off topic
Pain causes adrenaline which causes focus. The problem with that is it’s a cheap way to pay attention, like music or inspirational thoughts, rather than wiring your brain to just do stuff which part of it doesn’t want to do, without a push from extraneous stuff. You shouldn’t need to do well in classes to feel good about yourself. I hate how society acts like intellectual ability makes people better or worse than others. I’m not immune to any of this, it’s just stuff I’ve thought about a lot.
1 Like
Actually i believe that we can form thoughts only when there is enough inputs to actually create a meaningfull thoughts. If inputs are low or higher we can’t form a thought… so a adequate amount is necessary
You are right, but im living in a place where students compete each other with their marks… Its this place that demands me to stop my breath to get attention… I don’t want anyone to follow this… Sry thou…
Agreed… is top-down and bottom-up work with each other simultaneously to give attention?
No need to apologize, holding your breath isn’t a big deal.
1 Like