Today I realized something I hadn’t noticed before. Tell me if this makes sense or if I’m confused.
We talk about a hierarchy in the neocortex where columns send data to a region of neocortex that is above them in the hierarchy. In otherwords, the regions of neocortex are networked in a highly hierarchical fashion right?
That’s one type of hierarchy - regions hierarchy (which is technically a network but arranged in a hierarchy).
I realized today that there is another type of hierarchy - size hierarchy. A hierarchy of scale.
Neurons make up columns, columns make up regions, regions make up brains.
At each level, you have a network where the nodes of the network have many very close connections and few faraway connections. the local connections can be seen as a node in a higher size-scale network. Long-range connections can be seen as connections between nodes in the network above.
What you have is a network of networks - or - the realization that every node in any network is a network itself.
this drawing is very centric to the center red node to show long-range connections in yellow, midrange connections in light green and close connections in dark green.
I think you can abstract that scale hierarchy to look like this where each level represents the entire network at that particular scale made up of nodes of networks of nodes, of networks of nodes, etc.
I have been reading about it in relation to the brain about as long as I have been studying biology. The bulk of what I have read anthropomorphizes this in the shape of how humans break down tasks with certain common organizing motifs. This seemed natural and I accepted it without question. You can see that I am not alone in this - older Numenta papers featured hierarchy so prominently that is is part of the name of the HTM model.
See page 9.
As I learned more about how the brain was organized I read thousands of papers and books (yes - thousands!) I started to have my doubts. Many facts and observations just did not fit this model.
I have tried to keep an open mind about how this or that model “almost” works and maybe I have one or two thing wrong about it and with a little fixing up it would be just fine. Some models start to accumulate so much cruft that you just have to put them on the shelf and quit paying any attention to them. The concept that hierarchy concentrates or consolidates to some higher order representation fits in that crufty niche for me now.
I have come to this point though several different lines. One particularly notable line is developmental biology. What kind of operations does the growing brain use to turn from a few cells into hundreds of million cells all hooked up the right way? This is all done without a schematic or wiring diagram. Check out a paper that Numenta has touted many times - in it V B Mountcastle gives a nice overview of how the cells in the cortex hook themselves up as the cortex grows. Columnar organization of the neocortex - V B Mountcastle
See the section “The ontogenesis of the neocortex”
Cells do basic operation like migrating in waves and spreading out laterally. They can split into different types. They generate chemical markers to use as guiding scaffolds in place of schematics and road maps. These chemical markers can be gradients across a map. They can be a 2D address with markers with gradients going “top to bottom and left to right” in a map. (direction markers being an arbitrary definition here) They can make stripes and spots. See zebras and leopards for examples of this. One of the more astounding feats is the generation of inter-map axonal projections. This is roughly the same as your finger growing miles long and in the process, ending up at the right house correctly positioned for pushing the doorbell - without looking. The chemical markers are guiding the process with the growth cone on the axon sampling the chemical markers in the soup and sniffing out the target that has the exact same x/y smell as the cell that they axon started from in the target map. As it grows it add to the correct side to steer in the direction that smells right. What it does NOT have is the right details to form a complicated wiring diagram - it is part of a roughly parallel bundle of axons growing as a fleet to a target position in a distant map. (cue “flight of the Valkyries!”)
The last hurrah of the hierarchy for me was trying to use the “crazy quilting” and slight spreading of axons to pull off some sort of hierarchy concentration as the information ascends the maps.
In the discussion that followed and reading many papers on the loose ends that came up in these exchanges, while there are discontinuities, they are just that - scattered maps that do maintain topology in the multiple scattered copies of the input topology located all over the brain.
There are other lines of factoids that cast doubt on the concentrating of information as you ascend the hierarchy but I consider the developmental facts to be the most damming.
So what do the maps do with these bundles of parallel fibers? I put down some of the key factors in this post:
Which results in this schematic diagram showing the relative relationships of SDR size to spatial mapping size:
It makes little or no sense that the flow is a straight line from V1 to the association regions. There would be very little for the dendrites in the next map to use to form new SDRs; they are too far apart for even two fibers to reach a single dendrite - let alone enough to form an SDR. What must be happening is that the projecting axons from different maps come together to form new SDRs that are a combination of the output from these other maps.
Also - we have neurologists that have been giving us detailed connection maps for decades and it seems like every map is connected to many other maps. We trot this diagram out to frighten neural newbies:
On of the basic truths of brain is that if information will be used in a certain part of the brain there will have be be a direct or indirect connection from where that information is sensed.The good news here is that almost everything is connected to everything through a low number of hops - sort of a "six degrees of Keven Bacon" thing.
I do see the information being compared and contrasted as it splits apart and rejoins going up the hierarchy. I see the maps teasing out as many relationships as possible and presenting that to the association region to form codes representing objects.
This is the essence of my hex-grid coding scheme and where I think that Numenta is going with the 1000 brains theory.
I have a feeling that this is personal. In some brains, experience does converge into recognizable conceptual hierarchy. In others, you have local hierarchies, but they stay largely separate. No links, just a personal observation :).
There is learning on all levels of structure, we are not insects. Higher-in-scale and lower-in-the-pipeline structures are more genetically influenced, but nothing is set in stone. Ok, that might be an exaggeration, to compensate for your exaggeration :). But even prenatal development is adaptive, which is a form of learning.
Anyway, effective structure is a composite of all levels, so learning in finer structures alters function and interaction of more coarse ones. For example, we all have two hemispheres, but the degree of lateralization generally increases during development, to the extent that differs between individuals. And lateralization, to whatever extent, is the top component of generalisation hierarchy.
So, large areas and their fiber tracts maybe mostly genetically determined, but hierarchical relationship between them is informed by learning. I assume that specific short-term pressures, or innate sensitivity to such pressures, would increase detail-oriented learning at the cost of broad generalizations.
I’m not sure if you are disagreeing with me or you just don’t like the way I say things.
I think we are in agreement on the gross structure of maps and fiber bundles. I think we agree that the function is strongly dictated by the learned connections at the terminus of these bundles. We agree that this learning is distributed in the maps from the primary sensory areas through to the lobe hubs or as they are often called - association regions.
In a prior post on the definition of intelligence I stated that the training absorbed combined with the gifts of genetics combine to select the best actions in various settings. more intelligent people tent to pick what is thought to be better answers. I think we are in general agreement even though we are saying this in very different ways.
The original post asked about the hierarchical organization and my intent is that it is not what is normally thought of as a hierarchy but instead - a parallel data flow where the stream splits and rejoins to extract features of the stream. The representation maintains topology through this process. What is presented to the association region is a feature rich topological aligned stream that can be sampled for space-time features that add up to objects and spatial relationships. This is still in a distributed form that occupies some spatial extent of the association region and my be morphing over time.
In the case of the eye (processing of which consumes roughly 30% of the real estate of the cortex) the presented features strongly exploit the temporal nature of the processing to collect the topological organized stream of saccades to match up features from frame to frame for object recognition. Still not really what could be thought of as a spatial hierarchy although a case could be made for some kind of temporal hierarchy during recognition.
Basically, you stress the negative: NOT all / most relationships are hierarchical, and then it’s NOT what “conventionally” is thought of as hierarchy.
I stress the positive: upstream areas contain at least as or more general, AKA stable, AKA invariant representations. (Edit: they are projected be as or more general according to prior experience, but may not turn out to be such in the future)
Which can only be discovered by expanding effective receptive field of these representations. It may expand across space or over time (the difference is often POV: one maps to another, as with your eye saccades), and this expansion is selective vs. contiguous in various ways.
But it’s not a question of hierarchy or not, just a shape and degree of deep vs. flat in that hierarchy.
Generalization in the cortex is like evolution in biology: it may not be consistent in form or direction, but nothing makes any sense without it.
Do you feel that this definition is informative?
My intent here was to stress individual variation in width vs. depth of hierarchical organization. I feel that lot of theoretical disagreements come down to mismatch between these parameters in the participants :).
This is what happens with you summarize an idea with a sentence that hits the key point - it is often weak and misses the supporting ideas. You know that I am not afraid to dump a wall of text to support an idea - just not every time I mention it in passing.
We have a long winded thread on intelligence vs consciousness and it is not topical to the original post - if you want to continue this idea I suggest that we switch to that thread but a short response is this:
In that thread there were several attempts to examine exactly what intelligence is. Most were a laundry list of traits that assumes that if you have these traits - you are intelligent. As you correctly stated above - intelligence is a continuum so you end up with a this multi-variate input function yielding a slope with no clear relationship between the factors in the definition and the result. It really misses defining the core of what intelligence is.
The definition I offer is simple and gives a general metric based on the concept that the purpose of having a nervous system is to select and perform some action based on perception. If you think about most measures of intelligence you can boil them down to measuring this exact thing. There may be internal factors that drive this selection of action but in the end - smart people understand what they are seeing and make better choices.
I am scared shitless of any philosophical discussion about “consciousness”.
It’s a purest form of intellectual porn.
I disagree, respectfully :).
I am sure you’ve seen my definition, but it didn’t strike a cord:
“Intelligence is a general cognitive ability, ultimately an ability to predict. That includes cognitive component of action: planning is technically self-prediction. And prediction is interactive projection of previously discovered patterns. This perspective is well established, pattern recognition is a core of any IQ test. But there is no general and constructive definition of pattern and recognition. Below, I define (quantify) similarity for the simplest inputs, then describe hierarchically recursive algorithm to search for patterns in incrementally complex inputs…”: http://www.cognitivealgorithm.info
This actually does give a simple metric, which can be applied automatically on the lowest levels of processing. As I understand, your metric is a human judge observing some complex behaviour and applying a back-box load of implicit subjective criteria, case by case.
But it’s very to argue on this level of generalization…