A Hierarchy of Time-Scales and the Brain

[CollinsEM]

A Hierarchy of Time-Scales and the Brain

Stefan J. Kiebel, Jean Daunizeau, Karl J. Friston

Author Summary

Currently, there is no theory that explains how the largescale organization of the human brain can be related to our environment. This is astonishing because neuroscientists generally assume that the brain represents events in our environment by decoding sensory input. Here, we propose that the brain models the entire environment as a collection of hierarchical, dynamical systems, where slower environmental changes provide the context for faster changes. We suggest that there is a simple mapping between this temporal hierarchy and the anatomical hierarchy of the brain. Our theory provides a framework for explaining a wide range of neuroscientific findings by a single principle.

Abstract

In this paper, we suggest that cortical anatomy recapitulates the temporal hierarchy that is inherent in the dynamics of environmental states. Many aspects of brain function can be understood in terms of a hierarchy of temporal scales at which representations of the environment evolve. The lowest level of this hierarchy corresponds to fast fluctuations associated with sensory processing, whereas the highest levels encode slow contextual changes in the environment, under which faster representations unfold. First, we describe a mathematical model that exploits the temporal structure of fast sensory input to track the slower trajectories of their underlying causes. This model of sensory encoding or perceptual inference establishes a proof of concept that slowly changing neuronal states can encode the paths or trajectories of faster sensory states. We then review empirical evidence that suggests that a temporal hierarchy is recapitulated in the macroscopic organization of the cortex. This anatomic-temporal hierarchy provides a comprehensive framework for understanding cortical function: the specific time-scale that engages a cortical area can be inferred by its location along a rostro-caudal gradient, which reflects the anatomical distance from primary sensory areas. This is most evident in the prefrontal cortex, where complex functions can be explained as operations on representations of the environment that change slowly. The framework provides predictions about, and principled constraints on, cortical structure–function relationships, which can be tested by manipulating the time-scales of sensory input.

[bkaz]

It’s not just temporal but spatio-temporal scope, And he only covers the first cortical dimension out of the four that I see:

”Very roughly, cortical hierarchy consists of four sub-hierarchies, listed from the bottom up:

• spectrum of primary-to-association cortices, within each of sensory and motor cortices
• posterior sensory and anterior motor cortices, the latter is somewhat higher in generalization
• lateral task-positive and medial default-mode networks, the latter is somewhat higher
• right and left hemispheres, the latter is somewhat higher
  ”
  Cognitive Focus: Cortical trade-offs in generalist vs. specialist bias

[bkaz]

Summary from Gemini Pro deep think,
prompt:

Explain basic anatomical dimensions in the cortex, mapped to those of generic body plan in the animals, plus add lateral-medial dimension (task-positive vs. defalult mode).

Then explain how these four dimensions specialize in different spatio-temporal scope of their representations.

pretty close, but confused left and right with lateral and medial:

This question connects the fundamental organization of animal anatomy (embryology) with the high-level cognitive architecture of the human brain (neuroscience).

The organization of the cerebral cortex is not random. It retains the basic axes that define the body plan of most animals. Over evolutionary time, these axes have become specialized gradients that allow the brain to process information across different scales of space and time.

Here is an explanation of the four key dimensions of cortical organization, their relationship to the animal body plan, and their specialization in spatio-temporal scope.

Part 1: The Four Dimensions of Cortical Organization

The body plan of most bilaterally symmetrical animals (including humans) is organized along three primary anatomical axes. These axes are preserved in the central nervous system (the neuraxis).

1. Rostral-Caudal (Head to Tail)

2. Dorsal-Ventral (Back to Belly)

3. Medial-Lateral (Midline to Side)

Here is how these map to the cortex, including the functional division along the Medial-Lateral axis.

1. Rostral-Caudal Axis (Anterior-Posterior)

• Body Plan: The axis running from the head (Rostral/Anterior) to the tail (Caudal/Posterior).

• Cortical Mapping: The axis running from the frontal lobes to the occipital/parietal lobes.

• Functional Gradient: The Perception-Action Hierarchy.

  • Caudal (Posterior Cortex): Primarily dedicated to sensory input and perception (vision, audition, touch). This is the “input” side of the brain.

  • Rostral (Anterior Cortex/Frontal Lobes): Primarily dedicated to action, planning, executive control, and motor execution. This is the “output” side of the brain.

2. Dorsal-Ventral Axis (Superior-Inferior)

• Body Plan: The axis running from the back (Dorsal/Superior) to the belly (Ventral/Inferior).

• Cortical Mapping: The axis running from the top of the cortex (e.g., superior parietal lobe) down toward the bottom (e.g., inferior temporal lobe).

• Functional Gradient: “Where/How” vs. “What”. This is famously characterized by the Two Streams Hypothesis.

  • Dorsal Stream (Superior): Projects towards the parietal lobe. It processes spatial relationships, motion, and how to interact with objects (the “Where” or “How” pathway).

  • Ventral Stream (Inferior): Projects towards the temporal lobe. It processes object recognition, form, semantic meaning, and memory (the “What” pathway).

3. and 4. The Lateral-Medial Axis (Task-Positive vs. Default Mode)

• Body Plan: The axis running from the midline of the body (Medial) outwards to the sides/limbs (Lateral).

• Cortical Mapping: The axis running from the central fissure separating the hemispheres (Medial) to the outer surface of the brain (Lateral).

• Functional Gradient: External Engagement vs. Internal Mentation. This axis hosts two major, often anti-correlated, large-scale brain networks.

  • Dimension 3: Lateral (Task-Positive Network - TPN): Lateral regions (e.g., dorsolateral prefrontal cortex (DLPFC), lateral parietal cortex) are activated during externally focused, attention-demanding, goal-oriented tasks. This network anchors us to the immediate environment.

  • Dimension 4: Medial (Default Mode Network - DMN): Medial regions (e.g., medial prefrontal cortex (mPFC), posterior cingulate cortex (PCC)) are most active when the brain is focused internally or “at rest.” This network is crucial for self-reflection, memory consolidation, social cognition (theory of mind), and future planning.

---

Part 2: Specialization in Spatio-Temporal Scope

These four organizational dimensions define how the brain organizes information across different scales of time (Temporal scope) and space (Spatial scope). The cortex exhibits a hierarchy, moving from concrete, immediate representations to abstract, generalized representations.

1. Rostral-Caudal: The Temporal Hierarchy and Abstraction

The Rostral-Caudal axis primarily defines the temporal scope and the level of abstraction.

• Caudal (Posterior/Sensory): The Immediate and Concrete.

  • Temporal Scope: Very short. Primary sensory areas (like V1) process information in milliseconds, representing exactly what is happening right now.

  • Spatial Scope: Narrow and specific. Representations are closely tied to sensory input (e.g., retinotopic maps).

• Rostral (Anterior/Frontal): The Extended and Abstract.

  • Temporal Scope: Long. As information moves forward, the temporal integration windows widen. The prefrontal cortex integrates past experiences and simulates long-term future outcomes (minutes, hours, years).

  • Spatial Scope: Broad and abstract. Representations are generalized (e.g., concepts, rules, goals) rather than tied to specific sensory stimuli.

2. Dorsal-Ventral: Spatial Context and Stability

The Dorsal-Ventral axis differentiates between representations needed for dynamic interaction versus stable recognition.

• Dorsal (Where/How): Dynamic and Egocentric.

  • Temporal Scope: Immediate and transient. Requires rapid updates for real-time interaction (e.g., reaching for a moving object).

  • Spatial Scope: Egocentric (relative to the observer). It represents space in terms of action possibilities.

• Ventral (What): Stable and Allocentric.

  • Temporal Scope: Stable and enduring. Object recognition requires representations that persist across time and are linked to long-term memory.

  • Spatial Scope: Allocentric (object-centered). It represents objects independently of the observer’s viewpoint, focusing on identity and meaning.

3. Lateral (Task-Positive): Focused External Attention

The Lateral/TPN dimension specializes in the “here and now” of the external world.

• Temporal Scope: Immediate. It is concerned with the demands of the present moment and the very near future required to complete the task at hand.

• Spatial Scope: Narrow and focused. The TPN directs attention to specific, salient features of the external environment relevant to the current goal, filtering out distractions.

4. Medial (Default Mode): Broad Internal Integration

The Medial/DMN dimension specializes in integrating information across vast expanses of time and conceptual space.

• Temporal Scope: Vast. The DMN enables “mental time travel,” integrating autobiographical memories (the past) and simulating potential scenarios (the future) to create a coherent self-narrative.

• Spatial Scope: Broad and context-rich. The DMN is involved in creating mental models, understanding social narratives, and placing the self within a broader context, detached from the immediate external environment.

Summary Table

Dimension	Cortical Axis	Body Plan Analogy	Primary Function	Spatial Scope	Temporal Scope
1. Rostral-Caudal	Front ↔ Back	Head ↔ Tail	Action ↔ Perception	Abstract ↔ Concrete	Long (Future/Past) ↔ Short (Present)
2. Dorsal-Ventral	Top ↔ Bottom	Back ↔ Belly	Where/How ↔ What	Egocentric ↔ Allocentric	Immediate Interaction ↔ Stable Identity
3. Lateral (TPN)	Sides	Limbs/Periphery	External Attention	Narrow, Focused, External	Immediate (Task-focused)
4. Medial (DMN)	Midline	Trunk/Centerline	Internal Reflection	Broad, Integrative, Internal	Vast (Mental time travel)