In this research meeting, joined by Rosanne Liu, Jason Yosinski, and Mitchell Wortsman from ML Collective, Subutai Ahmad explains the properties of small-world structures and how they can be helpful in Numenta’s research.
Subutai first discusses different network types and the concept of small-world structures by reviewing the paper “Collective Dynamics of ‘Small-World’ Networks” by Watts & Strogatz. He then evaluates the efficiency of these structures and how they are helpful in non-physical networks by looking at Jon Kleinberg’s paper “Navigation in a Small World.” Subutai also addresses how small-world structures would apply to machine learning by using concepts from the paper “Graph Structure of Neural Networks” by Jiaxuan You et al… Lastly, the team discusses how small-world structures relate to Numenta’s research such as sparsity and cortical columns.
- “Collective Dynamics of ‘Small-World’ Networks” by Watts & Strogatz
- “Navigation in a Small World” by Kleinberg
- “Graph Structure of Neural Networks” by Jiaxuan You et al
- “Small-World Brain Networks” by Bassett & Bullmore
More information on ML Collective: https://mlcollective.org/