# Numenta Research Meeting - August 3, 2020

**URL:** <https://discourse.numenta.org/t/numenta-research-meeting-august-3-2020/7777>\
**Category:** Current Research\
**Created:** [August 4, 2020, 4:54pm UTC](https://discourse.numenta.org/t/numenta-research-meeting-august-3-2020/7777 "2020-08-04T16:54:49Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![Bitking](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/bitking/32/3099_2.png) [@Bitking](https://discourse.numenta.org/u/Bitking)\
**Post date:** [August 4, 2020, 4:54pm UTC](https://discourse.numenta.org/t/numenta-research-meeting-august-3-2020/7777/1 "2020-08-04T16:54:49Z")

</div>

[![](https://img.youtube.com/vi/Z4F-0l4Rkz8/maxresdefault.jpg "Continuous Learning: MAML, OML, ANML, and Supermasks - August 3, 2020") ](https://www.youtube.com/watch?v=Z4F-0l4Rkz8)

In this meeting Subutai discusses three recent papers and models (OML, ANML, and Supermasks) on continuous learning. The models exploit sparsity, gating, and sparse sub-networks to achieve impressive results on some standard benchmarks. We discuss some of the relationships to HTM theory and neuroscience.

Papers discussed:

1. Meta-Learning Representations for Continual Learning ([[1905.12588] Meta-Learning Representations for Continual Learning](http://arxiv.org/abs/1905.12588))  
[[1905.12588] Meta-Learning Representations for Continual Learning](https://arxiv.org/abs/1905.12588)
2. Learning to Continually Learn ([[2002.09571] Learning to Continually Learn](http://arxiv.org/abs/2002.09571))  
[[2002.09571] Learning to Continually Learn](https://arxiv.org/abs/2002.09571)
3. Supermasks in Superposition ([[2006.14769] Supermasks in Superposition](http://arxiv.org/abs/2006.14769))  
[[2006.14769] Supermasks in Superposition](https://arxiv.org/abs/2006.14769)  
License  
Creative Commons Attribution license (reuse allowed)

---

<div class="post-metadata">

**Author:** ![SeanOConnor](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/seanoconnor/32/3441_2.png) [@SeanOConnor](https://discourse.numenta.org/u/SeanOConnor)\
**Post date:** [August 5, 2020, 6:14am UTC](https://discourse.numenta.org/t/numenta-research-meeting-august-3-2020/7777/2 "2020-08-05T06:14:24Z")

</div>

The Continual AI group looked into the Supermasks in Superposition paper:  
[https://continualai.discourse.group/t/continualai-reading-group-supermasks-in-superposition/136](https://continualai.discourse.group/t/continualai-reading-group-supermasks-in-superposition/136)