# Attention Approximates Sparse Distributed Memory

**URL:** <https://discourse.numenta.org/t/attention-approximates-sparse-distributed-memory/9080>\
**Category:** Lounge\
**Created:** [October 21, 2021, 10:46am UTC](https://discourse.numenta.org/t/attention-approximates-sparse-distributed-memory/9080 "2021-10-21T10:46:23Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![LiorA](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/liora/32/1671_2.png) [@LiorA](https://discourse.numenta.org/u/LiorA)\
**Post date:** [October 21, 2021, 10:46am UTC](https://discourse.numenta.org/t/attention-approximates-sparse-distributed-memory/9080/1 "2021-10-21T10:46:23Z")

</div>

Nice talk from MITCBMM

[![](https://img.youtube.com/vi/THIIk7LR9_8/maxresdefault.jpg "Attention Approximates Sparse Distributed Memory") ](https://www.youtube.com/watch?v=THIIk7LR9_8)

---

<div class="post-metadata">

**Author:** ![maxerbubba](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/maxerbubba/32/4804_2.png) [@maxerbubba](https://discourse.numenta.org/u/maxerbubba)\
**Post date:** [October 22, 2021, 5:25am UTC](https://discourse.numenta.org/t/attention-approximates-sparse-distributed-memory/9080/2 "2021-10-22T05:25:36Z")

</div>

This is fantastic thanks for sharing!  
I love it when somebody discovers that an important equation in one field is “the same as” an important equation in another field.

The “Attention/Transformer is like cerebellum” idea is news to me