# Multiplicative Updates

**URL:** https://discourse.numenta.org/t/multiplicative-updates/1304
**Category:** Tangential Theories
**Created:** [August 28, 2016, 3:38pm UTC](https://discourse.numenta.org/t/multiplicative-updates/1304 "2016-08-28T15:38:42Z")
**Posts on this page:** 6
**Page:** 1

<div class="post-metadata">

### Author: ![Sean\_O\_Connor](https://avatars.discourse-cdn.com/v4/letter/s/34f0e0/32.png) [@Sean\_O\_Connor](https://discourse.numenta.org/u/Sean_O_Connor)
#### Post date: [August 28, 2016, 3:38pm UTC](https://discourse.numenta.org/t/multiplicative-updates/1304/1 "2016-08-28T15:38:42Z")

</div>

I suppose it might be better to learn which synapses to connect this way:  
[http://svivek.com/teaching/machine-learning/fall2016/slides/07-winnow/winnow.pdf](http://svivek.com/teaching/machine-learning/fall2016/slides/07-winnow/winnow.pdf)

[http://svivek.com/teaching/machine-learning/fall2016/lectures/07-multiplicative-update.html](http://svivek.com/teaching/machine-learning/fall2016/lectures/07-multiplicative-update.html)

---

<div class="post-metadata">

### Author: ![rhyolight](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/rhyolight/32/3922_2.png) [@rhyolight](https://discourse.numenta.org/u/rhyolight)
#### Post date: [August 29, 2016, 3:35pm UTC](https://discourse.numenta.org/t/multiplicative-updates/1304/2 "2016-08-29T15:35:12Z")

</div>

Moved from #htm-theory:papers to #htm-theory:tangential-theories because:

- linked paper does not relate to HTM
- proposal is non-biological

---

<div class="post-metadata">

### Author: ![Sean\_O\_Connor](https://avatars.discourse-cdn.com/v4/letter/s/34f0e0/32.png) [@Sean\_O\_Connor](https://discourse.numenta.org/u/Sean_O_Connor)
#### Post date: [August 30, 2016, 1:40am UTC](https://discourse.numenta.org/t/multiplicative-updates/1304/3 "2016-08-30T01:40:23Z")

</div>

Being aware of it you can keep it in mind when looking at biological systems. Actually the idea was presented in a video on biological evolution by the same Christos H. Papadimitriou who wrote the Cortical Learning via Prediction paper.  
[https://youtu.be/KP0WFbdHhJM](https://youtu.be/KP0WFbdHhJM)  
If you add in hysteresis where patterns self-reinforce via positive feedback for a while (giving short-term memory) you get an interesting overall package of ideas to explore.  
If the (short-term) positive feedback is is giving a good outcome there there is the possibility for its effects to be long-term potentiated by building synapses. You can end up with quite complex learning scenarios.

---

<div class="post-metadata">

### Author: ![Sean\_O\_Connor](https://avatars.discourse-cdn.com/v4/letter/s/34f0e0/32.png) [@Sean\_O\_Connor](https://discourse.numenta.org/u/Sean_O_Connor)
#### Post date: [August 31, 2016, 3:45am UTC](https://discourse.numenta.org/t/multiplicative-updates/1304/4 "2016-08-31T03:45:20Z")

</div>

[https://youtu.be/I\_CCQ-AC5gM](https://youtu.be/I_CCQ-AC5gM)

---

<div class="post-metadata">

### Author: ![Sean\_O\_Connor](https://avatars.discourse-cdn.com/v4/letter/s/34f0e0/32.png) [@Sean\_O\_Connor](https://discourse.numenta.org/u/Sean_O_Connor)
#### Post date: [October 25, 2016, 2:52pm UTC](https://discourse.numenta.org/t/multiplicative-updates/1304/5 "2016-10-25T14:52:50Z")

</div>

Paper (MWU and reinforcement learning):  
[http://www.pnas.org/content/110/49/19950.full.pdf](http://www.pnas.org/content/110/49/19950.full.pdf)

---

<div class="post-metadata">

### Author: ![Sean\_O\_Connor](https://avatars.discourse-cdn.com/v4/letter/s/34f0e0/32.png) [@Sean\_O\_Connor](https://discourse.numenta.org/u/Sean_O_Connor)
#### Post date: [October 28, 2016, 12:49am UTC](https://discourse.numenta.org/t/multiplicative-updates/1304/6 "2016-10-28T00:49:08Z")

</div>

In depth paper (evolution):  
[https://arxiv.org/abs/1511.01409](https://arxiv.org/abs/1511.01409)
