# Direct Fit to Nature: an evolutionary perspective on biological and artificial neural networks

**URL:** https://discourse.numenta.org/t/direct-fit-to-nature-an-evolutionary-perspective-on-biological-and-artificial-neural-networks/7195
**Category:** General Neuroscience
**Created:** [February 16, 2020, 1:06am UTC](https://discourse.numenta.org/t/direct-fit-to-nature-an-evolutionary-perspective-on-biological-and-artificial-neural-networks/7195 "2020-02-16T01:06:48Z")
**Posts on this page:** 8
**Page:** 1

<div class="post-metadata">

### Author: ![bkaz](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/bkaz/32/6455_2.png) [@bkaz](https://discourse.numenta.org/u/bkaz)
#### Post date: [February 16, 2020, 1:06am UTC](https://discourse.numenta.org/t/direct-fit-to-nature-an-evolutionary-perspective-on-biological-and-artificial-neural-networks/7195/1 "2020-02-16T01:06:48Z")

</div>

[https://www.cell.com/neuron/fulltext/S0896-6273(19)31044-X](https://www.cell.com/neuron/fulltext/S0896-6273(19)31044-X) [https://drive.google.com/file/d/1kNH\_Dw3f0iY5YXXwV\_phmLE94cv1Zj18/view?usp=drivesdk](https://drive.google.com/file/d/1kNH_Dw3f0iY5YXXwV_phmLE94cv1Zj18/view?usp=drivesdk)

“We argue that neural computation is grounded in brute-force direct fitting, which relies on over-parameterized optimization algorithms to increase predictive power (generalization) without explicitly modeling the underlying generative structure of the world. Although ANNs are indeed highly simplified models of BNNs, they belong to the same family of over-parameterized, direct-fit models, producing solutions that are mistakenly interpreted in terms of elegant design principles but in fact reflect the interdigitation of ‘‘mindless’’ optimization processes and the structure of the world.”

---

<div class="post-metadata">

### Author: ![SeanOConnor](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/seanoconnor/32/3441_2.png) [@SeanOConnor](https://discourse.numenta.org/u/SeanOConnor)
#### Post date: [February 24, 2020, 2:54am UTC](https://discourse.numenta.org/t/direct-fit-to-nature-an-evolutionary-perspective-on-biological-and-artificial-neural-networks/7195/2 "2020-02-24T02:54:35Z")

</div>

The most information an evolutionary algorithm can extract from the environment at one pass/fail instance (from one life) is one bit. But over time enough information can be extracted so that a stick insect looks like a stick for example. Which is kind of an interesting transference.  
Anyway I did an updated summary of some things:  
[https://ai462qqq.blogspot.com/2019/11/artificial-neural-networks.html](https://ai462qqq.blogspot.com/2019/11/artificial-neural-networks.html)  
It seems one overlooked thing in artificial neural network research is the variance equation for linear combinations of random variables and how that explains what you need to do to turn the weighted sum into a general associative memory.

---

<div class="post-metadata">

### Author: ![Jose\_Cueto](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/jose_cueto/32/4052_2.png) [@Jose\_Cueto](https://discourse.numenta.org/u/Jose_Cueto)
#### Post date: [February 24, 2020, 6:36am UTC](https://discourse.numenta.org/t/direct-fit-to-nature-an-evolutionary-perspective-on-biological-and-artificial-neural-networks/7195/3 "2020-02-24T06:36:18Z")

</div>

Thanks for sharing but is this a free resource?

> [@bkaz](#):
>
> “but in fact reflect the interdigitation of ‘‘mindless’’ optimization processes and the structure of the world.”

I wonder what the author mean about `mindless` here.

---

<div class="post-metadata">

### Author: ![bkaz](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/bkaz/32/6455_2.png) [@bkaz](https://discourse.numenta.org/u/bkaz)
#### Post date: [February 24, 2020, 9:48am UTC](https://discourse.numenta.org/t/direct-fit-to-nature-an-evolutionary-perspective-on-biological-and-artificial-neural-networks/7195/4 "2020-02-24T09:48:30Z")

</div>

Yes, open access, did the link work for you? I think by mindless they mean initially random connections, and the statistical nature of adjusting them. That’s their interpretation vs. directed extrapolation dichotomy.

---

<div class="post-metadata">

### Author: ![Jose\_Cueto](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/jose_cueto/32/4052_2.png) [@Jose\_Cueto](https://discourse.numenta.org/u/Jose_Cueto)
#### Post date: [February 24, 2020, 9:51am UTC](https://discourse.numenta.org/t/direct-fit-to-nature-an-evolutionary-perspective-on-biological-and-artificial-neural-networks/7195/5 "2020-02-24T09:51:03Z")

</div>

Ok. I think I need to login/buy it.

“To read this article in full you will need to make a payment”

---

<div class="post-metadata">

### Author: ![bkaz](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/bkaz/32/6455_2.png) [@bkaz](https://discourse.numenta.org/u/bkaz)
#### Post date: [February 24, 2020, 9:54am UTC](https://discourse.numenta.org/t/direct-fit-to-nature-an-evolutionary-perspective-on-biological-and-artificial-neural-networks/7195/6 "2020-02-24T09:54:41Z")

</div>

Damn, that’s new, it used to be free. Hold on, I think I have pdf somewhere, or they most likely have a copy on arxiv.

---

<div class="post-metadata">

### Author: ![bkaz](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/bkaz/32/6455_2.png) [@bkaz](https://discourse.numenta.org/u/bkaz)
#### Post date: [February 24, 2020, 10:16am UTC](https://discourse.numenta.org/t/direct-fit-to-nature-an-evolutionary-perspective-on-biological-and-artificial-neural-networks/7195/10 "2020-02-24T10:16:24Z")

</div>

[https://drive.google.com/file/d/1kNH\_Dw3f0iY5YXXwV\_phmLE94cv1Zj18/view?usp=drivesdk](https://drive.google.com/file/d/1kNH_Dw3f0iY5YXXwV_phmLE94cv1Zj18/view?usp=drivesdk)

---

<div class="post-metadata">

### Author: ![Jose\_Cueto](https://yyz2.discourse-cdn.com/flex030/user_avatar/discourse.numenta.org/jose_cueto/32/4052_2.png) [@Jose\_Cueto](https://discourse.numenta.org/u/Jose_Cueto)
#### Post date: [February 28, 2020, 11:51pm UTC](https://discourse.numenta.org/t/direct-fit-to-nature-an-evolutionary-perspective-on-biological-and-artificial-neural-networks/7195/11 "2020-02-28T23:51:05Z")

</div>

accessed thanks! will have a read
