Learning Sparse Neural Networks through L0 Regularization

rhyolight · August 16, 2019, 9:53pm

Monday’s live-stream will be a Journal Club.

Bitking · August 16, 2019, 10:16pm

Are we losing Matt to the deep learning dark side?

Falco · August 17, 2019, 11:26am

I don’t think Matt is stearing the course. But I do wonder about Numenta sometimes. Jeff certainly doesn’t seem impressed by these NN tangents.

Still, it’s interesting.

rhyolight · August 19, 2019, 4:17pm

The research team is reviewing attempts to apply sparsity to deep networks to see what tactics have been tried, and whether it can inform us as to how to best apply biologically-inspired sparsity to deep networks.

This live stream will start in about an hour.

Topic		Replies	Views
Research Meeting - 2020-05-20 Current Research	2	628	May 22, 2020
Variational Inference provides a taxonomy for training deep networks Current Research research , live , deep-learning	2	657	October 23, 2019
Brains@Bay Meetup: Sparsity in Neural Networks - Aug 19, 2019 Talks and Events	12	1309	August 28, 2019
Deep Learning Reinforcement Learning Summer School 2019 Recap Live Streaming live , education	5	939	August 23, 2019
Numenta Technology Demonstration: Sparse networks perform inference 50 times faster than dense networks, with competitive accuracy Machine Learning	6	1209	November 12, 2020

Learning Sparse Neural Networks through L0 Regularization

Related topics