Ares Fisher discusses dendrites in machine learning and reviews the paper “Improved Expressivity Through Dendritic Neural Networks” by Wu et al.
3 Likes
This one was quite heavy for me. Still very interesting. Thanks.
@afiser, at 1h20m you wonder about making complex functions by combining ReLU activation functions. Here is a great video that explains how to combine 8 neurons with ReLU activation functions into a sinusoide. (The start of the video gives an introduction to the ReLU, but I skipped ahead).