ReLU as a switch

Community Lounge
1

I wrote this blog:

https://sciencelimelight.blogspot.com/2025/07/relu-as-switch.html

1 Like
2

Video:

https://youtu.be/v8P0KO9zXAI

I always wonder what proportion of people get that you can view ReLU as a switch?

It does seem to evoke a lot of resistance perhaps due to very heavy cognitive biasing toward the function viewpoint.

1 Like