Thanks!
I’m trying to at least. Note the: “not exactly sure what I’m doing” comment. I tried to approximate sparsity enforcing with small convolutions, but I have another idea I want to try that’s more like some competitive attractor networks. Think: gravity bringing things together while electromagnetism (or dark energy) keeps it apart.
I don’t think I can do a global k-winners activation with local algorithms though, but I should be able to enforce a max.