Ensemble Neural Networks with Random Projections

Community Lounge
1

You could just ensemble a number of neural networks by averaging across dimensions.

That is to miss some opportunities for neurons to help each other out, so to say.

Or you can take a weak learner view point and then find a better way to combine those into stronger learners. Or you take a quantization viewpoint and find ways to get finer granulation.

Anyway better to use Random Projections to ensemble:

https://sciencelimelight.blogspot.com/2025/08/sum-then-project-vs-project-then-sum.html

1 Like
2

I’m supposed to find some gig-economy thing to do, but I’m doing this instead:

https://sciencelimelight.blogspot.com/2025/08/inward-outward-facing-fast-random.html

Fast inward & outward facing random projections.