Subutai Ahmad, Lucas Souza and Karan Grewal give a recap on The Conference and Workshop on Neural Information Processing Systems (NeurIPS) 2020, which was held virtually on Dec 6-12.
Subutai first gives his impression on the conference and highlights the positives and negatives. He then gives an overview of three papers from the conference that are focused on contrastive learning. Karan Grewal gives some highlights on the workshops he attended, specifically talks on the community being hyper-focused on achieving benchmark performances. Karan also highlights a panel session he attended on the rising trend of bias in machine learning. Lastly, Lucas shares his experience at the conference - highlighting the tutorials, workshops and industry talks.
Papers Subutai mentioned:
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
https://proceedings.neurips.cc//paper_files/paper/2020/hash/70feb62b69f16e0238f741fab228fec2-Abstract.html
Bootstrap Your Own Latent - A New Approach to Self-Supervised Learning
https://proceedings.neurips.cc//paper_files/paper/2020/hash/f3ada80d5c4ee70142b17b8192b2958e-Abstract.html
LoCo: Local Contrastive Representation Learning
https://proceedings.neurips.cc//paper_files/paper/2020/hash/7fa215c9efebb3811a7ef58409907899-Abstract.html