Alice Bizeul
PhD student @ETH AI Center working on self-supervised representation learning | Previously @EPFL, @MIT, Research Intern @Amazon
Personal website: https://alicebizeul.github.io
- ✨New Preprint ✨ Ever thought that reconstructing masked pixels for image representation learning seems sub-optimal? In our new preprint, we show how masking principal components—rather than raw pixel patches— improves Masked Image Modelling (MIM). Find out more below 🧵
- [1/🧵] Unlike text, images are not compact representations. Masking and reconstructing 75% of raw pixels—a common practice in MIM—can thus lead to failure cases: ❌ Visible pixels may be redundant with the masked ones. ❌ Visible pixels may be unpredictive of the masked regions.
