Self-supervised learning is fantastic for pretraining, but can we use it for other tasks (kNN classification, in-context learning) &amp; modalities, w/o training &amp; by simply using its gradients as features?
Enter 🍄FUNGI - Features from UNsupervised GradIents  #NeurIPS2024 🧵
#NeurIPS2024