Official repository for "Self-supervised Models are Good Teaching Assistants for Vision Transformers", ICML 2022.