Usporedite metode

	Polu-nadgledani Vision Transformer	Prilagođeni Vision Transformer
Područje	Duboko učenje	Duboko učenje
Obitelj	Machine learning	Machine learning
Godina nastanka	2021–2022	2020-2021
Tvorac	Dosovitskiy et al. (ViT); semi-supervised extensions by multiple groups (2021–2023)	Dosovitskiy, A. et al. (Google Brain)
Vrsta	Semi-supervised deep learning for image understanding	Transfer learning / fine-tuning of attention-based image model
Temeljni izvor	Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., Uszkoreit, J., & Houlsby, N. (2021). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. International Conference on Learning Representations (ICLR 2021).	Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., Uszkoreit, J., & Houlsby, N. (2021). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In International Conference on Learning Representations (ICLR 2021).
Drugi nazivi	Semi-supervised ViT, SSL-ViT, Semi-supervised Patch-based Transformer, Semi-supervised Self-Attention Image Model	Fine-Tuned ViT, ViT fine-tuning, Vision Transformer transfer learning, ViT downstream adaptation
Srodne	6	5
Sažetak	Semi-supervised Vision Transformer applies the patch-based self-attention architecture of ViT to settings where only a fraction of images are labeled, exploiting large unlabeled corpora through pseudo-labeling, consistency regularization, or self-supervised pretext tasks before fine-tuning on the small labeled set. This approach achieves near-supervised accuracy even when labeled images are scarce.	Fine-Tuned Vision Transformer adapts a large pre-trained ViT model — which splits images into fixed-size patches and processes them through self-attention layers — to a new image classification or recognition task using a relatively small labeled dataset. It achieves state-of-the-art accuracy in computer vision by leveraging rich representations learned during large-scale pre-training.