Methoden vergleichen

	Domain-Adaptive Vision Transformer	Feinabgestimmter Vision Transformer
Fachgebiet	Deep Learning	Deep Learning
Familie	Machine learning	Machine learning
Entstehungsjahr	2021–2023	2020-2021
Urheber	Multiple groups (Yang et al., 2023; Xu et al., 2021; Ma et al., 2022)	Dosovitskiy, A. et al. (Google Brain)
Typ	Domain adaptation + Vision Transformer ensemble	Transfer learning / fine-tuning of attention-based image model
Wegweisende Quelle	Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., ... & Houlsby, N. (2021). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. International Conference on Learning Representations (ICLR).	Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., Uszkoreit, J., & Houlsby, N. (2021). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In International Conference on Learning Representations (ICLR 2021).
Aliasnamen	DA-ViT, Domain Adaptation with Vision Transformer, ViT with Domain Adaptation, Domain-Adaptive ViT	Fine-Tuned ViT, ViT fine-tuning, Vision Transformer transfer learning, ViT downstream adaptation
Verwandt	5	5
Zusammenfassung	Domain-Adaptive Vision Transformer (DA-ViT) applies domain adaptation techniques — such as adversarial alignment, self-training, or attention-level bridging — on top of a pretrained Vision Transformer backbone to transfer visual knowledge from a labeled source domain to an unlabeled or lightly labeled target domain, reducing the distribution shift that limits standard ViT fine-tuning.	Fine-Tuned Vision Transformer adapts a large pre-trained ViT model — which splits images into fixed-size patches and processes them through self-attention layers — to a new image classification or recognition task using a relatively small labeled dataset. It achieves state-of-the-art accuracy in computer vision by leveraging rich representations learned during large-scale pre-training.