方法对比

	领域自适应视觉 Transformer	微调视觉Transformer
领域	深度学习	深度学习
方法族	Machine learning	Machine learning
起源年份	2021–2023	2020-2021
提出者	Multiple groups (Yang et al., 2023; Xu et al., 2021; Ma et al., 2022)	Dosovitskiy, A. et al. (Google Brain)
类型	Domain adaptation + Vision Transformer ensemble	Transfer learning / fine-tuning of attention-based image model
开创性文献	Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., ... & Houlsby, N. (2021). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. International Conference on Learning Representations (ICLR).	Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., Uszkoreit, J., & Houlsby, N. (2021). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. In International Conference on Learning Representations (ICLR 2021).
别名	DA-ViT, Domain Adaptation with Vision Transformer, ViT with Domain Adaptation, Domain-Adaptive ViT	Fine-Tuned ViT, ViT fine-tuning, Vision Transformer transfer learning, ViT downstream adaptation
相关	5	5
摘要	Domain-Adaptive Vision Transformer (DA-ViT) applies domain adaptation techniques — such as adversarial alignment, self-training, or attention-level bridging — on top of a pretrained Vision Transformer backbone to transfer visual knowledge from a labeled source domain to an unlabeled or lightly labeled target domain, reducing the distribution shift that limits standard ViT fine-tuning.	Fine-Tuned Vision Transformer adapts a large pre-trained ViT model — which splits images into fixed-size patches and processes them through self-attention layers — to a new image classification or recognition task using a relatively small labeled dataset. It achieves state-of-the-art accuracy in computer vision by leveraging rich representations learned during large-scale pre-training.