方法对比

	半监督视觉变换器	图像分类
领域	深度学习	深度学习
方法族	Machine learning	Machine learning
起源年份	2021–2022	2012 (deep CNN era); conceptual roots 1989 (LeCun)
提出者	Dosovitskiy et al. (ViT); semi-supervised extensions by multiple groups (2021–2023)	Krizhevsky, A.; Sutskever, I.; Hinton, G. E.
类型	Semi-supervised deep learning for image understanding	Supervised classification task
开创性文献	Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., Uszkoreit, J., & Houlsby, N. (2021). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. International Conference on Learning Representations (ICLR 2021).	Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). ImageNet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems (NeurIPS), 25, 1097–1105.
别名	Semi-supervised ViT, SSL-ViT, Semi-supervised Patch-based Transformer, Semi-supervised Self-Attention Image Model	visual classification, image recognition, CNN-based classification, visual categorization
相关	6	5
摘要	Semi-supervised Vision Transformer applies the patch-based self-attention architecture of ViT to settings where only a fraction of images are labeled, exploiting large unlabeled corpora through pseudo-labeling, consistency regularization, or self-supervised pretext tasks before fine-tuning on the small labeled set. This approach achieves near-supervised accuracy even when labeled images are scarce.	Image classification is the task of assigning a single semantic label to an entire image from a fixed set of categories. Modern approaches rely on deep convolutional neural networks (CNNs) or Vision Transformers (ViTs) trained end-to-end on large labeled datasets such as ImageNet, achieving superhuman accuracy on many benchmarks and underpinning applications from medical imaging to autonomous vehicles.