השוואת שיטות

	טרנספורמר ראייה	מודל דיפוזיה
תחום	למידה עמוקה	למידה עמוקה
משפחה	Machine learning	Machine learning
שנת המקור	2021	2020
הוגה השיטה	Dosovitskiy, A. et al.	Ho, J., Jain, A. & Abbeel, P.
סוג	Transformer architecture for images (self-attention over patches)	Generative deep learning (denoising diffusion)
מקור מכונן	Dosovitskiy, A. et al. (2021). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. ICLR.	Ho, J., Jain, A. & Abbeel, P. (2020). Denoising Diffusion Probabilistic Models. NeurIPS.
כינויים	Görsel Transformer (ViT), görsel transformer, ViT, patch transformer for images	Difüzyon Modeli (DDPM / Stable Diffusion), difüzyon modeli, denoising diffusion model, DDPM
קשורות	5	4
תקציר	The Vision Transformer (ViT), introduced by Dosovitskiy and colleagues in 2021, splits an image into fixed-size patches, treats those patches as a sequence, and applies the Transformer self-attention mechanism to image classification. Given enough training data, it surpasses convolutional neural networks (CNNs).	A diffusion model is a generative deep-learning method, introduced by Ho, Jain and Abbeel in 2020 (DDPM), that learns to produce high-quality images, audio and molecular structures by reversing a step-by-step noising process. It has largely displaced GANs as the current state of the art in generative modelling.