ScholarGate
Assistant

Comparer des méthodes

Examinez les méthodes sélectionnées côte à côte ; les lignes qui diffèrent sont mises en évidence.

Transformeur à adaptation de domaine×Vision Transformer×
DomaineApprentissage profondApprentissage profond
FamilleMachine learningMachine learning
Année d'origine2019–20222021
Auteur d'origineVarious (Vaswani et al. 2017 for Transformers; domain adaptation extensions emerged 2019–2022)Dosovitskiy, A. et al.
TypePre-trained model fine-tuned with domain-shift adaptationTransformer architecture for images (self-attention over patches)
Source fondatriceNi, J., Hernandez Abrego, G., Constant, N., Ma, J., Hall, K., Cer, D., & Yang, Y. (2021). Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models. Findings of ACL 2022. arXiv:2108.08877. link ↗Dosovitskiy, A. et al. (2021). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. ICLR. link ↗
AliasDAT, domain-adaptive Transformer, domain adaptation with Transformers, transfer-learning TransformerGörsel Transformer (ViT), görsel transformer, ViT, patch transformer for images
Apparentées25
RésuméA Domain-Adaptive Transformer (DAT) is a Transformer-based model — such as BERT or ViT — extended with an explicit domain-alignment objective so that learned representations transfer well from a labeled source domain to a different, often unlabeled, target domain. The approach combines the powerful representation capacity of Transformers with domain adaptation techniques such as adversarial training or contrastive alignment to minimise domain shift.The Vision Transformer (ViT), introduced by Dosovitskiy and colleagues in 2021, splits an image into fixed-size patches, treats those patches as a sequence, and applies the Transformer self-attention mechanism to image classification. Given enough training data, it surpasses convolutional neural networks (CNNs).
ScholarGateJeu de données
  1. v1
  2. 2 Sources
  3. PUBLISHED
  1. v1
  2. 2 Sources
  3. PUBLISHED

Aller à la recherche Télécharger les diapositives

ScholarGateComparer des méthodes: Domain-adaptive transformer · Vision Transformer. Consulté le 2026-06-19 sur https://scholargate.app/fr/compare