ScholarGate
Asisten

Bandingkan metode

Tinjau metode pilihan Anda berdampingan; baris yang berbeda akan disorot.

Transformer Adaptif Domain×Vision Transformer×
BidangPembelajaran MendalamPembelajaran Mendalam
KeluargaMachine learningMachine learning
Tahun asal2019–20222021
PencetusVarious (Vaswani et al. 2017 for Transformers; domain adaptation extensions emerged 2019–2022)Dosovitskiy, A. et al.
TipePre-trained model fine-tuned with domain-shift adaptationTransformer architecture for images (self-attention over patches)
Sumber perintisNi, J., Hernandez Abrego, G., Constant, N., Ma, J., Hall, K., Cer, D., & Yang, Y. (2021). Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models. Findings of ACL 2022. arXiv:2108.08877. link ↗Dosovitskiy, A. et al. (2021). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. ICLR. link ↗
AliasDAT, domain-adaptive Transformer, domain adaptation with Transformers, transfer-learning TransformerGörsel Transformer (ViT), görsel transformer, ViT, patch transformer for images
Terkait25
RingkasanA Domain-Adaptive Transformer (DAT) is a Transformer-based model — such as BERT or ViT — extended with an explicit domain-alignment objective so that learned representations transfer well from a labeled source domain to a different, often unlabeled, target domain. The approach combines the powerful representation capacity of Transformers with domain adaptation techniques such as adversarial training or contrastive alignment to minimise domain shift.The Vision Transformer (ViT), introduced by Dosovitskiy and colleagues in 2021, splits an image into fixed-size patches, treats those patches as a sequence, and applies the Transformer self-attention mechanism to image classification. Given enough training data, it surpasses convolutional neural networks (CNNs).
ScholarGateSet data
  1. v1
  2. 2 Sumber
  3. PUBLISHED
  1. v1
  2. 2 Sumber
  3. PUBLISHED

Ke halaman pencarian Unduh salindia

ScholarGateBandingkan metode: Domain-adaptive transformer · Vision Transformer. Diakses 2026-06-19 dari https://scholargate.app/id/compare