Domain-adaptive transformer
A Domain-Adaptive Transformer (DAT) is a Transformer-based model — such as BERT or ViT — extended with an explicit domain-alignment objective so that learned representations transfer well from a labeled source domain to a different, often unlabeled, target domain. The approach combines the powerful representation capacity of Transformers with domain adaptation techniques such as adversarial training or contrastive alignment to minimise domain shift.
Source record
Citations copied verbatim from the method’s source record. No claim-level verification is inferred from them.
- Ni, J., Hernandez Abrego, G., Constant, N., Ma, J., Hall, K., Cer, D., & Yang, Y. (2021). Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models. Findings of ACL 2022. arXiv:2108.08877. · URL
- Guo, J., Shah, D., & Barzilay, R. (2022). Multi-Source Domain Adaptation with Mixture of Experts. In Proceedings of EMNLP 2018. arXiv:1809.02060. · URL
Curated claims
Claims persisted in the evidence ledger, each with its own assessment.
This view does not invent a claim assessment when the ledger has none.
Related methods
Generated from the method graph and shown as machine-suggested relations — no evidence claim is inferred.