ScholarGate
Asystent

Porównaj metody

Przeglądaj wybrane metody obok siebie; wiersze, które się różnią, są wyróżnione.

Dostrojone osadzenia zdań×Dostrojony Transformer×
DziedzinaUczenie głębokieUczenie głębokie
RodzinaMachine learningMachine learning
Rok powstania20192017–2019
TwórcaReimers, N. & Gurevych, I.Vaswani et al. (architecture); fine-tuning paradigm popularised by Howard & Ruder, Devlin et al.
TypSupervised / contrastive fine-tuning of pre-trained sentence encodersTransfer learning / supervised fine-tuning
Źródło pierwotneReimers, N., & Gurevych, I. (2019). Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing (EMNLP), 3982–3992. DOI ↗Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30. link ↗
Inne nazwySBERT fine-tuning, sentence transformer fine-tuning, domain-adapted sentence embeddings, fine-tuned sentence encodersTransformer fine-tuning, pre-trained transformer fine-tuning, task-adaptive transformer, downstream-tuned transformer
Pokrewne54
PodsumowanieFine-Tuned Sentence Embeddings adapt a general-purpose pre-trained sentence encoder — such as Sentence-BERT — to a specific domain or task by continuing training on labeled or paired text data from that domain. The resulting embeddings capture domain-specific semantic structure far better than off-the-shelf vectors, improving downstream tasks such as semantic similarity, clustering, classification, and retrieval.Fine-tuning a Transformer adapts a large pre-trained model — such as BERT, GPT, or ViT — to a specific downstream task by continuing gradient-based training on a labelled target dataset. This two-stage paradigm (pre-train then fine-tune) consistently achieves state-of-the-art results across NLP and computer vision tasks with far less task-specific data than training from scratch.
ScholarGateZbiór danych
  1. v1
  2. 2 Źródła
  3. PUBLISHED
  1. v1
  2. 2 Źródła
  3. PUBLISHED

Przejdź do wyszukiwania Pobierz slajdy

ScholarGatePorównaj metody: Fine-Tuned Sentence Embeddings · Fine-Tuned Transformer. Pobrano 2026-06-19 z https://scholargate.app/pl/compare