Machine learningDeep learning / NLP / CV
Transfer Learning with Sentence Embeddings
Transfer Learning with Sentence Embeddings takes a large pre-trained encoder — such as Sentence-BERT or the Universal Sentence Encoder — that already encodes general language knowledge into fixed-length vectors, and adapts it to a new task or domain with little additional labelled data. The pre-trained representations give a head start that often outperforms task-specific models trained from scratch on modest corpora.
Open in MethodMindSoonVideoSoon
Read the full method
Members only
Sign inSign in with a free account to read this section.
Sources
- Reimers, N. & Gurevych, I. (2019). Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing (EMNLP), 3982–3992. link ↗
- Conneau, A., Kiela, D., Schwentz, H., Barrault, L. & Bordes, A. (2017). Supervised Learning of Universal Sentence Representations from Natural Language Inference Data. Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP), 670–680. link ↗