Machine learningDeep learning / NLP / CV

Self-supervised Sentence Embeddings

Self-supervised sentence embeddings train a neural encoder to map sentences into a dense vector space without requiring manually labeled pairs. By constructing positive examples automatically — for instance by passing the same sentence through dropout twice — and using contrastive objectives, the model learns semantically rich representations that transfer well to similarity, retrieval, and classification tasks.

Open in MethodMindSoonVideoSoon

Read the full method

Members only

Sign in with a free account to read this section.

Sign in

Sources

  1. Gao, T., Yao, X., & Chen, D. (2021). SimCSE: Simple Contrastive Learning of Sentence Embeddings. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 6894–6910. DOI: 10.18653/v1/2021.emnlp-main.552
  2. Reimers, N., & Gurevych, I. (2019). Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing (EMNLP), 3982–3992. DOI: 10.18653/v1/D19-1410

Related methods

Referenced by

ScholarGateSelf-supervised Sentence Embeddings (Self-supervised Learning for Sentence Embeddings). Retrieved 2026-06-04 from https://scholargate.app/en/deep-learning/self-supervised-sentence-embeddings