ScholarGate
Trợ lý

So sánh phương pháp

Xem các phương pháp đã chọn cạnh nhau; những hàng khác biệt được làm nổi bật.

Học tương phản cho NLP×Học tăng cường tự giám sát×
Lĩnh vựcKhai phá văn bảnHọc máy
HọProcess / pipelineMachine learning
Năm ra đời2020–20212018–2020
Người khởi xướngGao, Yao & Chen (SimCSE, 2021); Khosla et al. (Supervised Contrastive, 2020)LeCun, Y. and community (formalized ~2018–2020)
LoạiSelf-supervised / supervised representation learningRepresentation learning paradigm
Công trình gốcGao, T., Yao, X., & Chen, D. (2021). SimCSE: Simple Contrastive Learning of Sentence Embeddings. Proceedings of EMNLP 2021. link ↗LeCun, Y. & Misra, I. (2022). Self-supervised learning: The dark matter of intelligence. Meta AI Blog. https://ai.facebook.com/blog/self-supervised-learning-the-dark-matter-of-intelligence/ link ↗
Tên gọi khácSimCSE, contrastive sentence embeddings, ContrastiveBERT, Karşıtlık Öğrenmesi — NLP (Contrastive Learning)SSL, self-supervised pre-training, pretext-task learning, unsupervised representation learning
Liên quan43
Tóm tắtContrastive learning for NLP is a representation-learning technique — popularised by SimCSE (Gao et al., 2021) and Supervised Contrastive Learning (Khosla et al., 2020) — that trains a text encoder by pulling embeddings of similar text pairs together while pushing embeddings of dissimilar pairs apart. The result is a dense, high-quality embedding space that can be learned with no labels at all, or with minimal supervision, making it especially valuable when annotated data are scarce.Self-supervised learning (SSL) is a machine-learning paradigm that generates its own supervisory signal directly from unlabeled data by defining an auxiliary pretext task — such as predicting masked words, rotating images, or contrasting augmented views — and uses the learned representations as a powerful starting point for downstream tasks with minimal labeled examples.
ScholarGateBộ dữ liệu
  1. v1
  2. 2 Nguồn tài liệu
  3. PUBLISHED
  1. v1
  2. 2 Nguồn tài liệu
  3. PUBLISHED

Đến trang tìm kiếm Tải xuống bản trình chiếu

ScholarGateSo sánh phương pháp: Contrastive Learning for NLP · Self-supervised Learning. Truy cập ngày 2026-06-15 từ https://scholargate.app/vi/compare