So sánh phương pháp
Xem các phương pháp đã chọn cạnh nhau; những hàng khác biệt được làm nổi bật.
| Nhúng câu giám sát yếu× | Nhúng câu tự giám sát× | |
|---|---|---|
| Lĩnh vực | Học sâu | Học sâu |
| Họ | Machine learning | Machine learning |
| Năm ra đời≠ | 2016–2019 | 2019–2021 |
| Người khởi xướng≠ | Ratner et al. (weak supervision framework); Reimers & Gurevych (sentence embeddings) | Gao, T., Yao, X., & Chen, D. (SimCSE); Reimers, N. & Gurevych, I. (Sentence-BERT) |
| Loại≠ | Representation learning under weak supervision | Self-supervised representation learning |
| Công trình gốc≠ | Ratner, A., De Sa, C., Wu, S., Selsam, D., & Re, C. (2016). Data Programming: Creating Large Training Sets, Quickly. Advances in Neural Information Processing Systems (NeurIPS), 29. link ↗ | Gao, T., Yao, X., & Chen, D. (2021). SimCSE: Simple Contrastive Learning of Sentence Embeddings. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 6894–6910. DOI ↗ |
| Tên gọi khác | WS sentence embeddings, noisy-label sentence representation learning, weakly supervised sentence representation, distant-supervision sentence embeddings | self-supervised sentence representation learning, contrastive sentence embeddings, SimCSE, unsupervised sentence encoders |
| Liên quan≠ | 6 | 5 |
| Tóm tắt≠ | Weakly supervised sentence embeddings train dense sentence representations using noisy, heuristic, or programmatically generated labels instead of costly human annotation. Labeling functions — rules, distant supervision signals, or lightweight classifiers — supply approximate supervision that a label model aggregates into probabilistic labels, which then guide the sentence encoder to produce task-useful representations at scale. | Self-supervised sentence embeddings train a neural encoder to map sentences into a dense vector space without requiring manually labeled pairs. By constructing positive examples automatically — for instance by passing the same sentence through dropout twice — and using contrastive objectives, the model learns semantically rich representations that transfer well to similarity, retrieval, and classification tasks. |
| ScholarGateBộ dữ liệu ↗ |
|
|