Usporedite metode
Pregledajte odabrane metode jednu uz drugu; retci koji se razlikuju su istaknuti.
| Slabo nadzirani ugradci rečenica× | Samonadzorovani ugrađeni slojevi za rečenice× | |
|---|---|---|
| Područje | Duboko učenje | Duboko učenje |
| Obitelj | Machine learning | Machine learning |
| Godina nastanka≠ | 2016–2019 | 2019–2021 |
| Tvorac≠ | Ratner et al. (weak supervision framework); Reimers & Gurevych (sentence embeddings) | Gao, T., Yao, X., & Chen, D. (SimCSE); Reimers, N. & Gurevych, I. (Sentence-BERT) |
| Vrsta≠ | Representation learning under weak supervision | Self-supervised representation learning |
| Temeljni izvor≠ | Ratner, A., De Sa, C., Wu, S., Selsam, D., & Re, C. (2016). Data Programming: Creating Large Training Sets, Quickly. Advances in Neural Information Processing Systems (NeurIPS), 29. link ↗ | Gao, T., Yao, X., & Chen, D. (2021). SimCSE: Simple Contrastive Learning of Sentence Embeddings. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 6894–6910. DOI ↗ |
| Drugi nazivi | WS sentence embeddings, noisy-label sentence representation learning, weakly supervised sentence representation, distant-supervision sentence embeddings | self-supervised sentence representation learning, contrastive sentence embeddings, SimCSE, unsupervised sentence encoders |
| Srodne≠ | 6 | 5 |
| Sažetak≠ | Weakly supervised sentence embeddings train dense sentence representations using noisy, heuristic, or programmatically generated labels instead of costly human annotation. Labeling functions — rules, distant supervision signals, or lightweight classifiers — supply approximate supervision that a label model aggregates into probabilistic labels, which then guide the sentence encoder to produce task-useful representations at scale. | Self-supervised sentence embeddings train a neural encoder to map sentences into a dense vector space without requiring manually labeled pairs. By constructing positive examples automatically — for instance by passing the same sentence through dropout twice — and using contrastive objectives, the model learns semantically rich representations that transfer well to similarity, retrieval, and classification tasks. |
| ScholarGateSkup podataka ↗ |
|
|