Porównaj metody
Przeglądaj wybrane metody obok siebie; wiersze, które się różnią, są wyróżnione.
| Uzupełnianie tekstu× | Osadzenia BERT× | |
|---|---|---|
| Dziedzina | Eksploracja tekstu | Eksploracja tekstu |
| Rodzina | Process / pipeline | Process / pipeline |
| Rok powstania≠ | 1953 (cloze); 2019 (neural span infilling) | 2019 |
| Twórca≠ | Wilson L. Taylor (cloze procedure, 1953); modern span infilling by Zhu et al. (2019) | Devlin, Chang, Lee & Toutanova (Google AI) |
| Typ≠ | NLP conditional text generation task | Contextual transformer text-representation method |
| Źródło pierwotne≠ | Taylor, W.L. (1953). Cloze Procedure: A New Tool for Measuring Readability. Journalism Quarterly, 30(4), 415-433. link ↗ | Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. NAACL-HLT, 4171-4186. DOI ↗ |
| Inne nazwy≠ | cloze procedure, cloze test, masked language modeling, span infilling | contextual embeddings, transformer embeddings, BERT Tabanlı Metin Gömülmeleri |
| Pokrewne | 4 | 4 |
| Podsumowanie≠ | Text infilling is a natural-language-processing task that completes missing words, phrases, or spans in a document by exploiting the surrounding context. Introduced as the cloze procedure by Wilson L. Taylor in 1953 as a readability measure, it was reformulated for neural models by Zhu et al. (2019) and is now used for data augmentation, writing assistance, and language-model evaluation. | BERT-based text embeddings, introduced by Devlin and colleagues at Google AI in 2019, turn text into context-sensitive dense vectors using a bidirectional Transformer encoder. Because the meaning of a word shifts with its context, BERT produces richer representations than static methods such as Word2Vec or topic models like LDA. |
| ScholarGateZbiór danych ↗ |
|
|