Võrdle meetodeid
Vaata valitud meetodeid kõrvuti; erinevad read on esile tõstetud.
| BERT-i manused× | Teemamodelleerimine× | |
|---|---|---|
| Valdkond≠ | Tekstikaeve | Süvaõpe |
| Perekond≠ | Process / pipeline | Machine learning |
| Tekkeaasta≠ | 2019 | 1999–2003 |
| Looja≠ | Devlin, Chang, Lee & Toutanova (Google AI) | Hofmann, T. (pLSA, 1999); Blei, D. M., Ng, A. Y., & Jordan, M. I. (LDA, 2003) |
| Tüüp≠ | Contextual transformer text-representation method | Unsupervised generative probabilistic model |
| Algallikas≠ | Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. NAACL-HLT, 4171-4186. DOI ↗ | Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent Dirichlet Allocation. Journal of Machine Learning Research, 3, 993–1022. link ↗ |
| Rööpnimetused≠ | contextual embeddings, transformer embeddings, BERT Tabanlı Metin Gömülmeleri | Latent Semantic Analysis, probabilistic topic modeling, topic discovery, thematic modeling |
| Seotud≠ | 4 | 5 |
| Kokkuvõte≠ | BERT-based text embeddings, introduced by Devlin and colleagues at Google AI in 2019, turn text into context-sensitive dense vectors using a bidirectional Transformer encoder. Because the meaning of a word shifts with its context, BERT produces richer representations than static methods such as Word2Vec or topic models like LDA. | Topic Modeling is a family of unsupervised probabilistic techniques for discovering latent thematic structure in large text collections. By learning which words tend to co-occur, models such as Latent Dirichlet Allocation (LDA) automatically surface coherent topics — each represented as a distribution over vocabulary — without requiring labelled data. |
| ScholarGateAndmestik ↗ |
|
|