手法を比較
選択した手法を並べて確認できます。異なる行はハイライト表示されます。
| BERT埋め込み× | トピックモデリング× | |
|---|---|---|
| 分野≠ | テキストマイニング | 深層学習 |
| 系統≠ | Process / pipeline | Machine learning |
| 提唱年≠ | 2019 | 1999–2003 |
| 提唱者≠ | Devlin, Chang, Lee & Toutanova (Google AI) | Hofmann, T. (pLSA, 1999); Blei, D. M., Ng, A. Y., & Jordan, M. I. (LDA, 2003) |
| 種類≠ | Contextual transformer text-representation method | Unsupervised generative probabilistic model |
| 原典≠ | Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. NAACL-HLT, 4171-4186. DOI ↗ | Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent Dirichlet Allocation. Journal of Machine Learning Research, 3, 993–1022. link ↗ |
| 別名≠ | contextual embeddings, transformer embeddings, BERT Tabanlı Metin Gömülmeleri | Latent Semantic Analysis, probabilistic topic modeling, topic discovery, thematic modeling |
| 関連≠ | 4 | 5 |
| 概要≠ | BERT-based text embeddings, introduced by Devlin and colleagues at Google AI in 2019, turn text into context-sensitive dense vectors using a bidirectional Transformer encoder. Because the meaning of a word shifts with its context, BERT produces richer representations than static methods such as Word2Vec or topic models like LDA. | Topic Modeling is a family of unsupervised probabilistic techniques for discovering latent thematic structure in large text collections. By learning which words tend to co-occur, models such as Latent Dirichlet Allocation (LDA) automatically surface coherent topics — each represented as a distribution over vocabulary — without requiring labelled data. |
| ScholarGateデータセット ↗ |
|
|