手法を比較
選択した手法を並べて確認できます。異なる行はハイライト表示されます。
| BERT埋め込み× | コロケーション分析× | |
|---|---|---|
| 分野 | テキストマイニング | テキストマイニング |
| 系統 | Process / pipeline | Process / pipeline |
| 提唱年≠ | 2019 | 1990 |
| 提唱者≠ | Devlin, Chang, Lee & Toutanova (Google AI) | Church & Hanks |
| 種類≠ | Contextual transformer text-representation method | Statistical text-mining technique |
| 原典≠ | Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. NAACL-HLT, 4171-4186. DOI ↗ | Church, K.W. & Hanks, P. (1990). Word Association Norms, Mutual Information, and Lexicography. Computational Linguistics, 16(1), 22-29. link ↗ |
| 別名 | contextual embeddings, transformer embeddings, BERT Tabanlı Metin Gömülmeleri | word association, collocation extraction, Birliktelik Analizi (Collocation Analysis) |
| 関連≠ | 4 | 3 |
| 概要≠ | BERT-based text embeddings, introduced by Devlin and colleagues at Google AI in 2019, turn text into context-sensitive dense vectors using a bidirectional Transformer encoder. Because the meaning of a word shifts with its context, BERT produces richer representations than static methods such as Word2Vec or topic models like LDA. | Collocation analysis is a statistical text-mining technique that identifies word pairs or expressions that frequently occur together, using association measures rather than chance co-occurrence. Introduced in the lexicography work of Church and Hanks (1990), it is used for terminology extraction and language analysis, surfacing the multi-word units that carry meaning in a corpus. |
| ScholarGateデータセット ↗ |
|
|