手法を比較

	BERT埋め込み	スロット充填
分野	テキストマイニング	テキストマイニング
系統	Process / pipeline	Process / pipeline
提唱年	2019	2018 (joint slot-gate model); BIO tagging foundations earlier
提唱者	Devlin, Chang, Lee & Toutanova (Google AI)	Established via NER/IOB tagging literature; popularised for dialogue by Goo et al. (2018) and Chen et al. (2019)
種類	Contextual transformer text-representation method	NLP token-classification / information-extraction task
原典	Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. NAACL-HLT, 4171-4186.	Goo, C.W., Gao, G., Hsu, Y.K., Huo, C.L., Chen, T.C., Hsu, S.C., & Chen, Y.N. (2018). Slot-Gated Modeling for Joint Slot Filling and Intent Prediction. Proceedings of NAACL-HLT 2018.
別名	contextual embeddings, transformer embeddings, BERT Tabanlı Metin Gömülmeleri	slot doldurma, Slot Doldurma (Slot Filling / NER-NLU), information slot extraction, dialogue slot filling
関連	4	5
概要	BERT-based text embeddings, introduced by Devlin and colleagues at Google AI in 2019, turn text into context-sensitive dense vectors using a bidirectional Transformer encoder. Because the meaning of a word shifts with its context, BERT produces richer representations than static methods such as Word2Vec or topic models like LDA.	Slot filling is a natural-language-understanding task that extracts predefined template fields — such as date, location, or product name — from a user utterance. It emerged as a core component of dialogue systems and form-based information extraction, and became widely studied after Goo et al. (2018) introduced the Slot-Gated Model for joint slot filling and intent prediction, followed by Chen et al. (2019) who extended the paradigm with BERT-based joint modelling.