Сравнение на методи

	BERT Embeddings	Попълване на слотове
Област	Извличане на текст	Извличане на текст
Семейство	Process / pipeline	Process / pipeline
Година на възникване	2019	2018 (joint slot-gate model); BIO tagging foundations earlier
Създател	Devlin, Chang, Lee & Toutanova (Google AI)	Established via NER/IOB tagging literature; popularised for dialogue by Goo et al. (2018) and Chen et al. (2019)
Тип	Contextual transformer text-representation method	NLP token-classification / information-extraction task
Основополагащ източник	Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. NAACL-HLT, 4171-4186.	Goo, C.W., Gao, G., Hsu, Y.K., Huo, C.L., Chen, T.C., Hsu, S.C., & Chen, Y.N. (2018). Slot-Gated Modeling for Joint Slot Filling and Intent Prediction. Proceedings of NAACL-HLT 2018.
Други названия	contextual embeddings, transformer embeddings, BERT Tabanlı Metin Gömülmeleri	slot doldurma, Slot Doldurma (Slot Filling / NER-NLU), information slot extraction, dialogue slot filling
Свързани	4	5
Резюме	BERT-based text embeddings, introduced by Devlin and colleagues at Google AI in 2019, turn text into context-sensitive dense vectors using a bidirectional Transformer encoder. Because the meaning of a word shifts with its context, BERT produces richer representations than static methods such as Word2Vec or topic models like LDA.	Slot filling is a natural-language-understanding task that extracts predefined template fields — such as date, location, or product name — from a user utterance. It emerged as a core component of dialogue systems and form-based information extraction, and became widely studied after Goo et al. (2018) introduced the Slot-Gated Model for joint slot filling and intent prediction, followed by Chen et al. (2019) who extended the paradigm with BERT-based joint modelling.