手法を比較

	Text Infilling	BERT埋め込み
分野	テキストマイニング	テキストマイニング
系統	Process / pipeline	Process / pipeline
提唱年	1953 (cloze); 2019 (neural span infilling)	2019
提唱者	Wilson L. Taylor (cloze procedure, 1953); modern span infilling by Zhu et al. (2019)	Devlin, Chang, Lee & Toutanova (Google AI)
種類	NLP conditional text generation task	Contextual transformer text-representation method
原典	Taylor, W.L. (1953). Cloze Procedure: A New Tool for Measuring Readability. Journalism Quarterly, 30(4), 415-433.	Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. NAACL-HLT, 4171-4186.
別名	cloze procedure, cloze test, masked language modeling, span infilling	contextual embeddings, transformer embeddings, BERT Tabanlı Metin Gömülmeleri
関連	4	4
概要	Text infilling is a natural-language-processing task that completes missing words, phrases, or spans in a document by exploiting the surrounding context. Introduced as the cloze procedure by Wilson L. Taylor in 1953 as a readability measure, it was reformulated for neural models by Zhu et al. (2019) and is now used for data augmentation, writing assistance, and language-model evaluation.	BERT-based text embeddings, introduced by Devlin and colleagues at Google AI in 2019, turn text into context-sensitive dense vectors using a bidirectional Transformer encoder. Because the meaning of a word shifts with its context, BERT produces richer representations than static methods such as Word2Vec or topic models like LDA.