方法对比

	领域适应	BERT 嵌入	文本分类
领域	文本挖掘	文本挖掘	文本挖掘
方法族	Process / pipeline	Process / pipeline	Process / pipeline
起源年份	—	2019	—
提出者	—	Devlin, Chang, Lee & Toutanova (Google AI)	—
类型	NLP transfer-learning / fine-tuning pipeline	Contextual transformer text-representation method	Supervised NLP classification task
开创性文献	Lee, J. et al. (2020). BioBERT: A Pre-trained Biomedical Language Representation Model. Bioinformatics.	Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. NAACL-HLT, 4171-4186.	Joachims, T. (1998). Text Categorization with Support Vector Machines: Learning with Many Relevant Features. ECML 1998. Lecture Notes in Computer Science, vol 1398. Springer.
别名	Alan Uyarlaması (Domain Adaptation) — NLP, domain adaptation NLP, domain fine-tuning	contextual embeddings, transformer embeddings, BERT Tabanlı Metin Gömülmeleri	text categorization, document classification, topic classification, metin sınıflandırma
相关	4	4	4
摘要	Domain adaptation is a natural-language-processing technique that takes a general pretrained language model and fine-tunes it on target-domain data so that it performs better in specialised fields such as medicine, law, and finance. It builds on the transfer-learning ideas behind work like Blitzer et al. (2007) on cross-domain sentiment classification and Lee et al. (2020) on the biomedical BioBERT model.	BERT-based text embeddings, introduced by Devlin and colleagues at Google AI in 2019, turn text into context-sensitive dense vectors using a bidirectional Transformer encoder. Because the meaning of a word shifts with its context, BERT produces richer representations than static methods such as Word2Vec or topic models like LDA.	Text classification, also called text categorization, is a supervised natural-language-processing task that automatically assigns documents to predefined categories. Building on the support-vector-machine approach to text categorization established by Joachims (1998) and consolidated in the text-mining literature by Aggarwal and Zhai (2012), it powers tasks such as spam detection and topic classification by learning from labelled examples.