Machine learningDeep learning / NLP / CV
BERT-based Classification
BERT-based Classification fine-tunes Google's Bidirectional Encoder Representations from Transformers model on a labelled text dataset, replacing the generic pre-trained head with a task-specific classification layer. It exploits deep bidirectional context from hundreds of millions of pre-trained parameters to deliver state-of-the-art accuracy on short- and medium-length text classification tasks with relatively modest amounts of labelled data.
MethodMind'de açSoonVideoSoon
Tam yöntemi oku
Members only
Sign inSign in with a free account to read this section.
Sources
- Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of NAACL-HLT 2019 (pp. 4171–4186). Association for Computational Linguistics. DOI: 10.18653/v1/N19-1423 ↗
- Sun, C., Qiu, X., Xu, Y., & Huang, X. (2019). How to Fine-Tune BERT for Text Classification? In China National Conference on Chinese Computational Linguistics (CCL 2019), Lecture Notes in Computer Science, vol 11856, pp. 194–206. Springer. DOI: 10.1007/978-3-030-32381-3_16 ↗
Related methods
Referenced by
Domain-adaptive BERT-based ClassificationDomain-adaptive Named Entity RecognitionDomain-adaptive Question AnsweringDomain-adaptive RoBERTa-based ClassificationDomain-adaptive sentence embeddingsDomain-adaptive Sentiment AnalysisDomain-adaptive Text SummarizationExplainable BERT-based ClassificationExplainable Named Entity RecognitionExplainable Question AnsweringExplainable RoBERTa-based ClassificationExplainable Sentence EmbeddingsExplainable Sentiment AnalysisExplainable Topic ModelingExplainable TransformerFine-Tuned BERT-based ClassificationFine-Tuned Doc2VecFine-Tuned LSTMFine-Tuned Named Entity RecognitionFine-Tuned Question AnsweringFine-Tuned RoBERTa-based ClassificationFine-Tuned Sentence EmbeddingsFine-Tuned Text SummarizationFine-Tuned Topic ModelingFine-Tuned TransformerFine-Tuned Vision TransformerFine-Tuned Word2VecGated Recurrent UnitLDA Topic ModelLong Short-Term MemoryMultilingual question answeringMultilingual RoBERTa-based ClassificationMultilingual Sentence EmbeddingsMultilingual Sentiment AnalysisMultilingual TransformerMultimodal Named Entity RecognitionMultimodal question answeringMultimodal RoBERTa-based ClassificationMultimodal Text SummarizationMultimodal TransformerMultimodal Vision TransformerNMF Topic ModelRecurrent Neural NetworkRoBERTa-based ClassificationSelf-supervised LDA Topic ModelSelf-supervised Sentence EmbeddingsSelf-supervised topic modelingSelf-supervised TransformerSemi-supervised BERT-based ClassificationSemi-supervised LDA Topic ModelSemi-supervised Question AnsweringSemi-supervised RoBERTa-based ClassificationSemi-supervised Sentence EmbeddingsSemi-supervised Sentiment AnalysisSemi-supervised TransformerSentence EmbeddingsTopic ModelingTransfer Learning with BERT-based ClassificationTransfer Learning with LSTMTransfer Learning with Named Entity RecognitionTransfer Learning with Sentence EmbeddingsTransfer Learning with Text SummarizationTransfer Learning with Topic ModelingWeakly supervised BERT-based classificationWeakly supervised question answeringWeakly Supervised RoBERTa-based ClassificationWeakly supervised sentence embeddingsWeakly Supervised Topic ModelingWeakly supervised transformerWeakly supervised Word2Vec