Machine learningDeep learning / NLP / CV

Uainishaji wa BERT unaobadilika kulingana na kikoa

Uainishaji wa BERT unaobadilika kulingana na kikoa unapanua mchakato wa kawaida wa urekebishaji kwa kwanza kuendeleza mafunzo ya awali ya mtindo wa lugha uliositirika (masked-language-model) wa BERT kwenye hifadhi kubwa ya maandishi yasiyo na lebo ya kikoa husika, kisha kurekebisha mtindo uliorekebishwa kwa mifano yenye lebo kwa ajili ya kazi lengwa ya uainishaji. Mbinu hii ya hatua mbili hufunga pengo la msamiati na usambazaji kati ya hifadhi ya mafunzo ya awali ya jumla ya BERT na kikoa maalum kama vile biolojia, sheria, fedha, au maandishi ya mitandao ya kijamii.

Fungua katika MethodMindHivi karibuniVideoHivi karibuniDownload slides

Soma mbinu kamili

Kwa wanachama pekee

Ingia kwa akaunti ya bure ili kusoma sehemu hii.

Ingia

Method map

The neighbourhood of related methods — select a node to explore.

Uainishaji wa BERT unaobadilika kulingana na kikoa

Uainishaji unaotumia BERT Transformer zinazobadili…Uainishaji wa BERT Uliob…Uainishaji unaotegemea R…Sentence Embeddings (Vib…Mafunzo ya Uhamisho kwa…Doc2Vec inayobadilika na…Utambuzi wa Jina la Eneo…Kujibu Maswali Kwa Ureke…Mrejesho wa akili bandia…

+4 more

Vyanzo

Gururangan, S., Marasovic, A., Swayamdipta, S., Lo, K., Beltagy, I., Downey, D., & Smith, N. A. (2020). Don't Stop Pretraining: Adapt Language Models to Domains and Tasks. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (ACL 2020), 8342–8360. DOI: 10.18653/v1/2020.acl-main.740 ↗
Lee, J., Yoon, W., Kim, S., Kim, D., Kim, S., So, C. H., & Kang, J. (2020). BioBERT: a pre-trained biomedical language representation model for biomedical text mining. Bioinformatics, 36(4), 1234–1240. DOI: 10.1093/bioinformatics/btz682 ↗

Jinsi ya kunukuu ukurasa huu

ScholarGate. (2026, June 3). Domain-Adaptive Pre-training with BERT for Text Classification. ScholarGate. https://scholargate.app/sw/deep-learning/domain-adaptive-bert-based-classification

Which method?

Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.

Uainishaji unaotumia BERTUjifunzaji wa Kina↔ compare
Transformer zinazobadilika na dhima (Domain-Adaptive Transformer - DAT)Ujifunzaji wa Kina↔ compare
Uainishaji wa BERT UlioboreshwaUjifunzaji wa Kina↔ compare
Uainishaji unaotegemea RoBERTaUjifunzaji wa Kina↔ compare
Sentence Embeddings (Vibandiko vya Sentensi)Ujifunzaji wa Kina↔ compare
Mafunzo ya Uhamisho kwa Uainishaji unaotumia BERTUjifunzaji wa Kina↔ compare

Compare side by side →

Imerejelewa na

Doc2Vec inayobadilika na domaini Utambuzi wa Jina la Eneo-lililobadilishwa Kujibu Maswali Kwa Urekebishaji wa Kikoa Mrejesho wa akili bandia wa akili bandia unaobadilika na kikoa Uainishaji wa RoBERTa unaojirekebisha Kikoa Muhtasari wa Muktadha-Ubadilifu Transformer wa Maono unaobadilika na Kikoa Uainishaji unaotegemea usimamizi dhaifu wa BERT

Umeona tatizo kwenye ukurasa huu? Ripoti au pendekeza marekebisho →