Rukia hadi maudhuiScholarGate
MaktabaMaktaba yanguDawatiReview StudioMsaidizi
Ingia
Semi-supervised Transformer/Ushahidi
Rekodi ya ushahidi wa mbinu

Semi-supervised Transformer

Semi-supervised learning with Transformer architectures leverages large quantities of unlabeled data alongside a small labeled set to train powerful sequence models. The dominant pattern — exemplified by BERT — first pre-trains the Transformer on unlabeled data using self-supervised objectives such as masked token prediction, then fine-tunes it on the labeled task. This two-stage approach dramatically reduces the labeled data needed to achieve strong performance.

Sources recorded, not reviewed

Rekodi ya chanzo

Nukuu zimehamishwa kwa uhalisi kutoka kwa rekodi ya chanzo cha mbinu. Hakuna uthibitisho wa kiwango cha dai unaodokezwa kutoka kwao.

Semi-supervised Learning with Transformer Architectures
Rekodi ya mbinu ya kiajenda · ml-model / deep-learning
  • Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of NAACL-HLT 2019, 4171–4186. · DOI 10.18653/v1/N19-1423
  • Zoph, B., Ghiasi, G., Lin, T.-Y., Cui, Y., Liu, H., Cubuk, E. D., & Le, Q. V. (2020). Rethinking Pre-training and Self-training. Advances in Neural Information Processing Systems (NeurIPS), 33, 3833–3845. · URL
Fungua mbinu kamili

Madai yaliyotunzwa

Madai yamehifadhiwa katika daftari la ushahidi, kila moja ikiwa na tathmini yake.

Hakuna madai yaliyotunzwa bado

Mwonekano huu haubuni tathmini ya dai wakati daftari haina yoyote.

Mbinu zinazohusiana

Zilizotengenezwa kutoka kwa grafu ya mbinu na kuonyeshwa kama uhusiano uliopendekezwa na mashine — hakuna dai la ushahidi linalodokezwa.

Taxonomic bucketBERT-based Classificationmachine-suggested · Relational suggestion, not evidence.Taxonomic bucketFine-Tuned Transformermachine-suggested · Relational suggestion, not evidence.Taxonomic bucketRoBERTa-based Classificationmachine-suggested · Relational suggestion, not evidence.Taxonomic bucketSelf-supervised Transformermachine-suggested · Relational suggestion, not evidence.Taxonomic bucketSemi-supervised Convolutional Neural Networkmachine-suggested · Relational suggestion, not evidence.

Hali ya ushahidi

Sources recorded, not reviewed

Bibliographic sources are present. Claim-level evidence review has not been performed.

Vyanzo

2 nukuu zilizorekodiwa, ziliyonakiliwa kutoka kwa rekodi ya chanzo cha mbinu.

Vitendo

Fungua ukurasa wa mbinu
ScholarGate

Maktaba ya marejeleo inayotanguliza maudhui kwa mbinu za utafiti — kila moja ni nini, inavyofanya kazi, na inakotoka.

Data huria (CC-BY)

Gundua

  • Maktaba
  • Tafuta mbinu…
  • Vinjari kwa nyanja
  • Nyanja
  • Safari
  • Linganisha
  • Mbinu ipi?

Marejeo

  • Taaluma
  • Atlas
  • Kamusi ya istilahi
  • Mbinu
  • Falsafa

Eneo la kazi

  • Maktaba yangu
  • Dawati
  • Gumzo

Kampuni

  • Kuhusu
  • Bei
  • Wasiliana nasi
  • Pendekeza mbinu

Maingizo yamekusanywa kutoka vyanzo vilivyochapishwa kwa madhumuni ya marejeo. Kuthibitisha usahihi na ufaafu wa taarifa yoyote kwa matumizi yako mwenyewe kunabaki kuwa jukumu lako.

© 2026 ScholarGate · Maktaba ya marejeleo ya mbinu za utafiti
  • Faragha
  • Vidakuzi
  • Masharti
  • Futa akaunti