Rekodi ya ushahidi wa mbinu

Self-supervised Transformer

A self-supervised Transformer is a Transformer network pretrained using automatically constructed supervision signals — such as masked token prediction or next-sentence prediction — rather than human-annotated labels. The resulting representations are then fine-tuned or probed on downstream tasks. BERT, GPT, and ViT (Vision Transformer in masked-image modeling mode) are the most widely known instantiations of this paradigm.

Sources recorded, not reviewed

Rekodi ya chanzo

Nukuu zimehamishwa kwa uhalisi kutoka kwa rekodi ya chanzo cha mbinu. Hakuna uthibitisho wa kiwango cha dai unaodokezwa kutoka kwao.

Self-supervised Transformer (Pretraining with Self-generated Supervision)

Rekodi ya mbinu ya kiajenda · ml-model / deep-learning

Fungua mbinu kamili

Madai yaliyotunzwa

Madai yamehifadhiwa katika daftari la ushahidi, kila moja ikiwa na tathmini yake.

Hakuna madai yaliyotunzwa bado

Mwonekano huu haubuni tathmini ya dai wakati daftari haina yoyote.

Mbinu zinazohusiana

Zilizotengenezwa kutoka kwa grafu ya mbinu na kuonyeshwa kama uhusiano uliopendekezwa na mashine — hakuna dai la ushahidi linalodokezwa.

Taxonomic bucketBERT-based Classificationmachine-suggested · Relational suggestion, not evidence.Taxonomic bucketFine-Tuned Transformermachine-suggested · Relational suggestion, not evidence.Taxonomic bucketRoBERTa-based Classificationmachine-suggested · Relational suggestion, not evidence.Taxonomic bucketSelf-supervised convolutional neural networkmachine-suggested · Relational suggestion, not evidence.Taxonomic bucketSentence Embeddingsmachine-suggested · Relational suggestion, not evidence.