Machine learning

Ufumbuzi wa Maarifa

Ufumbuzi wa Maarifa ni mbinu ya upunguzaji wa modeli, iliyoanzishwa na Geoffrey Hinton na wenzake mwaka 2015, ambayo hufunza modeli ndogo ya mwanafunzi kwa kutumia matokeo ya lebo laini kutoka kwa modeli kubwa ya mwalimu. Modeli zilizofumbuliwa kama vile DistilBERT na TinyBERT hufikia takriban 97% ya utendaji wa modeli kubwa huku zikikimbia kwa kasi zaidi.

Fungua katika MethodMindHivi karibuniVideoHivi karibuniDownload slides

Soma mbinu kamili

Kwa wanachama pekee

Ingia kwa akaunti ya bure ili kusoma sehemu hii.

Ingia

Method map

The neighbourhood of related methods — select a node to explore.

Ufumbuzi wa Maarifa

Longformer / BigBird Mchanganyiko wa Wataalamu Msitu Nasibu Ujifunzaji wa Kulinganis…XGBoost Mtandao wa Vidonge Ujifunzaji Unganishi Una…Federated Learning MobileNet: Mitandao ya M…Kujifunza kwa Kazi Nyingi

+3 more

Vyanzo

Hinton, G., Vinyals, O. & Dean, J. (2015). Distilling the Knowledge in a Neural Network. NeurIPS Deep Learning Workshop. link ↗
Sanh, V., Debut, L., Chaumond, J. & Wolf, T. (2019). DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter. arXiv:1910.01108. link ↗

Jinsi ya kunukuu ukurasa huu

ScholarGate. (2026, June 1). Knowledge Distillation (Teacher–Student Model Compression). ScholarGate. https://scholargate.app/sw/deep-learning/knowledge-distillation

Which method?

Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.

Longformer / BigBirdUjifunzaji wa Kina↔ compare
Mchanganyiko wa WataalamuUjifunzaji wa Kina↔ compare
Msitu NasibuUjifunzaji wa Mashine↔ compare
Ujifunzaji wa Kulinganisha wa KuonaUjifunzaji wa Kina↔ compare
XGBoostUjifunzaji wa Mashine↔ compare

Compare side by side →

Imerejelewa na

Mtandao wa Vidonge Ujifunzaji Unganishi Unaojisimamia (Ensemble Self-supervised Learning)Federated Learning MobileNet: Mitandao ya Mawasiliano ya Kina kwa Maono ya Simu Kujifunza kwa Kazi Nyingi Utafutaji wa Usanifu wa Neural Uainishaji wa Picha kwa Kujisimamia Kigeuzi cha Taswira Kinachosimamiwa Kidogo

Umeona tatizo kwenye ukurasa huu? Ripoti au pendekeza marekebisho →

Soma mbinu kamili

Method map

Vyanzo

Jinsi ya kunukuu ukurasa huu

Mbinu zinazohusiana

Which method?

Imerejelewa na