Metodebevisregister

LoRA and PEFT

LoRA (Low-Rank Adaptation), introduced by Hu et al. in 2022, and the broader family of parameter-efficient fine-tuning (PEFT) methods adapt large pretrained language models to new tasks by training only a small number of extra parameters instead of every weight in the model. This makes fine-tuning possible with far less GPU memory and compute while leaving the original model largely untouched.

Sources recorded, not reviewed

Kilderegister

Siteringer kopiert ordrett fra metodens kilderegister. Ingen påstandsnivåverifisering er underforstått fra dem.

Low-Rank Adaptation and Parameter-Efficient Fine-Tuning

Taksonomisk metoderegister · ml-model / deep-learning

Åpne full metode

Kuraterte påstander

Påstander lagret i bevishovedboken, hver med sin egen vurdering.

Ingen kuraterte påstander ennå

Denne visningen finner ikke opp en påstandsvurdering når hovedboken ikke har noen.

Relaterte metoder

Generert fra metodegrafen og vist som maskinforslåtte relasjoner – ingen bevispåstand er underforstått.

Same method familyGenerative Adversarial Networkmachine-suggested · Relational suggestion, not evidence.Same method familyRandom Forestmachine-suggested · Relational suggestion, not evidence.Same method familyVariational Autoencodermachine-suggested · Relational suggestion, not evidence.Same method familyVision Transformermachine-suggested · Relational suggestion, not evidence.Same method familyXGBoostmachine-suggested · Relational suggestion, not evidence.