ScholarGate
Asistente

Comparar métodos

Revisa los métodos seleccionados uno junto a otro; las filas que difieren aparecen resaltadas.

Perceptrón Multicapa Sintonizado×Transformer Ajustado Finamente×
CampoAprendizaje profundoAprendizaje profundo
FamiliaMachine learningMachine learning
Año de origen1986 (MLP); fine-tuning practice formalised c. 20142017–2019
Autor originalRumelhart, Hinton & Williams (MLP); Yosinski et al. (fine-tuning analysis)Vaswani et al. (architecture); fine-tuning paradigm popularised by Howard & Ruder, Devlin et al.
TipoSupervised deep learning with pre-trained weight initialisationTransfer learning / supervised fine-tuning
Fuente seminalRumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986). Learning representations by back-propagating errors. Nature, 323, 533–536. DOI ↗Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., & Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, 30. link ↗
Aliasfine-tuned MLP, adapted MLP, domain-adapted multilayer perceptron, MLP fine-tuningTransformer fine-tuning, pre-trained transformer fine-tuning, task-adaptive transformer, downstream-tuned transformer
Relacionados44
ResumenA Fine-Tuned Multilayer Perceptron starts from weights learned on a source task — or a large general-purpose dataset — and continues training on a smaller target dataset with a reduced learning rate. This reuse of pre-learned representations allows the MLP to converge faster and generalise better than training from scratch, especially when labelled target data is scarce.Fine-tuning a Transformer adapts a large pre-trained model — such as BERT, GPT, or ViT — to a specific downstream task by continuing gradient-based training on a labelled target dataset. This two-stage paradigm (pre-train then fine-tune) consistently achieves state-of-the-art results across NLP and computer vision tasks with far less task-specific data than training from scratch.
ScholarGateConjunto de datos
  1. v1
  2. 2 Fuentes
  3. PUBLISHED
  1. v1
  2. 2 Fuentes
  3. PUBLISHED

Ir a la búsqueda Descargar diapositivas

ScholarGateComparar métodos: Fine-Tuned Multilayer Perceptron · Fine-Tuned Transformer. Recuperado el 2026-06-19 de https://scholargate.app/es/compare