Comparer des méthodes
Examinez les méthodes sélectionnées côte à côte ; les lignes qui diffèrent sont mises en évidence.
| Apprentissage par transfert avec apprentissage par renforcement× | Apprentissage par renforcement affiné× | |
|---|---|---|
| Domaine | Apprentissage profond | Apprentissage profond |
| Famille | Machine learning | Machine learning |
| Année d'origine≠ | 2009 (survey); concept from early 2000s | 2017–2022 |
| Auteur d'origine≠ | Taylor, M. E. & Stone, P. | Christiano, P. et al.; Ouyang, L. et al. |
| Type≠ | Transfer learning paradigm for sequential decision-making | Policy adaptation via fine-tuning |
| Source fondatrice≠ | Taylor, M. E., & Stone, P. (2009). Transfer Learning for Reinforcement Learning Domains: A Survey. Journal of Machine Learning Research, 10, 1633–1685. link ↗ | Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R. (2022). Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, 35, 27730–27744. link ↗ |
| Alias | Transfer RL, TL for RL, cross-task reinforcement learning, inductive transfer in RL | RL fine-tuning, policy fine-tuning, RLHF, reinforcement learning from human feedback |
| Apparentées≠ | 4 | 5 |
| Résumé≠ | Transfer Learning with Reinforcement Learning (Transfer RL) is a training paradigm in which knowledge acquired by an agent in one or more source tasks — encoded as policy weights, value functions, or learned representations — is reused to accelerate or improve learning in a related but different target task. It directly addresses the sample-inefficiency that plagues reinforcement learning from scratch in complex or expensive environments. | Fine-Tuned Reinforcement Learning adapts a pre-trained policy or model to a new task or behavioral objective using reinforcement signals — including human feedback — rather than retraining from scratch. Popularized by RLHF, it is the core technique behind aligning large language models and adapting deep RL agents to specialized environments with minimal additional data. |
| ScholarGateJeu de données ↗ |
|
|