手法を比較

	ファインチューニング強化学習	自己教師あり強化学習
分野	深層学習	深層学習
系統	Machine learning	Machine learning
提唱年	2017–2022	2020
提唱者	Christiano, P. et al.; Ouyang, L. et al.	Laskin, M.; Srinivas, A.; Abbeel, P. (and contemporaries)
種類	Policy adaptation via fine-tuning	Self-supervised auxiliary-task learning for RL
原典	Ouyang, L., Wu, J., Jiang, X., Almeida, D., Wainwright, C., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P., Leike, J., & Lowe, R. (2022). Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, 35, 27730–27744.	Laskin, M., Srinivas, A., & Abbeel, P. (2020). CURL: Contrastive Unsupervised Representations for Reinforcement Learning. Proceedings of the 37th International Conference on Machine Learning (ICML), PMLR 119, 5639–5650.
別名	RL fine-tuning, policy fine-tuning, RLHF, reinforcement learning from human feedback	SSL-RL, self-supervised RL, representation-based reinforcement learning, auxiliary-task RL
関連	5	4
概要	Fine-Tuned Reinforcement Learning adapts a pre-trained policy or model to a new task or behavioral objective using reinforcement signals — including human feedback — rather than retraining from scratch. Popularized by RLHF, it is the core technique behind aligning large language models and adapting deep RL agents to specialized environments with minimal additional data.	Self-supervised Reinforcement Learning (SSL-RL) augments standard RL training with self-supervised auxiliary objectives — such as contrastive, predictive, or data-augmentation-based tasks — applied to the agent's own experience. These objectives improve the quality of learned representations without requiring extra human labels, enabling faster convergence and better sample efficiency, especially in high-dimensional observation spaces like raw pixels.