手法を比較

	マルチモーダル強化学習	自己教師あり強化学習
分野	深層学習	深層学習
系統	Machine learning	Machine learning
提唱年	2015–2022	2020
提唱者	Multiple contributors (DeepMind, OpenAI, Google Brain, 2010s–2020s)	Laskin, M.; Srinivas, A.; Abbeel, P. (and contemporaries)
種類	Multimodal deep RL agent	Self-supervised auxiliary-task learning for RL
原典	Reed, S., Zolna, K., Parisotto, E., Colmenarejo, S. G., Novikov, A., Barth-Maron, G., ... & de Freitas, N. (2022). A Generalist Agent. Transactions on Machine Learning Research.	Laskin, M., Srinivas, A., & Abbeel, P. (2020). CURL: Contrastive Unsupervised Representations for Reinforcement Learning. Proceedings of the 37th International Conference on Machine Learning (ICML), PMLR 119, 5639–5650.
別名	Multimodal RL, Multi-Sensory Reinforcement Learning, Vision-Language RL, Multi-Input RL	SSL-RL, self-supervised RL, representation-based reinforcement learning, auxiliary-task RL
関連	6	4
概要	Multimodal Reinforcement Learning trains agents to make sequential decisions by perceiving and integrating multiple input modalities — such as raw pixels, language instructions, audio, and proprioceptive sensors — simultaneously. Rather than acting on a single data stream, the agent fuses heterogeneous signals into a unified state representation and learns a policy through environmental reward feedback.	Self-supervised Reinforcement Learning (SSL-RL) augments standard RL training with self-supervised auxiliary objectives — such as contrastive, predictive, or data-augmentation-based tasks — applied to the agent's own experience. These objectives improve the quality of learned representations without requiring extra human labels, enabling faster convergence and better sample efficiency, especially in high-dimensional observation spaces like raw pixels.