Machine learningDeep learning / NLP / CV
Transfer Learning with Diffusion Model
Transfer Learning with Diffusion Models adapts a large pre-trained diffusion model — such as Stable Diffusion or DALL-E 2 — to a new target domain or task by continuing training on a smaller domain-specific dataset. Rather than learning the full generative process from scratch, practitioners leverage knowledge already encoded in millions of training steps to achieve high-quality domain-adapted generation with modest data and compute.
Open in MethodMindSoonVideoSoon
Read the full method
Members only
Sign inSign in with a free account to read this section.
Sources
- Ho, J., Jain, A., & Abbeel, P. (2020). Denoising Diffusion Probabilistic Models. Advances in Neural Information Processing Systems (NeurIPS), 33, 6840–6851. link ↗
- Ruiz, N., Li, Y., Jampani, V., Pritch, Y., Rubinstein, M., & Aberman, K. (2023). DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation. CVPR 2023. link ↗