【論文サーベイ】Score-Based Generative Model
3.6K Views
October 25, 23
スライド概要
関連スライド
各ページのテキスト
Score-Based Generative Model キーワード ● ● ● ● Langevin Monte Carlo Sampling Score Matching Denoising Score Matching Classifier Guidance
Score-Based Generative Model Generative Modeling by Estimating Gradients of the Data Distribution, Y. Song, S. Ermon [NeurIPS’19] Diffusion Models Beat GANs on Image Synthesis, P. Dhariwal, A. Nichol [NeurIPS’21]
Score-Based Generative Model NCSN, Y. Song, S. Ermon [NeurIPS’19] Classifier Guidance, P. Dhariwal, A. Nichol [NeurIPS’21]
Score-Based Generative Modelと連続時間 Diffusion Model Generative Modeling by Estimating Gradients of the Data Distribution, Y. Song, S. Ermon [NeurIPS’19] Score-Based Generative Modeling through Stochastic Differential Equations, Y. Song, J. Sohl-Dickstein, D. P. Kingma, A. Kumar, S. Ermon, B. Poole [ICLR’21 oral] Diffusion Models Beat GANs on Image Synthesis, P. Dhariwal, A. Nichol [NeurIPS’21] SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equations, C. Meng, Y. He, Y. Song, J. Song, J. Wu, J. Zhu, S. Ermon [ICLR’22]
- https://proceedings.neurips.cc/paper_files/paper/2019/hash/3001ef257407d5a371a96dcd947c7d93-Abstract.html
- https://openreview.net/forum?id=PxTIG12RRHS&utm_campaign=NLP News&utm_medium=email&utm_source=Revue newsletter
- https://papers.nips.cc/paper/2021/hash/49ad23d1ec9fa4bd8d77d02681df5cfa-Abstract.html
- https://openreview.net/forum?id=aBsCjcPu_tE
Score-Based Generative Modelと連続時間 Diffusion Model NCSN, Y. Song, S. Ermon [NeurIPS’19] Score SDE, Y. Song, J. Sohl-Dickstein, D. P. Kingma, A. Kumar, S. Ermon, B. Poole [ICLR’21 oral] Classifier Guidance, P. Dhariwal, A. Nichol [NeurIPS’21] SDEdit, C. Meng, Y. He, Y. Song, J. Song, J. Wu, J. Zhu, S. Ermon [ICLR’22]
- https://proceedings.neurips.cc/paper_files/paper/2019/hash/3001ef257407d5a371a96dcd947c7d93-Abstract.html
- https://openreview.net/forum?id=PxTIG12RRHS&utm_campaign=NLP News&utm_medium=email&utm_source=Revue newsletter
- https://papers.nips.cc/paper/2021/hash/49ad23d1ec9fa4bd8d77d02681df5cfa-Abstract.html
- https://openreview.net/forum?id=aBsCjcPu_tE
概要 Diffusion Model - エネルギーベース (スコアベース)の生成モデル - 元々はDPM，DDPMを指していた Score-Based generative Model (SBM) - スコアベースの生成モデル - DDPMと統一的な枠組みで扱えることが示され，DDPMとSBMを 合わせてDiffusion Modelと呼ぶようになった
Background (1/8) エネルギーベースモデル
Background (2/8) MCMCサンプリング
Background (3/8) スコア
Background (4/8) Langevin Monte Carlo サンプリング
Background (5/8) Score Matching
Background (6/8) Denoising Score Matching (1)
Background (7/8) Denoising Score Matching (2)
Background (8/8) Score Based Model (SBM)
Generative Modeling by Estimating Gradients of the Data Distribution, Y. Song, S. Ermon [NeurIPS’19]
Generative Modeling by Estimating Gradients of the Data Distribution, Y. Song, S. Ermon [NeurIPS’19]
Diffusion Models Beat GANs on Image Synthesis, (一部) P. Dhariwal, A. Nichol [NeurIPS’21]
Diffusion Models Beat GANs on Image Synthesis, (一部) P. Dhariwal, A. Nichol [NeurIPS’21] [J. Ho 2022]
Summary