Paper Walkthrough: Denoising Diffusion Probabilistic Fashions

This walkthrough is a couple of paper that kicked off a brand new period of generative deep studying in pc imaginative and prescient and plenty of different fields subsequently: the period of diffusion fashions. It’s titled “Denoising Diffusion Probabilistic Fashions” and it introduces a brand new framework referred to as DDPM, the abbreviation of the paper’s title.

Whereas the overall thought of diffusion fashions might sound intuitive, the mathematics behind it isn’t, and also you would possibly end up having a tough time attempting to grasp papers on that matter. At the very least I did. On the identical time, lots of as we speak’s generative fashions like DALL-E3, Imagen, SORA, and Steady Diffusion 3 are constructed upon diffusion fashions. Therefore, you will need to perceive the fundamentals.

🚀 So, fasten your seatbelt as a result of as we speak is the day the place we’ll construct a strong instinct on the fundamentals of diffusion fashions. We’ll put the DDPM into some broader context and we’ll strip down the equations, tables and illustrations from the paper, add some further annotations and uncover what they’re truely about.