← Neural Networks & Model Architectures
02 · Neural Networks & Model Architectures · Topic 06

What is a Diffusion Model?

A diffusion model is a generative model that learns to create data by reversing a gradual noising process.

What is it?

A diffusion model learns how to turn noisy data into useful, structured data.

During training, noise is gradually added to examples. The model learns how to predict or remove that noise, so generation can start with noise and repeatedly make it more organized.

Think of it like...

Starting with a television screen full of static and gradually turning the noise into a recognizable image.

This is only a learning analogy: a diffusion model is not literally cleaning a television screen.

How it works

1 · Training DataStart with examplesImages, audio, video, or other data provide patterns to learn.
2 · Add NoiseMake examples less clearNoise is added gradually until structure is mostly hidden.
3 · Learn to Predict / Remove NoiseLearn the useful directionThe model learns what denoising step should happen next.
4 · Start from NoiseBegin generationGeneration starts with random noise.
5 · Repeated DenoisingReveal structureMany steps turn noise into a generated output.

Real-world examples

Image Generation

Creates an image from a text prompt or other conditioning signal.

Image Editing

Uses controlled noise and denoising to change part of an existing image.

Video Generation

Produces sequences of frames while aiming for temporal consistency.

What it is NOT

Diffusion Model ≠ Transformer

Diffusion: A generative modeling family based on noising and denoising.

Transformer: A neural-network architecture based on attention.

Diffusion Model ≠ Generative AI

Generative AI: A broader capability or category for creating new content.

Diffusion: One family that can support generative AI.

Diffusion Model ≠ Image Model

Diffusion: Can be used with images, but also with other data types.

Image model: A broader description based on data or task.

Remember this

A diffusion model learns to turn noise into structured data through repeated denoising.

Video

Video

not available yet

A verified video explainer will be added when a real asset is available.

↑