Jipeng Sun

Building Blocks

• Self Attention
• Vision Transformer (ViT)
• Diffusion Transformer (DiT)

Neural Lookup Table

Design

• Classifier-Free Guidance (CFG)
• Classifier-Free Guidance

Math

• Backpropagation
• AutoDiff
• KL Divergence
• ELBO (Evidence Lower Bound)

Generative Models

• Diffusion Model
• Diffusion from Stochastic Differential Equations (SDEs) Perspective
• VAE vs. Diffusion from ELBO Perspective
• DDIM (Denoising Diffusion Implicit Models)
• DDPMs, DDIMs, and Score-Based Methods
• Flow Matching
• Mean Flow
• Improved Mean Flow (iMF)

Analysis

Neural Tangent Kernel