Tomorrow at #CVPR2026
Come join our full-day tutorial on analytic understanding of diffusion models.
How do diffusion models generalize? What outputs can you expect from your generative model? Where should you direct resources to make it better?
This and much more on a full day tutorial with wonderful @yuancy@MasonKamb@CScarvelis@WangBinxu@ZKadkhodaie
Links in the reply.
4/4 The model I used was GPT 5.4 xhigh on Codex. The code, prompts, harness, verification scripts, generated proof blueprint and Lean formalization are in this GitHub repo: github.com/yuanchenyang/n…
3/4 The harness gave the agent a computational toolkit to autonomously search for counterexamples using optimization solvers, so it can infer structure from dual certificates, write a blueprint, formalize the proof, and keep going until Lean accepted the final theorem.
I wrote a blog post about a Codex harness/workflow I built to autonomously prove a new mathematical result after 3 days of continuous work producing ~60k lines of Lean, where the input is a Lean theorem statement and output is a fully formalized proof.
1/4
chenyang.co/blog/automatic…
I'm helping to organize this CVPR tutorial on analytic understanding of diffusion models, join us if you are interested in learning more about how diffusion models generalize!
Join us at @CVPR in Denver for a full-day tutorial about Analytic Understanding of Diffusion Models.
The training objective of diffusion models has a closed-form solution -- yet it only memorizes. How do real models generalize? We'll unpack this paradox and the emerging
Why do diffusion models produce new images instead of just memorizing the dataset? We show that they learn pixel correlation patterns from the data and therefore denoise locally, which promotes generalization.
To test this idea, we compare trained diffusion models with a training-free algorithm that mixes local patches from the dataset. Surprisingly, this simple procedure already reproduces many properties of the trained models.
🧵 Check out this thread for more details about our Spotlight NeurIPS paper with @yuancy, @JustinMSolomon and @vincesitzmann.
At #NeurIPS today in San Diego?
Come check out poster #4409 (4:30–7:30 PM) today. We’re excited to share our spotlight paper on the generalization properties of diffusion models.
Looking forward to great research conversations!
@yuancy@JustinMSolomon@vincesitzmann
I played a small part in the production of this video, and I'm really happy with how it addressed common misconceptions about diffusion models, as well as the beautiful visualizations and animations!
New video on the details of diffusion models: youtu.be/iv-5mZ_9CPY
Produced by @welchlabs, this is the first in a small series of 3b1b this summer. I enjoyed providing editorial feedback throughout the last several months, and couldn't be happier with the result.
In the problem sets, we use the library introduced in the first lecture (github.com/yuanchenyang/s…) to train diffusion models on custom data, as well as using pretrained models as building blocks for a variety of downstream tasks (see examples above)
(4/4)
Using score distillation for 3D shape generation (L5) and wrapping up with a summary of the latest research making diffusion models better and faster (L6)
The lecture recordings can be found here: youtube.com/playlist?list=…
(3/4)
Last month I cotaught a class on diffusion models at MIT during the IAP term: practical-diffusion.org
In the lectures, we first introduced diffusion models from a practitioner's perspective, showing how to build a simple but powerful implementation from the ground up (L1)
(1/4)
270 Followers 3K FollowingMSc in Math from @uni_regensburg; BSc in Math and CS minor from @UUtah
AI4Math & ML/DL & Extremal comb, TCS, and number theory
9K Followers 582 FollowingResearch lead at Meta TBD Labs.
Previously research lead and core contributor to o1, o3, gpt5, at OpenAI. PhD at Stanford with Percy Liang and Tengyu Ma
1K Followers 2K FollowingResearcher at @Inria, affiliated at @Mila_Quebec. Previously, postdoctoral researcher at @Mila_Quebec w/ @SimonLacosteJ and @gauthier_gidel.
2K Followers 147 FollowingAssistant Professor @mldcmu. Formerly: Postdoc @MITEECS, PhD @Berkeley_EECS, Math Undergrad @Princeton. New to Twitter. https://t.co/67bMOAyqK6
127 Followers 651 Followingglass is a non-equilibrium state of matter that continuously relaxes towards the liquid state; its ultimate fate in the limit of infinite time is to crystallize
9K Followers 582 FollowingResearch lead at Meta TBD Labs.
Previously research lead and core contributor to o1, o3, gpt5, at OpenAI. PhD at Stanford with Percy Liang and Tengyu Ma
2K Followers 147 FollowingAssistant Professor @mldcmu. Formerly: Postdoc @MITEECS, PhD @Berkeley_EECS, Math Undergrad @Princeton. New to Twitter. https://t.co/67bMOAyqK6
8K Followers 21 FollowingGrad&Clip&EM is all you need @Kimi_Moonshot
Blog: https://t.co/YVxsWylklA , Cool Papers: https://t.co/scS1n1oyaO
Interesting link: https://t.co/7Tl4HaVajh, https://t.co/Y5qaxAA9Iy
19K Followers 314 FollowingBuilding AI that learns by interacting with the world. Associate Professor @ MIT, leading the Scene Representation Group (https://t.co/h5gvhLYZj4).
681K Followers 700 FollowingInternet Rocket Scientist, Gamer, Astronomer, Dad, Scotsman, Pilot. Makes videos about space and science https://t.co/mLfUsogKq5
42K Followers 358 FollowingI built a C library that lets you compile 12kb static binaries that run natively on Linux, Mac, Windows, FreeBSD, OpenBSD, NetBSD and BIOS using just GCC/Clang.
430K Followers 759 FollowingSenior Space Editor at Ars Technica. Likes rockets. Author of the best-selling book on the Falcon 9 and Dragon, REENTRY. https://t.co/5HYUhJzFHZ
43K Followers 577 FollowingAssistant prof. @ Stanford; Chief AI Scientist @ MongoDB; Former Co-founder/CEO of Voyage AI
Working on ML, DL, RL, LLMs, and their theory.
46K Followers 43 FollowingActive on https://t.co/WG71Nrs60M; also trying out https://t.co/fGOzbSxVHi. No longer read replies or notifications here now that tweetdeck is gated.
30K Followers 301 FollowingProfessor and Department Chair @Berkeley_EECS. Research Scientist (part-time) @GoogleResearch. Founder @addiscoder. Posts are personal views. 🇻🇮🇺🇸🇪🇹
4K Followers 432 FollowingAssociate professor at U of T. Computer science and math research: (differentially) private data analysis, geometry, discrepancy, optimization.
8K Followers 463 FollowingProfessor @MITEECS and @MIT_CSAIL, currently visiting @the_IAS. Complexity, algorithms, and related math. I'll let you know when P != NP (and when it's not)
113K Followers 573 FollowingDistinguished Scientist at Google. National Academy of Engineering. Computational Imaging ∩ AI. Posts are personal opinions
57K Followers 187 FollowingMathematician. Professeur titulaire de la chaire Combinatoire au Collège de France. Also fellow of Trinity College Cambridge.
64K Followers 609 FollowingAssistant Prof of CS @UWaterloo, Faculty @VectorInst, Canada @CIFAR_News AI Chair. Joining @NYU_Courant Fall 2026. Co-EiC @TmlrOrg. I lead @TheSalonML.