📚 Journal club on discrete diffusion models 🎥 Replays available on YouTube! Contact: [email protected] Hosted by @ssahoo_, @jdeschena, @zhihanyang_

Joined August 2025
Drowning in the sea of Discrete Diffusion papers? 🌊 We got you. Join our Reading Group! From theory → empirics, and language → molecules — we’ll decode the chaos together 💫 Join the cult—uh, I mean community 😇 👉 Google Group:  groups.google.com/g/diffusio… (1 / 2)
2
7
45
11,304
Discrete Diffusion Reading Group retweeted
Hot take: the community keeps asking whether diffusion LLMs can beat AR. That's the wrong question. Diffusion is a sampling method, and it can sit on top of an AR model to make it faster instead of replacing it. Speculative decoding already speeds up AR, but it has two long-standing problems. Training a drafter takes a long time, and you have to build a complete pretraining corpus for it. Even then, token acceptance drops sharply on out-of-domain data. Uno @ssahoo_ offers an elegant way out: it decouples sampling training from capability training. There's no separate drafter. The model itself, plus one LoRA, drafts several tokens in a single forward pass, and the LoRA learns to match the model's own next-token distribution, so there's no drafter corpus to build and no labels to collect. We applied this to the Looped Transformer Nanbeige4.2-3B: 1 hour of LoRA training gives a lossless 2× speedup on agentic task. We haven't optimized anything yet, and we believe the acceleration can go much further. The takeaway: diffusion doesn't need to beat AR. Any model that can score its next token can get a fast diffusion mode in an hour. Page: fengsxy.github.io/LoopUno Lora Adapters: huggingface.co/liddlefish/Lo…
3
15
4
74
6,757
Discrete Diffusion Reading Group retweeted
This is so cool! With less than an hour of training on a single A100 node, Uno delivered a 2x speedup on a looped model (Nanbeige) for agentic tasks. In the coming weeks, we’ll see diffusion drafters like Uno replace traditional speculative decoding drafters across frontier models. Great work, @Loy004Yu!
Hot take: the community keeps asking whether diffusion LLMs can beat AR. That's the wrong question. Diffusion is a sampling method, and it can sit on top of an AR model to make it faster instead of replacing it. Speculative decoding already speeds up AR, but it has two long-standing problems. Training a drafter takes a long time, and you have to build a complete pretraining corpus for it. Even then, token acceptance drops sharply on out-of-domain data. Uno @ssahoo_ offers an elegant way out: it decouples sampling training from capability training. There's no separate drafter. The model itself, plus one LoRA, drafts several tokens in a single forward pass, and the LoRA learns to match the model's own next-token distribution, so there's no drafter corpus to build and no labels to collect. We applied this to the Looped Transformer Nanbeige4.2-3B: 1 hour of LoRA training gives a lossless 2× speedup on agentic task. We haven't optimized anything yet, and we believe the acceleration can go much further. The takeaway: diffusion doesn't need to beat AR. Any model that can score its next token can get a fast diffusion mode in an hour. Page: fengsxy.github.io/LoopUno Lora Adapters: huggingface.co/liddlefish/Lo…
5
6
69
3,195
This Monday, Oct 26, Gregor Kornhardt (@gregorkornhardt) will present his paper: SOL: Measuring Gaps between Text Distributions by Double Sliced Wasserstein Metrics
2
5
1
23
1,850
RT @JCJesseLai: 🎉 Excited to extend our book, The Principles of Diffusion Models, into a tutorial at @NeurIPSConf 2026! This time, it’s al…
This quoted post is unavailable.
2
31
Discrete Diffusion Tutorial at NeurIPS 2026 (Sydney) 🔥
🎊 Excited to give a tutorial on diffusion LLMs at @NeurIPSConf 2026 with @StefanoErmon @JCJesseLai @mittu1204 📆 Mon, Dec 7, 9 AM AEDT 📍 TikTok Ent Centre (Sydney, Australia) Topics covered: > A beginner friendly introduction to diffusion-LLMs > Designing frontier diffusion-LLMs > Using Continuous diffusion for LLMs
6
26
1,504
Discrete Diffusion Reading Group retweeted
🎊 Excited to give a tutorial on diffusion LLMs at @NeurIPSConf 2026 with @StefanoErmon @JCJesseLai @mittu1204 📆 Mon, Dec 7, 9 AM AEDT 📍 TikTok Ent Centre (Sydney, Australia) Topics covered: > A beginner friendly introduction to diffusion-LLMs > Designing frontier diffusion-LLMs > Using Continuous diffusion for LLMs
2
26
2
90
7,234
Discrete Diffusion Reading Group retweeted
Missed the presentation yesterday? We just uploaded the recording on YouTube: youtube.com/watch?v=J8rcc00l… I especially tried to give some intuition for the sampler, which can look surprising on a first read!
This Monday, Oct 19, Justin Deschenaux (@jdeschena) will present his paper: Simplex Diffusion Models
4
33
1,587
Missed the presentation yesterday? We just uploaded the recording on YouTube: youtube.com/watch?v=J8rcc00l…
This Monday, Oct 19, Justin Deschenaux (@jdeschena) will present his paper: Simplex Diffusion Models
1
6
1,017
Discrete Diffusion Reading Group retweeted
Join our reading group next Monday! Topic: Simplex Diffusion Models Presenter: Justin Deschenaux
This Monday, Oct 19, Justin Deschenaux (@jdeschena) will present his paper: Simplex Diffusion Models
5
17
1,035
Diffusion-LLMs go mainstream 🚀
We added Uno training to NeMo AutoModel. The neat idea: let the model draft for itself, then verify with the original AR model — no separate draft model needed. Our Qwen3-0.6B run gets ~2 committed tokens per forward on GSM8K and 1.84 on HumanEval. PR: github.com/NVIDIA-NeMo/Autom… cc @IFM_AI @ssahoo_ Thanks @krasul and @Chonghan_Liu for getting this in 🙏
8
731
Discrete Diffusion Reading Group retweeted
Really excited to see Uno-adapters incorporated into @nvidia -Nemo Thanks @huiying_lii @krasul @Chonghan_Liu Learn more about Uno: xitter.cf/ssahoo_/status/2095741…
We added Uno training to NeMo AutoModel. The neat idea: let the model draft for itself, then verify with the original AR model — no separate draft model needed. Our Qwen3-0.6B run gets ~2 committed tokens per forward on GSM8K and 1.84 on HumanEval. PR: github.com/NVIDIA-NeMo/Autom… cc @IFM_AI @ssahoo_ Thanks @krasul and @Chonghan_Liu for getting this in 🙏
3
22
1,500
Missed the talk? Check out the recording on YouTube: youtu.be/STCXPRaO3L4
This Monday, Oct 12, Yeongmin Kim will present his paper: Gumbel Straight Flow: Distilling Autoregressive Models into One-step Flow Maps
1
3
1
11
1,023
Discrete Diffusion Reading Group retweeted
Join our reading group next Monday! Topic: Gumbel Straight Flow: Distilling Autoregressive Models into One-Step Flow Maps Presenter: Yeongmin Kim
This Monday, Oct 12, Yeongmin Kim will present his paper: Gumbel Straight Flow: Distilling Autoregressive Models into One-step Flow Maps
4
7
47
132,547
This Monday, Oct 12, Yeongmin Kim will present his paper: Gumbel Straight Flow: Distilling Autoregressive Models into One-step Flow Maps
Introducing 💫 Gumbel Straight Flow 💫: Distilling Autoregressive Models into One-step Flow Maps 🚀 Can autoregressive (language) models be used as teachers for flow map parallel samplers?
1
5
4
47
141,935