I'm proud to share that our paper, "Plan for Speed: Dilated Scheduling for Masked Diffusion Language Models", has been accepted to #ICML2026! ๐
Huge thanks to Haim Permuter and @NachmaniEliya for the great collaboration.
๐งต1/ Meet Plan for Speed: Dilated Unmasking Scheduler (DUS) for Masked Diffusion LMs - a drop-in, inference-only planner that shatters the speedโquality trade-off.
๐ Paper: https://t.co/qYZee0ZL37
๐ Site and Demos: https://t.co/NhDeKO5vPV
๐งต6/ Results:
Preserves โณ25% quality at 5โ10ร fewer passes for math, code, and general knowledge reasoning benchmarks, revealing MDLMsโ true parallel potential.
Huge thanks to Haim Permuter and @NachmaniEliya for their collaboration!
#DiffusionLM#LLM#NLP#NonAutoregressive
๐งต1/ Meet Plan for Speed: Dilated Unmasking Scheduler (DUS) for Masked Diffusion LMs - a drop-in, inference-only planner that shatters the speedโquality trade-off.
๐ Paper: https://t.co/qYZee0ZL37
๐ Site and Demos: https://t.co/NhDeKO5vPV
๐งต5/ Why it works:
Under a 1st-order Markov view, distant tokens share almost no info, so DUSโs grouping slashes joint entropy near-optimally - far better than self-confidence schedulers.