Peng Wu

PyTorch Compiler, Lifelong Learner

[Peng Wu @PengWu326]

@henrylhtsang The recent "CAKE — Compiler–Agent Co-Design for Frontier Kernel Evolution" work (https://t.co/p076APXAC4) seems a really interesting way of co-evolving compiler (IR) with agents.

[Zihao Ye @ye_combinator]

🍰 CAKE paper's out, the design bet: the compiler isn't a fixed black box the agent calls — it's part of the harness, and it's under evolution too.

CAKE didn't inherit existing abstraction layer. no tile/layout abstractions: the vocabulary was distilled by agents from a corpus of production kernels. every pattern the agent couldn't express pushed new primitives into the IR, and the analyses to keep them checkable. every barrier/layout bug that kept coming back became a verifier rule.

none of this can be designed up front. the IR has to co-evolve with the kernels, and the workload tells you what's missing, the corpus tells you if the fix broke anything.

the best language for an agent is the one that tells you what's illegal, what's slow, and which decision might made it faster.

https://t.co/810wbeLuAW

[Peng Wu @PengWu326]

@zerbLion PyTorch team just posted a response to the Zhihu post. The benchmarking was flawed - not enough warm-up led to torch.compile measurement including compilation time. Correct benchmarking shows torch.compile faster than Eager on geomean. Details in https://t.co/ihUcd3GBrD

[Peng Wu @PengWu326]

https://t.co/Sbz3hVa2n9

[Peng Wu @PengWu326]

https://t.co/diqgHupwj6

[Peng Wu @PengWu326]

Pen{g}sieve Vol. 15: 2022 Personal Annual Review, by @PengWu326 https://t.co/r9OaygY7Ar

[Peng Wu @PengWu326]

@clattner_llvm Coongrat! Looking forward to your new adventure.

[Peng Wu @PengWu326]

Happy new year! My words of the year for 2022 — Effortless, Embodiment, Nonlinear. What about yours?

[Peng Wu @PengWu326]

My last tweet was 5 years ago :). Inspired by @cHHillee, I am getting back in at the start of the new year. Looking forward to exploring a new way of connecting.

[Peng Wu @PengWu326]

What compiler? It’s all about abstraction. http://t.co/wpAjruxVdo

[Peng Wu @PengWu326]

How to start a new job? http://t.co/kyN3KcM4SZ

[CF Bolz-Tereick @cfbolz]

The RPython translator gained a truly essential feature: The fractal now uses 256 colors (done by @krono).

[Peng Wu @PengWu326]

The myth of auto-SIMD http://t.co/B1YxA0Ji9w via @PengWu326

[Peng Wu @PengWu326]

@cfbolz it is a Taoism Classic "the Inner Canon of Huang Di” on philosophy, Chinese medicine, and healthy written 2000 years ago :).

[Peng Wu @PengWu326]

@cfbolz indeed, now can't live without it.

[Peng Wu @PengWu326]

How change happens http://t.co/fYEWM03W6T

[Peng Wu @PengWu326]

Organizing a workshop on SIMD programming models and applications for PPoPP'14, Submission Deadline Dec 2nd, https://t.co/AyT5DabOPF

[Peng Wu @PengWu326]

Big conference is less interesting these days; much prefer well-run workshop in a focused area where deep technical exchange is possible

[Peng Wu @PengWu326]

attended the DALI workshop http://t.co/sTEKn3UR9b, and gave a short talk on the landscape of VM/JIT projects for R http://t.co/vP6WhGMOLO.

[Peng Wu @PengWu326]

@cfbolz @alex_gaynor only the google IO talk http://t.co/lNOvYO9N0c.

[Peng Wu @PengWu326]

@alex_gaynor @cfbolz Good point. Dalvik is another one missed. Added both.