Joe Isaacson

torching pys @pytorch

[Joe Isaacson @Jisaacso]

@marksaroufim Congrats Mark, it was an awesome run together!

[Joe Isaacson @Jisaacso]

@elliotarledge @PyTorch The focus of our initial release was correctness to the precision level of KernelBench. We'll continue hammering on both accuracy and performance next!

[Joe Isaacson @Jisaacso]

@giffmana Shout out to @ralfgommers and @quansightai ‘s partnership with @PyTorch team last year to ship compiled numpy!

[driss guessous @drisspg]

Would you rather have better documentation for PyTorch prototype features but more BC breakages or secret APIs until we have more confidence?

[Joe Isaacson @Jisaacso]

🚀🚀🚀 come work with PyTorch on GPU kernel optimization, distributed training/inference/post-training, compiler design, ABI stability

[Mark Saroufim @marksaroufim]

If you’re excited about optimizing code that runs equally well on a single or thousands of GPUs and if you have the ability to submit a single substantial PR to a major OSS library, we want you on the PyTorch team - especially if you’re early in your career.

[Joe Isaacson @Jisaacso]

Excited to share the GPU MODE kernel authoring competition! We’re stoked to see the creative solutions people come up with to push bounds of performance. And, all for a good cause — towards a public dataset of performant kernels 😁

[GPU MODE @GPU_MODE]

Write a fast kernel and run it on Discord. See how you compare against the best!

If you're familiar with Leetcode, Kaggle or Codeforces then this should feel right at home

[Joe Isaacson @Jisaacso]

@AsimovBio cooking over the holidays. Just launched their second essays on genetic engineering, written in physical DNA and sealed in a stainless steel capsule. Lasts 10k years without degradation 🤯

[Alec Nielsen @alectricity]

Eat your heart out, Gutenberg

@AsimovPress book #2, encoded in DNA, available now for pre-order. One of the coolest projects I've ever seen unfold.

Huge thanks to @catalogtechinc, @imagene_biotech, and @plasmidsaurus for making this possible, and @jasonjoyride for the epic vid

[Joe Isaacson @Jisaacso]

Great talk on the importance of RLEF and CoT for coding generation performance

[Gabriel Synnaeve @syhw]

Just gave a talk on "Grounding LLMs in Code Execution" at the NeurIPS Hacker-Cup AI Competition, here are the slides https://t.co/XUbO0NaDX9

[Joe Isaacson @Jisaacso]

@anneouyang from @Stanford talking on KernelBench, a standardized benchmark for kernel generations. Level 1-4 problems challenging sota LLMs to generate performant GPU kernels.

[Joe Isaacson @Jisaacso]

@simran_s_arora from @HazyResearch on GPU kernel generation, project 🍿and the challenge of AI mapping algorithms to hardware architecture. At @NeurIPSConf Hacker AI Cup

[Joe Isaacson @Jisaacso]

@neal_wu from @cognition_labs on the future of competitive programming as a litmus test for AI, at @NeurIPSConf Hacker Cup session

[Joe Isaacson @Jisaacso]

@syhw on RL for Execution Feedback, trained with PPO, run on CodeContests

[Joe Isaacson @Jisaacso]

David Harmeyer on Facebook’s history of Hacker Cup. How to add N flights to N airports to minimize travel distance.

[Joe Isaacson @Jisaacso]

Stoked for the Hacker AI Cup Workshop to start at @NeurIPSConf ! Speakers @weiwei_msr @syhw @neal_wu @simran_s_arora @MishaLaskin @thomascapellajp @marksaroufim ! Come join, room 210

[Joe Isaacson @Jisaacso]

Congrats on the launch of 🌽 KernelBench! We're excited to partner with 🍿 Popcorn to lower the barrier to GPU programming!

[Simon Guo @simonguozirui]

We are not the only ones thinking about this direction. The vision was nicely outlined by @karpathy in his talk (see picture below, credit to karpathy and @accel), and we found many others also eager to attempt this.

Project 🍿: https://t.co/UfhsH5izNB in the GPU Mode server is a community effort towards this goal of LLMs generating performant GPU kernels. We hope KernelBench could be a valuable contribution for the community, to help understand current capabilities and serve as a playground to evaluate various techniques.

If you are interested, we would love to hear your thoughts and welcome you to join the mission!

Link to the relevant part of Karpathy’s talk: https://t.co/qGxFwyGeh4

[Joe Isaacson @Jisaacso]

@marksaroufim @threadreaderapp unroll

[Joe Isaacson @Jisaacso]

@diamondbishop First Epoch