kyle yu

building gpu visualizations

[kyle yu @brrrkyle]

this is how i wish i learned GPU fundamentals

not a lengthy textbook. not a static image. every concept is an interactive visualization.

covering the SM architecture, memory coalescing, synchronization, and more.

what concepts do you want to see next?

https://t.co/D7lq9xwXyk

[Tensordyne @TensordyneInc]

Nobody gets more fast tokens out of a megawatt than us. Nobody.

· Bit-accurate log math is locked in.
· Chip is taped out with Broadcom and in wafer fab on TSMC 3nm.
· System bring-up of compute tray with HPE Juniper scale-up fabric is ahead of schedule.

Today we're publishing our whitepaper on how we solved for what really matters in AI inference.

[kyle yu @brrrkyle]

@FaroukAdeleke3 @wafer_ai wafer team is goated

[steve @gpusteve]

i'm sad to announce that our recent fundraising round did not go according to plan...

we initially planned to raise $18m.

we didn't end up getting that number.

we ended up raising a $40m series a instead.

co-led by @MarathonMP and @chemistry, with participation from @Wing_VC, @AMD Ventures, @outsetcap, @fiftyyears, and @ycombinator, and our existing investors doubling down on @wafer_ai. we are also joined by an incredible list of angels, including @JeffDean (CEO, @DiscoLoopAI), @rauchg (CEO, @vercel), @andyfang (CTO, @DoorDash), @kvogt (CEO, Bot), @akothari (COO, @NotionHQ), @eastdakota (CEO, @Cloudflare), @deepgramscott (CEO, @DeepgramAI), and more.

back to the kernel mines

[kyle yu @brrrkyle]

@wafer_ai @vercel holy cow 1 band

[kyle yu @brrrkyle]

@kylejeong @modal good looks!

[kyle yu @brrrkyle]

@yoonseok_yang just do it

[Yoonseok Yang @yoonseok_yang]

I became an AI Research Scientist as a college freshman.

The job required a master’s degree.

I had:
• a high school diploma
• 0 publications
• 0 AI research experience

Here’s exactly how I did it (thread):

[kyle yu @brrrkyle]

@gpusteve @wafer_ai chat do i skip my flight for this

[kyle yu @brrrkyle]

@levidiamode 🤝

[kyle yu @brrrkyle]

@gpusteve we working out our fingers by typing everyday

[kyle yu @brrrkyle]

@jino_rohit nice nice

[kyle yu @brrrkyle]

@maxxfuu Nice work man! Check out https://t.co/D7lq9xxvnS. Hope it helps :)

[kyle yu @brrrkyle]

the fastest optimization you can make to a memory-bound kernel:

make the numbers smaller by going from fp32 to bf16

this is precision

learn about it @ https://t.co/1ni1pr6wA0

[kyle yu @brrrkyle]

get ready 👀

[Tensordyne @TensordyneInc]

https://t.co/s5e3TQ6E9Z

[kyle yu @brrrkyle]

@gpusteve my guy

[kyle yu @brrrkyle]

https://t.co/s9WjSQDwHb stays cooking

[steve @gpusteve]

https://t.co/l5ecFMhy1e is quite nice

[kyle yu @brrrkyle]

@h100envy check out https://t.co/D7lq9xxvnS 🤝

[kyle yu @brrrkyle]

@gpusteve yessir

[kyle yu @brrrkyle]

I'm on vacation in Hong Kong and just shipped BrrrViz Chapter 11: Tiling from my hotel room. It's 6 interactive visuals that will help you grasp the concept. It's 1:43am. I'm tired. Hope it helps and go check it out :)

https://t.co/D7lq9xxvnS

[kyle yu @brrrkyle]

@Aru__09 @GPU_MODE nice work man!