Have you ever wanted to train LLMs in pure C without 245MB of PyTorch and 107MB of cPython? No? Well now you can! With llm.c:
https://t.co/PoGTZIwASL
To start, implements GPT-2 training on CPU/fp32 in only ~1,000 lines of clean code. It compiles and runs instantly, and exactly matches the PyTorch reference implementation.
I chose GPT-2 to start because it is the grand-daddy of LLMs, the first time the LLM stack was put together in a recognizably modern form, and with model weights available.
@sopyer@_jura_z_ Justification for what, Mykhailo? Kuleba lied and I posted the proof. After invasion I was shocked as everybody else. But if YOU have a million enemies, maybe the problem is not with them? Now feel free to blame me for someone’s personal crusade. Hate breeds hate.
Russian propaganda has gone off the rails and speculates Ukraine might be preparing to drop a ‘dirty bomb’ on the Russian territory. This is a sick fake. Ukraine doesn’t have nuclear weapons, doesn’t conduct any work to create/acquire them. We are a responsible member of the NPT.
Mike Filippo has quite the CPU heritage. Is it my imagination or are some great architects and engineers leaving Apple recently? Add that to the Nuvia now Qualcomm folks. What's going on at Apple? $APPL
Finally, the moment everyone's been waiting for... 👀
Cornell McRay t'Racing is open source! 🏎️🔥🔥🔥
https://t.co/G6K8ArrqoO 🎉🦀
@rustlang#Vulkan 🤪 (yes, it's 99% jank)
@AntifaVoter@anonymassi@Reuters Learn some history, dear. Not only Finland allied with Hitler to invade USSR, they participated in the siege of Leningrad. 900 days of terror, where 600K+ civilians died, including my relatives. And before that, Finland tried to annex East Karelia from USSR in 1921-1922.
@bkaradzic @FlohOfWoe @actualGraphite I’m not familiar with NVN, but this Deko3d looks good. If it works with K1, it might be a good reason to blow the dust off my Jetson TK1 :)
Some people were curious, so here's a quick breakdown of lighting passes in the experimental branch of my toy renderer, where I play with ReSTIR and "surfel" irradiance caching: https://t.co/xo1wHphP5Y 👨🔬🔥
zig-gamedev project v0.2.0 is released! In this release I've implemented physics demo using Bullet library. Along the way I wrote cbullet - a universal C API for Bullet. RTs much appreciated!
#ziglang#DirectX12
https://t.co/ZLgJ97X5EN
https://t.co/XFbBaV37b2