Less Wright

@PyTorch, Large Scale Distributed AI Training, Object Detection, Optimizers, Stock Indexes

[Less Wright @lessw2020]

Blog post showcasing some of my kernel work at Cursor:
https://t.co/wUWXdXYzaM

[Less Wright @lessw2020]

@SemiAnalysis_ ymmv, but I've run 2K scale H200 and B200 runs with 70B model, up to 3D parallel, with regional torch.compile with no issues. Compile is not distributed aware, so the better method imo is regional compile of the transformer blocks, not full model compile:
https://t.co/rrFXMUprZs

[Less Wright @lessw2020]

Our TorchTitan Paper has been Accepted to ICLR 2025!
(https://t.co/bJBvPZmQx7)

From the paper chair:
"
I recommend Accept ...:
(a) This is a production-grade framework that covers a wide range of parallelism method and .... is likely to have significant impact
"

[George E. Dahl @GeorgeEDahl]

We've just released the first version of our Deep Learning Tuning Playbook! This is our attempt to distill our process for actually getting good results with deep learning. We emphasize hyperparameter tuning since it has been a large pain point. https://t.co/PjeJVWeOzS

[Less Wright @lessw2020]

testing my new handle

[Less Wright @lessw2020]

Excellent article on vector processing on CPU and GPU. If you want to dive deeper into what's happening internally and the tradeoffs involved, this covers SIMD, SIMT, blocks, warps, and more: https://t.co/rG38IizSoT

[Less Wright @lessw2020]

Trying out @zksync 2.0 zkEVM!

https://t.co/zzTV6axmoP

Send some test tokens for 0x9495f4d2477511a8cf4e.

[Less Wright @lessw2020]

My trading strategy Software Stars is up +53% for the year so far! https://t.co/mojKUVISbY

[Less Wright @lessw2020]

@IOHK_Charles This is a badge of honor. BitCoin went through the very same thing with Wikipedia in 2010 or so (for real!). Basically,imo this annoints ADA as the successor to BTC. That said, I'll go update the page tomorrow with some links/news to make sure it stays.

[Less Wright @lessw2020]

Verifying myself: I am silicontitan on Keybase.io. K_jka6m-OwMKZJX11cnIEsiEZzQb_OMyUTrZ / https://t.co/Ey7J4rH6Q7

[Less Wright @lessw2020]

#KarenTheSuperTrader = lost $50M in SPX Options, over-leveraged, and then used fraud? Over-leverage strikes again...https://t.co/Uw85T3EsRk