AI is math. GPU is metal. Sitting between math and metal is a programming language. Ideally, it should feel like Python but scale like CUDA. I find two newcomers in this middle layer quite exciting:
1. Bend: compiles modern high-level language features to native multi-threading on Apple Silicon or NVIDIA GPU. Supports difficult constructs like - lambdas with full closure, unrestricted recursion and branches, folds, ADTs, etc. Bend compiles to HVM2, a thread-safe runtime implemented in Rust.
All open-source:
- https://t.co/qb5VckRXVH
- https://t.co/F3n8tw8pwy
2. Mojo: a CUDA-flavored, Python like language the executes at C speed. Mojo is conceptually lower level than Bend and allows you to have stronger control over exactly how the parallelism is done. Especially suited for coding modern neural net accelerations by hand.
- https://t.co/aYQ5LtgsVb
- Llama2 in one Mojo source file: https://t.co/wW2ANhKPPT
"Disappointed with @Flipkart! Ordered a product on 16th June and it's still stuck in 'Order in Process' status. No updates whatsoever. @flipkartsupport "
I’m in the running to win the new @Nothing Phone (1) thanks to @TechnicalGuruji ! Don't miss out on the official announcement on 12 July: https://t.co/BN4IRQB9WO #Nothingphone1