We're releasing ZML/LLMD, our homegrown LLM server built on top of our homegrown high performance heterogeneous inference stack.
It ships with 5 architectures out of the box: NVIDIA, AMD, Metal, Intel and TPU. All transparent.
It supports DFlash, continuous batching, prefix caching, the whole deal.
Oh, and it's fast.
$6M raised, <15 team, @KakarotZkEvm is the smallest company dedicated to the zk-ification of eth infrastructure, launching mainnet by eoy and realtime block proving in a year.
What’s our secret?
On the shoulders of Starkware
Thanks for bringing so much value to the ecosystem
The Paris Olympics was a great excuse to chat with friends in France: @roxannevarza at @joinstationf & @an21m from @amoamoamo!
We talk about what makes the Parisian ecosystem special - esp AI & consumer - plus the last ingredient we'd love to see! 🇫🇷
https://t.co/vz7N3nlskx
Hey folks, since we've been asked so many times, here is a quick demo of what we're building.
This is a small LLaMA2 sharded on 1 NVIDIA RTX 4090 (in Paris), 1 AMD 6800XT (in @TheCorendos's flat) and 1 Google Cloud TPU v2 over @Tailscale.
Exact same code, all built on my Mac
Kakarot plans to make Starknet the first-ever DualVM ZK rollup, supporting both EVM and Cairo VM.
And this is happening this year: @KakarotZkEvm will launch on the Starknet mainnet Q4 2024.
This is huge: learn why in this Q&A by none other than @ETazou 👇
https://t.co/wdETOFSosZ
Full house 👏🏻 for the Token Warrant workshop by @SamuelTazartes at @themu_xyz 🇦🇷
1h to catch up on major narrative to align interest in a fair way btw crypto Teams & VC
👉🏻 Keep your team in a leader nego position & propose fair deals (same for everyone) rather than fix token %
There is nothing like Helsinki and @SlushHQto kick off winter! ❄️
@bcichostepski, Johann, myself and #TeamOrrick are super excited to be back supporting many of our founders & investors clients & friends.
📷 Join us & let's meet!
@Orrick,@OrrickTech, Orrick Paris Tech Studio