Faisal Mumtaz

Innovating and building crazy things @HUMAIN

[Faisal Mumtaz @digitacy]

I wrote an LLM inference engine from scratch in Rust.

No PyTorch. No ONNX. No Python.

Just one binary that downloads a model and runs GPU-native inference on Apple Silicon + NVIDIA.

It beats llama.cpp at Q4 on Apple Silicon. Here’s how it works 🧵

[Sujay. @Sujay__Raj]

@AnthropicAI It was expected

[Faisal Mumtaz @digitacy]

Built solo to understand GPU inference end-to-end.

I also document where it loses today (e.g. CUDA prefill trade-offs) so benchmarks stay honest.

If this is useful, star it:
https://t.co/CC9msIZ7lq

#RustLang #LLM #LocalLLaMA

[Faisal Mumtaz @digitacy]

I wrote an LLM inference engine from scratch in Rust.

No PyTorch. No ONNX. No Python.

Just one binary that downloads a model and runs GPU-native inference on Apple Silicon + NVIDIA.

It beats llama.cpp at Q4 on Apple Silicon. Here’s how it works 🧵

[Faisal Mumtaz @digitacy]

OpenAI- and Anthropic-compatible server in one command.

SSE streaming, tool calling, native tokenizer, and native format in a single Rust codebase.

[Faisal Mumtaz @digitacy]

@cryptogoos Just starlink will be worth that in 10 years so its a steal

[Faisal Mumtaz @digitacy]

😂

[Cybertruck @cybertruck]

Hey Luce

[Faisal Mumtaz @digitacy]

@helloitsaustin People who typically fit the higher echelons such as distinguished fellows, don't get interviewed in traditional ways. They decide if the company and its mission is worth their time.

[Faisal Mumtaz @digitacy]

@karpathy @farzyness Oh damn. OpenAI is cooked

[Crémieux @cremieuxrecueil]

Last year, China added as much energy to its grid as Germany has in total.

[Faisal Mumtaz @digitacy]

Another great piece from @JayaGup10

[Jaya Gupta @JayaGup10]

https://t.co/5vDrndcmFn

[Balaji @balajis]

The US federal budget is $7 trillion.
There are 535 in the Senate and Congress.
They collectively allocate that money.
Specifically: 7000/535 = 13 billion per official.
Which means AOC is a political billionaire.
She allocates far more than any market billionaire.
Indeed she allocates ten billion liquid, per year.
A market billionaire has one billion, illiquid, per life.
So: AOC spends 10-100X what a market billionaire has.
It's not even close.
She's right about one thing, though.
AOC didn't earn the tens of billions she spends.
The state taxed that money, by force.

[Faisal Mumtaz @digitacy]

@alex_whedon If you're going to make such claims, start with empirical proof, not marketing

[Faisal Mumtaz @digitacy]

@UrataSyndicate @damianplayer Exactly, he literally listed every single option. How is this a revelation?

[Faisal Mumtaz @digitacy]

@zan2434 @eddiejiao_obj @drewocarr Dude what!?

[Faisal Mumtaz @digitacy]

@hthieblot No

[Faisal Mumtaz @digitacy]

@stats_feed @grok Compare SpaceX launches vs rest of the world, 2025 and 2026