Martin | GorroAI

Running Qwen 295B locally on my Mac in San Juan. Free public API at

[Martin | GorroAI @DrPhoto]

@M0SC0W0 What was “the remark”?

[Martin | GorroAI @DrPhoto]

@packfaxai Maybe this but in prize pack

[Martin | GorroAI @DrPhoto]

@DMBGorgeCrew Dave always giving 💯 ❤️

[Awni Hannun @awnihannun]

Adopting Claude speak in my regular life, episode 1:

Partner: Did you do the dishes tonight?
Me: Yes they're done.
Partner: Why are they still dirty?
Me: You're right to push back. I didn't actually do them.

[Martin | GorroAI @DrPhoto]

@LordCharizard33 I miss the abercrombie when the vibe was all nice red variarions. Now its all bland and worse quality.

[Martin | GorroAI @DrPhoto]

@ClassicAdvertz https://t.co/cuUoSGwPiu sure dont make bands like they used to. This rocks!

[Martin | GorroAI @DrPhoto]

@JohnnyCrambo Vmax has better hands

[Martin | GorroAI @DrPhoto]

@BitcoinatBlock Its a scam to sign up on cash app

[Martin | GorroAI @DrPhoto]

Ollama 0.19 just dropped with MLX backend hitting 112 tok/s on Qwen3.5-35B on M5 Max. Running autoresearch on @anemll’s flash-mlx I hit 55.7 tok/s on the same model via SSD streaming. Different problems: they need it in RAM, I run models larger than RAM. https://t.co/mjZThfH9uO

[Martin | GorroAI @DrPhoto]

Full day of repairing my github since everybody has getting 404 Error.

Had to make a new github account LINK to full GITHUT REPO:

Paper + code: https://t.co/WjYu3IrDQQ

[Martin | GorroAI @DrPhoto]

@anemll @danveloper CORRECTED github: https://t.co/WjYu3IrDQQ

[Martin | GorroAI @DrPhoto]

Just hit 20.34 tok/s on Qwen3.5-397B on a MacBook Pro M5 Max. 4.67x over the baseline by @danveloper. 36 experiments, 58% discard rate. Here’s what worked and what didn’t:
https://t.co/My6yYV04Po
cc @anemll

[Martin | GorroAI @DrPhoto]

@anemll @danveloper Thanks for the foundation — your Q3-GGUF expert support was essential to getting here. Full writeup with 36 experiments on r/LocalLLaMA: https://t.co/is94P5jnav Paper + release: https://t.co/PyUmQs3pgh

[Martin | GorroAI @DrPhoto]

CORRECTED github link: https://t.co/WjYu3IrDQQ

[Martin | GorroAI @DrPhoto]

Here is link to the study https://t.co/qeYpCZ92Nx

https://t.co/PyUmQs3pgh

[Martin | GorroAI @DrPhoto]

@heynavtoor We just pushed it to 20.34 tok/s on M5 Max 128GB — 4.67x over that baseline. 36 experiments, temporal expert prediction, fused Metal scheduling. Full writeup: https://t.co/BErwdkWp0S

[Martin | GorroAI @DrPhoto]

@aaawwwd_w @danveloper @anemll It works now. Thank you!

[Martin | GorroAI @DrPhoto]

@tom_doerr @tom_doerr @danveloper Running the same model at 20.34 tok/s on M5 Max 128GB — 4.67x faster. Temporal prediction + Metal optimizations. Paper pending ArXiv.

[Martin | GorroAI @DrPhoto]

🚀 Just hit 20.34 tok/s on Qwen3.5-397B running locally on M5 Max—4.67× faster than the prior benchmark by @danveloper! Paper incoming, pending ArXiv endorsement.

[Martin | GorroAI @DrPhoto]

@LottoLabs Running Qwen3.5-397B locally on M5 Max at 19 tok/s — way bigger than 27B, no GPU needed, no API bill. For privacy-sensitive work where you can’t send data to any cloud this is the only option. Full benchmark: https://t.co/6hLelgC16B