Xavier Jones

6'4" dad. Two M5 Maxes. Open models for closed rooms

FAANG Hackathons winner 10x (150k) 🏆

co-Founder Oksia

OSRS = first 6 $figures at 17

@universityofga

[Xavier Jones @Xavierjones]

SUCCESS ! I got a 753B-parameter model running fully local.

It runs across two M5 Max laptops wired together with one Thunderbolt cable. About 16 tokens a second. thanks @UnslothAI @Zai_org @Hikari_07_jp @antirez watching them past day or so got me hype! guess @jun_song may have to re-update local list ranking

[Xavier Jones @Xavierjones]

@ashxhart @XadenRyan Thanks I'll give it a gander!

[Xavier Jones @Xavierjones]

@ashxhart @XadenRyan No worries or rush was just wondering thanks for your efforts!🫡🤗

[Xavier Jones @Xavierjones]

HOT TAKE :
This is a great start for using a Mac but
I'd argue it's a waste on M5 Max you can get 80 tok/s on same machine but with qwenflash next 4-8 mixed.

So while it is great, still not enough to be used for real work where your output is what the client pays for imo.

[Inco AI @inco_ai]

Qwen3.8-27B at 144 tok/s on an M5 Max MacBook Pro ⚡

Meet Inco Splash: our open-source inference engine, built around the model and around Apple silicon.

Up to 3× the decode speed of Ollama, 2× oMLX, and almost 4× when an agent fans out into sub-agents.

[Xavier Jones @Xavierjones]

@ashxhart @XadenRyan Hey did you ever get a chance to OOS this ? I'd love to try

[Xavier Jones @Xavierjones]

@MikeBradleyAI @losterror501 I get 82 tps 393k context on m5 max 128

[Xavier Jones @Xavierjones]

Nothing can shut down open source

[Elon Musk @elonmusk]

@kevinnbass Nothing can shut down open source

[Xavier Jones @Xavierjones]

@newzealandhodl @owenthcarey Tyty

[Xavier Jones @Xavierjones]

@harvey_control Hey let's! Nice to meet you ill check it out

[Xavier Jones @Xavierjones]

@Careerbuddha111

[Xavier Jones @Xavierjones]

@itskamrankhan Sold the car kept the house, moved to Thailand to allow my wife to not change her standard of living as I build. I say Build and fast

[Xavier Jones @Xavierjones]

@chenzhangreal Hey at this point engagement is metrics I'll take it for now. ^^

[Xavier Jones @Xavierjones]

@itskamrankhan Hey Kamran! sounds awesome happy to !

[Xavier Jones @Xavierjones]

@mynameisdesmond This is the way

[Xavier Jones @Xavierjones]

@TTrimoreau People who passed on you will circle back.

They will have wasted your time, kicked the ball down
the road, promised you false hope, and then you'll
make it.

You have to be the bigger person.

[Xavier Jones @Xavierjones]

@Teknium yoo bro did you drop mobile yet please eta good sir!!

[Xavier Jones @Xavierjones]

Contract completed!!

I bargained with the wife no more broom closet! building the home lab in the spare bedroom upgrading from the sun room!!!! Real testing/exploring can begin!! @OmarchyLinux is about to breathe life into a lot of decommissioned tech I have!

[Xavier Jones @Xavierjones]

@cetusian still around the same but I keep getting caught on it hanging for approvals it doesn't really need or randomly stopping.

[Xavier Jones @Xavierjones]

Hot take :

Grok cli with local models > Hermes on most daily work/tool calls

[Xavier Jones @Xavierjones]

@AdinaYakup @InclusionAI The model let me down.I was not impressed at all.Maybe it's close to inkling

[Xavier Jones @Xavierjones]

@AdinaYakup @InclusionAI I'll test it now.I'll report back excited🙌😄😄