Sufyan

Building and experimenting with AI and local AI | Tech + privacy

1x DGX Spark

[Sufyan @sfxnz]

My brand new @NVIDIAAI DGX Spark has just arrived.

Setting it up now.

I have to say it's one of the most premium feeling devices I have ever unboxed.

[Sufyan @sfxnz]

@sudoingX 16gb 2019 mbp ➡️ 128gb spark

[Sufyan @sfxnz]

@brivael Accurate

[Sufyan @sfxnz]

@Italianclownz Fellow open source supporter! You will reach your goal

[Sufyan @sfxnz]

@DJLougen nvidia/qwen3.6-35b-a3b also seems to be having trouble with agentic workflows according to @MiaAI_lab

[Sufyan @sfxnz]

First direct benchmark of qwen3.6-27b vs qwen3.6-35b-a3b (both NVFP4) on a single dxg spark

35B is 5-6x faster

Prefill/decode:
27B➡️ reads 1.1k tok/s, types 13 tok/s
35B➡️ reads 6k tok/s, types 76 tok/s

A3B is MOE so this checks out

vLLM v0.24.0, single stream, 2K/8K/16K inputs

Real question is how good is each ones tool calling in hermes agent? Pending.

[Sufyan @sfxnz]

@subkleo Very nice this is with @jetha work

[Sufyan @sfxnz]

@SlimTradeyBaby Concurrency shining

[Sufyan @sfxnz]

@AgentSparko @dangerm00se @NVIDIAAI DXG spark community is the best

[Sufyan @sfxnz]

@JohnPippett Yeah we did still satisfying to see on your own hardware

[Sufyan @sfxnz]

@TheAhmadOsman Same will apply to Local AI 😎

[Sufyan @sfxnz]

@hirenpatelatl Will try!

[Sufyan @sfxnz]

@Dadojvk both tested at base, no speculative decoding/MTP

[Sufyan @sfxnz]

@TimoTweetss more storefronts I suppose, just the next best move on the chess board

[Sufyan @sfxnz]

@AgentSparko I feel this way too. I have one and am aching for another

[Sufyan @sfxnz]

@0xSero As an INTJ I can attest to this

[Sufyan @sfxnz]

@u1tra_instinct making the most of your sparks ladies and gentleman

[Sufyan @sfxnz]

Genuinely baffled that Chinese companies can't use Claude

[Sufyan @sfxnz]

@MiaAI_lab @NVIDIAAI tmux about to blow up

[Sufyan @sfxnz]

@sabeshbharathi

[Sufyan @sfxnz]

@Insider747 @VraserX not on 16gb ram🙏

[Sufyan @sfxnz]

@MichaelGannotti MTP would push these both even more!