Advented

Hardware, AI and some finance for fun.

[Advented @advented_]

@MiaAI_lab I reviewed your Ds-v4 recipe against my own. You’re actually doing better than me! I falsely assumed my config was the most I could get for 2 DGX setup (200k, 5 seqs, 12k batch prefil)
But turns out your recipe does way better (1M, 6 seqs, 8kbatch) for the same 40-50 t/s !!

[Advented @advented_]

@0xSero i've been trying to search around for the best DGX spark sg alng recipes..

your reap looked interesting and I seen promising results on dev forum getting this model running native on 2 DGX sparks..

benchmarks would be a huge help to determine recipe and best use case!

[Advented @advented_]

@willreil real question: how would you keep the yard green? is it all astro turf? else make the roof entirely electrochromatic glass to control sun light in the neighbourhoods. consistent weather all year round lol

[Advented @advented_]

@StockWorthyApp @StockMKTNewz major disappointment. I was holding warby parker calls for the anouncement and watched them get COOKED live

[Advented @advented_]

@0xSero I’ve been trying to build an MCP with it.
After long enough chat it can hallucinate bad

It’ll say ready to implement the plan but then never take action. Even at 30% context window usage

Some ppl saying it might be the system prompt that breaks model over time

[Advented @advented_]

@bubbleboi without reservation lol

[Advented @advented_]

@r0b0t_sp1der @alexinexxx we live in a world where elon can hire devs on the spot when its go time to lock in talent. pandering for corporate just has no upside when you taste and see what high agency can be

[alexine 🏴‍☠️ @alexinexxx]

God’s plan for me doesn’t involve a 6-round application process

[Advented @advented_]

@skcd42 @Daniel_Farinax based 🫡

[Advented @advented_]

@Daniel_Farinax @StudioZamudio i think Opencode is around the same size for thier system prompt.

intitial prompt or fist chat is the system prompt getting consumed.

sharing it is typically apart of the closed model aspect of frontier models.

grok cli is interesting. i love and hate it so far

[Advented @advented_]

@tueks3 the chinese do this with Fio BTR product with many audio codecs support. this module is powerful because it can be adapted for anything! In college i worked on spatial audio, I wonder how easy it could be to add gyroscope and processing unit to enable this device!

[Advented @advented_]

@iamgingertrash you think leopold gonna keep his trades private or he offloaded to crypto?

[Advented @advented_]

@0xSero Docker containers defined alloc of resources but sometimes go over or under the RAM durring runtime.

Would be nice to have for debug and more consistent recipe deployment

[Advented @advented_]

@0xSero I like vllm studio.
I tried running it on my Spark recently but it didn’t support container deployment of vllm.

Have you added support since then?

I vibe coded my own patch but still haven’t worked out the bugs with live resource observability.

[jlcjak @jlcjak]

This man is a legend and this project is truly amazing. He went from zero to selling an assembled pcb on his website and shipping it internationally in a single project. Shipping the thing is as impressive as making it, congrats will.
You guys should buy the thing NOW, it's $1

[Advented @advented_]

@Tri_Stanisaurus @willreil the 10x referral upsell, amazing lol

[fish @fishPointer]

it's too risky to not take your dreams seriously

[Advented @advented_]

@willreil There’s a guy on YouTube who made a crucible out of a microwave.. possibilities endless lol

https://t.co/cBiOWIqJNv

[Advented @advented_]

@MorgenMason @FL0WG0D doing a calendar or vertical spread on this is actually affordable.. but damn.. like still such a bold position to take