Der Kauz

BTC, MSTR

[Der Kauz @KosmischerK]

@HermesWatcher Safari bookmark (with custom avatar picture) on iPhone, opens cloudflare-tunneled open web ui, which makes it easy to sort by chat, deliver files through the custom download link workflow I made and is completely customizable in looks

[Der Kauz @KosmischerK]

@unbug Hey, in your opinion is it worth it to get 2x V100 32GB to get a second inference server up and running?

[Der Kauz @KosmischerK]

@truthavatar777 @coldniko Is this with PF-FUSED=1? Setting it to 1 gave me a lot of prefill, am also on gfx1201

[Der Kauz @KosmischerK]

@coldniko Btw @coldniko do you reccommend running ROCm 7 or 10?

[Der Kauz @KosmischerK]

@coldniko I love it, amazing results, prefill almost +50%

[Der Kauz @KosmischerK]

@essam_madridi @coldniko Well a 5080/5090 would be even stronger under strata but seems like Niko put in a lot of work into optimizing

[Der Kauz @KosmischerK]

@OdinsReisen Und das auch unter IQ3_XXS und calibrate

[Der Kauz @KosmischerK]

@OdinsReisen Ah ok, auf 9070XT/64GB DDR4 bekomme ich mit der neusten Version auf 75-80 token/s decode und 1500-2000 token/s prefill, deswegen wundert es mich wenn du sagst dass es langsamer geworden ist

[Der Kauz @KosmischerK]

@coldniko Will this improve performance on a single 9070XT as well?

[Der Kauz @KosmischerK]

@seanhighness @coldniko 9070xt also now at 70/1800 tps

[Der Kauz @KosmischerK]

Absolutely amazed by Strata on the 9070XT on Linux @coldniko

[Der Kauz @KosmischerK]

@witcheer @HermesWatcher Currently testing and developing custom scripts with Hermes with qwen3.8-27B to be our office assistant with emails, documents and research for 5 seats - no coding at our company

[Der Kauz @KosmischerK]

@januarycomputer @ronaldmannak Check out strata by @coldniko

[Der Kauz @KosmischerK]

@ItsmeAjayKV Yeah got a 4x16gb ddr4-3200 kit this morning… for 300€ 😭

[Der Kauz @KosmischerK]

@ItsmeAjayKV Only 16GB DDR4, but hunting for a 64GB kit currently so I can try strata or stay with 27B but with huge caches

[Der Kauz @KosmischerK]

@Italianclownz @AIatAMD You think other RDNA4 cards like 9070XT would also benefit from that?

[Der Kauz @KosmischerK]

@Oluwaphilemon1 What‘s the setup for that kind of performance on 3.8-27B? I have it completely on a 9070XT with 96k ctx, q4 kv, mtp, decode at 40-50 token/s

[Der Kauz @KosmischerK]

@murasametech What‘s the speed and what kind of RAM?