Tomasz Muszynski

[Tomasz Muszynski @herkii]

@0xNeoArch what is your use case for this model? It looks really fast 9b is relatively small but it is depend on the use case

[Tomasz Muszynski @herkii]

@0xNeoArch You don't use the vllm? it is Qwen 3.8 Flash Q8 on the 13x3090 ?

[Z.ai @Zai_org]

We’re still up.

[Tomasz Muszynski @herkii]

@gabu3d_pl I was doing both and prefer bare metal and containers

[Tomasz Muszynski @herkii]

@gabu3d_pl yeah this price now are now probably 10x or more :(

[Tomasz Muszynski @herkii]

@LottoLabs @tenstorrent great can't wait for the real use case not only demo

[Tomasz Muszynski @herkii]

@superalesha Great job Alexey need to test your quant on my 3090 rig, really appreciate for your work on that, and how you are squeezing every little tensor :P from the 3090's

[Tomasz Muszynski @herkii]

@MiaAI_lab @Kimi_Moonshot the 20$ are also bad 5h even not fill the context, and it is over :(

[Tomasz Muszynski @herkii]

@zfields @jmurillocode @bleysg it was a bug in the previous version upgrade it to the last one and you have working 1M context (ds4-on-spark)

[Tomasz Muszynski @herkii]

@LottoLabs @holytrinity Hope @LottoLabs
you are delivery more info about this product, how it is working what is the pain point or maybe they are not

[Tomasz Muszynski @herkii]

@holytrinity And what is the performance there was almost zero information how it behave what the benchmarks and how it is working on daily run, or what ever, can't find any informatation about that, only the marketing stuff, not real use case

[Tomasz Muszynski @herkii]

@bleysg @kkiran @MiaAI_lab @TechMDAI @SamJWasserman @WescheNex1q @0xSero I have the same issue it is crushing around 32k (ASUS Ascent GX10 1TB), also new version of ds4-on-spark 0.5.4 same thing

[Tomasz Muszynski @herkii]

@ChrisJPatty No worries, was just curious. Unfortunately my typescript isn't that strong.

[Tomasz Muszynski @herkii]

@ChrisJPatty Hi Chris, this is fantastic project, but is this project still in active development?

[Yashar Ali 🐘 @yashar]

FYI

[Tomasz Muszynski @herkii]

Verifying myself: I am herki on https://t.co/zdBPJkqIOx. QBIZdZVhDCKD3j3CRGu_cL9KYwQSR_I7Hw5m / https://t.co/LKeBFvJVfo

[Tomasz Muszynski @herkii]

@TheHikariKnight Hi, what is the name of discord channel?