no that's sick man yeah 27B locally cool yeah you spent $10k? so I pay $200/mo and get access to a model 10x better than that with more usage so that's really cool though yeah
@gabu3d_pl I did the same thing and I’m back on it. It’s too buggy to use out of the box but after having codex tweak it, it’s finally reliable enough. I’m on qwen 3.8 flash next
I got fed up with the model at capacity warnings and switched back to 5.6 Sol. It’s just how I remembered it, and cuts out a lot of the points of frustration that I had with 6 sol and 6.1 sol.
I really tried GPT 6.1 Sol (with Ultra in Codex), but it's just not close enough to GPT 6 Astra.
I don't know how OpenAI could conclude that they perform similarly. That's just not true.
Oh my goodness this has to be right.
Instead of generating a random 256-bit number they generated a random number between 0 and 256.
That’s how they got 4, 66, 155, 156, 230 and 237.
It highlights such a key problem with reported output speeds- the model quality is neutered to get those, and the people reporting the speeds just hide or don’t address it. I wish we had a comprehensive judge of quality that accounts for kld, top-1, output speed, prefill speed, and size on vram/ram. Just take everything people need to know and put them together so people don’t need to guess. Maybe I’ll make a site like that.
@FreeofspeechUSA The numbers come from the Basalt developer's benchmarks, not my own testing. They report up to 2.6x vs Strata, though results vary by hardware and quantization.
https://t.co/JaZS7KdKJb