@AndrewDev8383 it lacks QSFP56 connection. that card alone costs $1000. So it makes sense that price is lower. But you cant connect 4 of those new ones.
@loktar00@dunik_7 Maybe we need to start reporting those bots for fake misleading info? To get them all down as it really sucks to see spam in timeline
Tested out stepfun-ai/Step-3.7-Flash-NVFP4 and results are following: model failed to make floating clouds while even every Qwen 3.6 / MiniMax 2.7 / DeepSeek V4 Flash models managed to do that properly every time. Animals look terrible. But they are grounded jumping in place not like many models get them in 0 x 0 coordinate jumping. But thinking is longest of all models 70% of all output was thinking. I thought MiniMax2.7 was a big thinker so this model beats it quit hard 🤣 In overall going back to DeepSeek V4 Flash.
@mr_r0b0t@King0James0 Gemma-4 introduced they mtp like 1 or 2 weeks ago would be nice if you would update recipes with mtp :) plus i suspect vllm/vllm-openai:cu130-nightly can be outdated as they just recently released version 22 and that one you mention was from 19
Tested out stepfun-ai/Step-3.7-Flash-NVFP4 and results are following: model failed to make floating clouds while even every Qwen 3.6 / MiniMax 2.7 / DeepSeek V4 Flash models managed to do that properly every time. Animals look terrible. But they are grounded jumping in place not like many models get them in 0 x 0 coordinate jumping. But thinking is longest of all models 70% of all output was thinking. I thought MiniMax2.7 was a big thinker so this model beats it quit hard 🤣 In overall going back to DeepSeek V4 Flash.
@atomic_chat_hq Now name the fact that it supports just tool format it recognizes and if you ask for other it will fail drastically ignoring new format. And Bonsai beats it hard in normal tests having just fraction of memory usage. https://t.co/ev9t1JGCB8
@liquidai Just tested it out and could say prism-ml/Bonsai-8B-gguf beats this model like 10 times. Results are so bad that it can't even generate solar system lineup... But speed is insane.