ALIBABA'S 35B MODEL RAN 6X FASTER ON HIS CPU THAN A 27B ONE DID, 17.68 TOKENS A SECOND AGAINST 3.07, AND THE REASON IS ONE LETTER IN THE FILENAME MOST PEOPLE SKIP RIGHT PAST
02:04 he explains the whole thing in one sentence, "that's a mixture of experts model, that means even though it has 35 billion parameters, only about 3 billion are active at any given time"
qwen 3.5 35b-a3b at q4, 20gb, both gpus switched off -> 17.68 tokens per second on cpu and ram alone -> same model on a six core ryzen 5 9600x hits 18.94 -> now load qwen 3.5 27b, a dense model, fewer parameters -> 3.07 tokens per second -> five full minutes just for the thinking phase
a dense model pushes every token through all 27 billion parameters, a mixture of experts routes each token through 3 billion of 35, so the bigger file is the faster one and the smaller file is what makes people give up on local ai and go back to paying altman and amodei $200 a month each
then he switched both to gpu, the dense 27b jumped to 37.18 tokens per second and the 35b-a3b hit 122.61, which is the real answer, the model architecture decides whether your cpu is enough and the gpu decides how far past enough you go
qwen 3.5 35b-a3b q4 + qwen 3.5 27b dense + ryzen 9 7950x3d + ryzen 5 9600x + 64gb ddr5 + lm studio
watch and save it, musk gave away the agent and moonshot gave away the weights, the full $400 to $25 routing table is in the article below
@Rusia_HD It's a Islamist Terror Cult Fake Country Fake History Fake Agenda Their only function is Terror War Murder Rape Crime and Destroy our Countries. They Hate you an everything you stand for and will try to Kill you. Kick them out
@SilentlySirs A fucking moron promoting a terror cult a fake nation that never existed fake history stolen flag stolen land nothing more than a terror cult. time to Ban this fagget from all venues keep this shit out of US and Europe.
@Natute123 Whole Dubai and Monaco France full of brand new Ukrainian Millionaires and Billionaires easy to spot because money can't buy class. Ukrainas have laundered over a trillion Dollar in Dubai's real estate market buying up all new production.
@MrWhiplash_ That means all of them are criminals and illegals send in everything we have to close it all down rain the state put them all on a banana boat back to where they came from.
Agent OBS - $AOBS is now officially LIVE!
Phase 2 of the Obscura ecosystem starts today. Obscura now runs on two contracts instead of one: $OBS, the token of the private Swap-to-Earn exchange, and $AOBS, the official contract of Agent OBS, Obscura's own on-chain trading agent. Two contracts, two flywheels, each one feeding and boosting the other.
This is the official $AOBS contract address - your gateway to becoming an $AOBS holder:
Contract Address: 0x47366e0f257ac009e82bd46fb74e2fb50826ce98
Disclaimer: Interact only with this contract. $AOBS is a Robinhood Chain token. We are not affiliated with any other projects, tokens, or contracts - any address on any other chain claiming to be $AOBS is fake.
What is Agent OBS? Full Breakdown Below 👇
@MollerReal They triggered the genocide of Sweden by sacrificing our children and women to rapist cultures on a industriel scale. In the future this people will be held accountable in Nuremberg style trials and hung in public for their crimes!
@warDaniel47 They biting the hand that feeding them. One day the civilized people end them and their civilizations. when enough of Islam insults terror rape and crime is enough.
@hippyygoat Rouge terror cult flagging a flag with no country false history false agenda all they want is terror and death rape and pedofila and destroy your country with Islam.