@analogalok Nice! I'm getting about 5 t/s with this setup on a OnePlus 8T Snapdragon 865 with 12GB of RAM.
I couldn't get the UI to load though, had to test via curl.
Most large language models predict answers by guessing the single best word to say next, then the next, and so on... 🔎
It's highly capable, but not necessarily fast. The model waits to finish one word before it can think about the next.
DiffusionGemma skips the wait.
It uses "diffusion" to generate text by refining noise step by step — drafting and error-correcting whole blocks simultaneously. This makes it incredibly fast, and helpful for editing complex math and code.
Introducing Claude Fable 5: a Mythos-class model that we’ve made safe for general use.
Its capabilities exceed those of any model we’ve ever made generally available.
@outsource_@huggingface Great! I'm looking for a good 12B uncensored that can run tools and think a bit, I've tried 24B from someone else and when it "thinks" it gets stuck thinking.
@0x0SojalSec Great! I'm looking for a good 12B uncensored that can run tools and think a bit, I've tried 24B from someone else and when it "thinks" it gets stuck thinking.
We’re continuing to work with Microsoft and GitHub to investigate the impact of the malicious Nx Console version 18.95.0. I'll share any updates on X (@jeffbcross and @NxDevTools) as well as in our security advisory: https://t.co/szBoQ3doaX.
Initially, Microsoft indicated to us that there were 28 installs of the malicious version 18.95.0. Based on our own analytics for the compromised version, we currently believe the number of users who received the malicious package may be significantly higher; potentially over 6k installs.
We’ll keep working to determine the actual impact and exposure, and I don’t want to speculate beyond the facts we have right now. But I also don’t want to minimize the situation.
This is my top priority right now. Our team has been, and continues to be focused on understanding exactly what happened, helping affected users, hardening our systems and release processes, and being as transparent as possible throughout the investigation.