Llama-3.2 3B + Keiro research API hit ~85% on SimpleQA ($0.005/query)
we ran Llama 3.2 3B locally. unmodified. no fine-tuning. no fancy framework. just the raw model + Keiro research API.
~85% on SimpleQA. 4,326 questions.
PPLX Sonar Pro: 85.8%. ROMA: 93.9% — a 357B model.
OpenDeepSearch: 88.3% — DeepSeek-R1 671B.
SGR: 86.1% — GPT-4.1-mini with Tavily ( SGR also skipped questions)
we're sitting right next to all of them. with a 3B model. running on your laptop.
DeepSeek-R1 671B with no search? 30.1%. Qwen-2.5 72B? 9.1%.
no LangChain. no research framework. just a small script, a small model, and a web search API.
cost per query: $0.005.
Anyone with a decent laptop can run a 3B model, write a small script, plug in Keiro research api , and get results that compete with systems backed by hundreds of billions of parameters and serious infrastructure spend.
Benchmark script link + results --> https://t.co/S4wqnjRVcw
Keiro research -- https://t.co/D7BDWoPIcn
#LLMs
holy shit... Hugging Face cooked again! 🔥
they just dropped a free blog (BOOK) that covers the no-bs reality of building SOTA models. i haven't seen any lab/researcher go into the real decisions behind the LLM research and its nuances. this is literally a gem.
Syllabus:
→ Training compass: why → what → how
→ Every big model starts with a small ablation
→ Designing the model architecture
→ The art of data curation
→ The training marathon
→ Beyond base models — post-training in 2025
→ Infrastructure - the unsung hero
skimming through the blog, this is incredibly detailed just like their ultrascale playbook. i'm gonna read this and share more about it in the coming days.
Read here: https://t.co/4dqfa9f8TQ
AI-generated QR codes are the next big thing in marketing.
And it's completely free.
Here's my full tutorial on how to do it in 5 simple steps:
(Try scanning the image below)
Every entrepreneur should know these websites:
jasper .ai
notion .so
loom .com
pitch .com
make .com
typedream .com
landingpage .fyi
producthunt .com
answerthepublic .com
marketingexamples .com
Retweet to share it.
Seth Godin is one of the greatest marketers of this era.
He once said:
“Marketing is no longer about the stuff you make, but about the stories you tell.”
Sadly, most weren't taught how to tell a good story.
So here are 10 dead simple tips to make you a better storyteller: