I built an LLM benchmark that tests something none of the others do: can a model actually do science?
A secret rule governs which items you can bring on a picnic. The model proposes items, gets YES/NO feedback, and has to deduce the rule from scratch.
No memorized knowledge helps. 10 models tested.
The biggest finding: every model is terrible at designing experiments.
Even the best model scored 57% on Strategic Exploration. LLMs are great at recognizing patterns but bad at testing hypotheses .
Scores ranged from 27% to 89%. The ranking surprised me.
You can play it now on desktop: https://t.co/FX8mb5b4G0
You can also fork it, mod it, or ship your own version. Code is on GitHub.
AI tools and modern web tech make it possible to go from idea to playable multiplayer in days, not weeks. Start building.
#GameDev#AI#WebSockets #indiedev
Built a real-time multiplayer arena shooter in 48 hours, inspired by Vampire Survivors and the chaos of classic .io games.
Thread on what it is, how it works, and why you should start building 🧵.
Why I built it:
I wanted to explore real-time networking patterns, ECS-like design in plain JS, and frictionless multiplayer deployment.
Inspired by Vampire Survivors’ simple but deep progression, I wondered what would happen if this kind of chaos was shared online.
Losing due to another player might hurt, but it is statistically as likely that you could win due that same player hitting when he "shouldn't". Blaming your neighbor is like blaming the shuffle. Skill = mastering basic strategy and bankroll control.
Revamped my portfolio https://t.co/0iaKvroA7o!
Added: New paper on how AdaBound+Swish trains nets fastest, Texas Homes platform connecting people with shelters, Tab Time Tracker Chrome extension that sorts tabs, and STOMACH horror cooking game coming to Steam. Check it out!