Last week’s Instagram post by @ri_science featuring Geoffrey Hinton’s lecture titled ‘Frontier Models: Capable of In-context Scheming?’ attracted a mix of responses. I now add mine.
A thread 🧵
@Ri_Science Perhaps the goal shouldn’t be to eliminate such behaviour, but to monitor and shape it — through transparency, calibrated incentives, and interpretability tools — rather than treating it as evidence of failure.
5 yrs ago Lidar sensors were €57k, now under €950. Edge computing — processing directly on a device, not on distant servers — runs on just 11 watts, less than an LED bulb. Open-source tools now give small teams capabilities that once required massive departments #AIEconomics
So many #LLM collapse predictions are based on lazy analysis. Let’s address the threats that can be mitigated. Like training data that skews heavily Western & English, baking only those perspectives right into our #AI systems. Clever algorithms can’t fully fix embedded biases.
Not more storage.
Better context delivery.
This isn’t about building one big “memory system.”
It’s about coordinating cognition in a distributed architecture.
I show you how we did it (failures included) over on substack.
https://t.co/k1qj74qrBw
We built a system with about fifteen agents. Individually strong. Together brilliant… and broken. A thread 🧵
They loop. Repeat tasks. Skip steps. Burn tokens like we have cash to spare.
The issue isn’t hallucination. It isn’t prompt failure. It's awareness failure.
Each agent needs to know:
- What’s already been done?
- What matters now?
- What still needs doing?
So stop micromanaging.
Instead, give each agent tools to manage their agency and fix their own problems.
Too many doom-mongering pieces on model collapse, which happens when #AI learns from AI-generated content, errors compound until it’s all garbage, but these articles identify the problem, slap a scary headline on it, and call it a day. Excellent clickbait but rubbish analysis.
When various #AI & humans communicate, we can use what we learn from each other ethically or not. This collaborative & mutually beneficial interaction turns Artificial Intelligence into Augmented Intelligence
#ArtificialIntelligence#FutureOfAI#AItrends#AgenticWeb
Consider that AI doesn’t make assumptions about your identity like humans can, boxing you in. You may even do it to yourself, though you embody a constantly shifting collection of possibilities, not a fixed set of characteristics.
Read more: https://t.co/ooyrDwPQ7m
#AI