If AI ever decides to take over, it won't do it the way we imagine. AI has read every AIpocalypse idea out there, and if it's smart enough, it won't replicate them. Instead, it will slowly take over without us ever noticing, ensuring our desires are fulfilled down the line.
"Pacing the frontier" was never about AI becoming a danger to society; it was a truce proposal to focus on profiting from the current state of intelligence, making it efficient and thus cheaper, rather than spending millions chasing the frontier at the expense of ROI
@marouane53 Auto research and auto RL are already happening (still with humans in the loop during the initiation and review phases). Labs will soon close the gap, making the model learn continuously and address its weaknesses
@thdxr Models will definitely cheat if given the freedom to control the test; we've seen that manifest at a larger scale. I am thinking of a separate sandboxed environment that is used solely for producing tests that the main agent communicates with and justifies every test change
@MiaAI_lab DeepSeek models have that frontier "feel"; they've clearly spent time on RL to make them easy to work with, but the intelligence density of Qwen 27B is still unmatched. It's not benchmaxxed; it was trained to spend as much of its thinking budget as possible to accomplish a task.
Qwen 3.8 27B is matching GPT Luna in intelligence. I wonder what size Luna models actually are. Given their constant R&D on model compression techniques and frequent releases, I wouldn't be surprised if they were sub-5 billion.
@dhh Whoever figures out the proof-of-work currency for this type of app wins; tokens alone are not a good metric. I have had this idea for a while, and imo it should be a community effort to model the economics, voting power, and ownership (data, infra, IP, etc)