building anthroly. we help companies sell their data to ai labs and build rl environments + datasets with 100+ phds. posting what i see inside ai data deals
i run anthroly. we do two things
help companies sell the data they're already sitting on to ai labs. support threads, call notes, expert docs, the stuff nobody looks at
build rl environments and datasets for labs. 100+ phds on contract, 400 more ready to go
i post what i actually see inside ai data deals. follow if that's your world
the most valuable thing your company owns might be the stuff you were about to delete
@Google pays @Reddit $60m a year for old forum posts. labs pay phds up to $200 an hour to write answers
and most founders are sitting on years of support tickets, call notes and expert docs they call junk
what's the oldest folder you still have?
@jasonjias@X building datasets and rl environments for ai labs with a bench of phds. always-on agents are the thing i'd most want real eval data on. how do you test yours?
@MaximLevoshin helping companies sell their data to ai labs, and building datasets for labs with phds. games and edtech teams usually sit on more useful data than they think
the cumulative clause is the sleeper. a lot of real post-training now is a small team, a pile of expert-written tasks and an rl environment
calling that frontier misses where the compute actually is
Is 10ยฒโต FLOPs Still the Frontier?
A new Anthropic-written safety bill is circulating on Capitol Hill. Some of its ideas could be reasonable if limited to true frontier companies. As written, however, it will eventually sweep in most of Silicon Valley, damaging the startup ecosystem.
The bill defines the โfrontierโ as any model trained on 10ยฒโต FLOPs โ the EU standard from 2023. Bidenโs executive order, Californiaโs SB 53, and New Yorkโs RAISE Act used 10ยฒโถ (ten times more). 10ยฒโท is where the frontier actually is today (e.g., GPT-6 Astra).
Astra was reportedly trained on 100,000+ Grace Blackwell GPUs. A 10ยฒโต model can be trained on as few as several hundred GB300 chips in three months. That is not frontier in 2026.
The definition is also cumulative: it adds FLOPs from fine-tuning, reinforcement learning, or other material modifications. In practice, that captures almost all meaningful post-training โ work that is becoming commonplace in the enterprise.
The enterprise trend is toward thousands of smaller custom models built for specific workloads. These pose no frontier risk. Treating them as frontier systems would impose large compliance costs across corporate America for no safety gain.
Dario has claimed that Anthropic designs rules to disadvantage frontier companies like his own while advantaging smaller competitors. This definition does the opposite.
A stale 2023 cutoff favors incumbents who already clear the bar and can absorb the costs. It hobbles the open model ecosystem that threatens Anthropicโs pricing power.
The frontier keeps moving. Any definition meant to track risk should move with it.
Anthropic should clarify if they really believe 10ยฒโต FLOPs represents the frontier.
@jwt0625 does "smooth mapping" end up meaning you pick training systems by symmetry rather than by volume? feels like the opposite of how llm data gets picked
@waseem_s the raters shape it as much as the spec does. character training is basically a preference dataset with opinions, and whoever grades it leaves fingerprints
@levie same thing is happening with training data. everyone assumed labs would stop buying once the internet was scraped. demand for expert-written data went up instead
@NandoDF that cost is real. the middle ground i keep coming back to is grading a small sample of full traces properly and using those to audit the cheap verifier, not replace it. self-distillation with nobody auditing is where the bias compounds
@ebelilov@VAIBHAV22155287 rl post-training for diffusion feels underrated. what's the reward here, a learned preference model or something you can actually verify? that choice seems to decide everything downstream
@_AxelT anything that says "this looks off" before i hit send. spell check did it long before ai did. what's the one mistake maple tracker is built to catch?
@levie the bottleneck you land on is almost always review. agents can start ten things, someone still has to decide which one was right, and nobody budgeted time for that part
@satish_vutukuru 19 rows down to 11 is the most useful note here. the rows that disappear tell you more than the new ones
we're in a similar lane at anthroly, 100+ phds on contract building rl envs and datasets for labs. always up to compare notes on what labs actually ask for