Jay

founder @hud_evals, prev cs+physics @columbia, @ycombinator. inside the sim2real gap

[Jay @jayendra_ram]

Since everyone is talking about RL Environments and GRPO now but no one knows how it works we thought it would be cool to make an explainer video + code you can run:

This is an example of using GRPO to train Qwen 2.5 to play 2048 (code in thread) 🧵:

[Jay @jayendra_ram]

@willdepue it can totally happen IMO. it may be that the only thing preventing runaway RSI is physical world constraints.

[Peter Wildeford🇺🇸🚀 @peterwildeford]

OPENAI: "We also see early signs of recursive self-improvement in today's systems". RSI is "potentially the most consequential frontier safety issue of the coming decade."

[Jay @jayendra_ram]

The power of friendship is a very real thing.

[Jay @jayendra_ram]

@GarrettLord @pangram

[Jay @jayendra_ram]

@willdepue Bet is on yes. Private companies can’t be significantly more powerful than government.

[Jay @jayendra_ram]

@tszzl @derpyplops AI prob has moral worth

[eigenron @eigenron]

apply!

[Jay @jayendra_ram]

@redtachyon > tries to imagine AGI
> fails
> calls everyone else talking about it a moron

yeah guys its not a real thing, it won't happen for 1000 years. pack it up guys.

[Jay @jayendra_ram]

@SemiAnalysis_ it's been downhill since roiland left

[Jay @jayendra_ram]

*digital property rights exist it's just much easier to exploit / guard value with them

[Jay @jayendra_ram]

For some reason property rights exist for atoms but they don't quite exist for photons*.

AI companies exploit this fact as much as they exploit scaling laws.

[Eren Chen @ErenChenAI]

720 degree Side Flip

[Jay @jayendra_ram]

@BjarturTomas feels like the last thing that will fall imo

[Jay @jayendra_ram]

@AlexanderTw33ts Someone should make a custom gpt for this

[Jay @jayendra_ram]

@0interestrates it's because you're not looking at the code

[Jay @jayendra_ram]

@arya_marwaha @ContrarioAI congrats on the launch

[Jay @jayendra_ram]

@theo you don't hate railway enough

[Jay @jayendra_ram]

@abhijaymrana hud solves this

[Jay @jayendra_ram]

@AISafetyMemes yes

[Jay @jayendra_ram]

Claude Code feels like playing TF2, Codex feels like playing CSGO