difficultyang

More social alt of @ezyang

[difficultyang @difficultyang]

Claude workshopping with me on thoughts on Chiang.

[difficultyang @difficultyang]

Maybe I am going to lose cred in the LLM whisperer community for this, but I thought Chiang's article was quite good. Chiang, perhaps of all people, should know how powerful a story is. But many of the other potential objections to Ted's frame are covered.

[difficultyang @difficultyang]

Someone needs to make a benchmark called "ReviewBench" where basically it teaches LLMs to stop approving PRs that humans rejected. "But this benchmark is unfair, no one wrote down X constraint." Yes. That is EXACTLY the point.

[difficultyang @difficultyang]

mmm actually opus 4.8 is fine to talk to, I enjoy it

[difficultyang @difficultyang]

@tenderizzation Shhhhhhh

[difficultyang @difficultyang]

I am happy the MAI report is so detailed; the next time someone says exascale PyTorch is dead I will refer them to this one LOL

[difficultyang @difficultyang]

Some discourse around Erdos was about a "hint book", where each hint was effectively one bit of information for the LLM. "Look for a counterexample." "Generalize the best known counterexample." This idea feels very important for elicitation beyond math. https://t.co/NLE8qfwUqL

[difficultyang @difficultyang]

Importantly, this is even after post facto we discovered already publicly available models could have made this discovery! From this I infer there is a built in slow down in capability diffusion predicated simply on elicitation ability

[difficultyang @difficultyang]

ANTI-GOONING SAFETY GUARD RAILS LEADS TO JAILBREAK ARMS RACE INCREASING PROBABILITY OF CATASTROPHIC AI XRISK SCENARIOS. In this essay I will...

[difficultyang @difficultyang]

Importantly, this is even after post facto we discovered already publicly available models could have made this discovery! From this I infer there is a built in slow down in capability diffusion predicated simply on elicitation ability

[difficultyang @difficultyang]

This makes the "if anyone can make a bioweapon" xrisk argument less scary. It does NOT make the "extremely motivated adversary" (crime, governments, etc) xrisk less scary, but this scariness feels more "priced in" in terms of traditional geopolitical risk (eg nuclear)

[difficultyang @difficultyang]

Here's an argument why LLM based biological xrisk will have a warning lead time. If any random joe could elicit model capability, we would have seen major AI math breakthroughs from random cranks. But instead OAI got there first.

[difficultyang @difficultyang]

Importantly, this is even after post facto we discovered already publicly available models could have made this discovery! From this I infer there is a built in slow down in capability diffusion predicated simply on elicitation ability

[difficultyang @difficultyang]

Building software for large scale training is kinda like tailoring: no two clusters are the same!

[difficultyang @difficultyang]

@diamondbishop Don't even get me started about Amazon Prime

[difficultyang @difficultyang]

As someone who is still on my parent's YouTube premium I FEEL SEEN (My wife refuses to use my family's side YT premium as a matter of principle lmao)

[Diamond Bishop 🤖 @diamondbishop]

@jain_harshit @Google You’re a staff engineer? Pay for an account. For that matter, pay for your parents’ account too. It’s not that complicated

[difficultyang @difficultyang]

The problem with token efficiency maxxing is you spend all your time building harnesses to overcome the model problems and not enough time actually getting shit done

[difficultyang @difficultyang]

A salt and buttery

[difficultyang @difficultyang]

Many strange things happened when you scaled things like "make it easy for people to talk to each other" or "tell people about things they might want to buy". Would you have predicted the rollout?

[difficultyang @difficultyang]

god dammit i can't deal with the bots noooooo

[difficultyang @difficultyang]

my new eval is how many actions it takes for an LLM to commit a diff (that is in its context) when I say "commit"

[difficultyang @difficultyang]

Blah. It looks like we are going to be replacing our 16yo HVAC system. Only a 9F temperature differential between intake and outtake