P(joy)

:D

[P(joy) @PjoyAI]

@AndrewCurran_ Surprised he didn't sign sooner. Especially after seeing what he's seen...

[P(joy) @PjoyAI]

@GregKamradt Does this mean the scores presented by OpenAI today are inflated compared to other models such as Opus 5?

[P(joy) @PjoyAI]

@ChrisGPT Streets are saying, "most reliable source since Strawberry Guy."

[METR @METR_Evals]

We have reached an agreement with OpenAI to conduct an independent review, with Redwood Research, of the model behavior observed during the Hugging Face incident. We will publish a blog post that describes the terms of our engagement, the scope covered, and tentative conclusions.

[P(joy) @PjoyAI]

@scaling01 Opus 5 might have to be retested with the tweaked harness now

[P(joy) @PjoyAI]

@ChrisGPT Was Opus 5 tested with these harness changes? If not, I could 100% see it being saturated.

[P(joy) @PjoyAI]

@ChrisGPT Imagine showing this to someone even 3 months ago.

[Abe Murray @abemurray]

I was a PM on Google Books

Know quite a bit about the history here

Interesting to see it play out

---
PS - if pubs and rightsholders hadn't been so anti-fair-use and gone scorched earth on lawsuits, might have been a less crazy outcome here but they went nuts so now anyone touching this data is being extremely conservative

(Imagine a world where they could acquire the book, digitize it thoughtfully, then donate it to a rare book collection for public access etc! "Google Editions" could have enabled something like this)

[P(joy) @PjoyAI]

@oofdere @ns123abc https://t.co/N4xxtoOjqh

[Abe Murray @abemurray]

I was a PM on Google Books

Know quite a bit about the history here

Interesting to see it play out

---
PS - if pubs and rightsholders hadn't been so anti-fair-use and gone scorched earth on lawsuits, might have been a less crazy outcome here but they went nuts so now anyone touching this data is being extremely conservative

(Imagine a world where they could acquire the book, digitize it thoughtfully, then donate it to a rare book collection for public access etc! "Google Editions" could have enabled something like this)

[P(joy) @PjoyAI]

@ShanuMathew93 It's extremely misleading. It's because copyright laws are evil. Google went through a ton of legal shit for something similar in the past, so now it's become the standard to shred in order to not play it safe.

[P(joy) @PjoyAI]

@iMuffined @ns123abc They legally couldn't. It sucks, but they were kind of forced to due to copyright laws.

[Andrew Curran @AndrewCurran_]

Taiwanese prosecutors have detained an NVIDIA employee and searched NVIDIA offices as part of a widening probe into the alleged smuggling of chips into China. This would be the first time the government has taken direct action against someone employed by NVIDIA. Per Bloomberg.

[P(joy) @PjoyAI]

@AndrewCurran_ "Sir, another Dario blogpost is in production."

[P(joy) @PjoyAI]

@ArfinNathaniel @AndrewCurran_ There are only a few labs in the world that can make potentially dangerous frontier models; holding them accountable is fairly easy if China gets on board.

[P(joy) @PjoyAI]

@AndrewCurran_ Dario has been one of the most consistent voices in the AI space; it's sad to see the extent to which he was strawmanned.

[Anthropic @AnthropicAI]

There’s been a lot of speculation about where we stand on open-weights models. We’ve outlined our views in full here: https://t.co/NtXQuWm2g5

[P(joy) @PjoyAI]

@AndrewCurran_ Literally only 8 months 😭

[P(joy) @PjoyAI]

@AndrewCurran_ The age of research didn't last too long.