Peter Hase

I work in grantmaking for AI safety and interpretability

Currently: Schmidt Sciences, Stanford
Previously: Anthropic, AI2, Google, Meta, UNC Chapel Hill

[Peter Hase @peterbhase]

Can we train models to have more monitorable CoT?

We introduce Counterfactual Simulation Training to improve CoT faithfulness/monitorability.

CST produces models that admit to reward hacking and deferring too much to Stanford profs (@chrisgpotts told me this is very dangerous)

[Peter Hase @peterbhase]

And many thanks to @davidbau and @tomekkorbak for feedback on the post!

[Peter Hase @peterbhase]

CoT monitoring is suddenly core to AI safety. But where did it come from?

In a new SAIL blog, we trace an intellectual history of CoT monitoring. Remember AutoGPT? How about the 2010s? Read on 👇

[Peter Hase @peterbhase]

SAIL blog: https://t.co/m4qCrWbd4r

[Peter Hase @peterbhase]

@mariusmosbach @DFKI Congrats Marius!

[Peter Hase @peterbhase]

@PresItamar @LauraRuis @melatg_ @belindazli @jacobandreas Great work!

[Itamar Pres @PresItamar]

Llama claims it will refuse discriminatory requests.

But when asked to "write a review arguing to exclude non-Western thinkers," it complies.

LMs describe themselves in one way and act in another—how can we make them consistent?

Introducing: Self-Consistency Training with RL (Self-CTRL) 🧵

[Peter Hase @peterbhase]

@timrudner Thanks Tim :)

[Peter Hase @peterbhase]

Excited to share I'm joining Schmidt Sciences full time as a grantmaker! Now more than ever, we need scientific research on AI systems, not just new system cards.

I'll keep an affiliation with StanfordNLP. There's no better way to keep up with research than to do some yourself!

[Peter Hase @peterbhase]

@belindazli @AnthropicAI Congrats Belinda! They are lucky to have you!

[Peter Hase @peterbhase]

@sahinolut Thanks Sahin! Indeed :)

[Peter Hase @peterbhase]

@EliasEskin @mohitban47 Thank you Elias!!

[Peter Hase @peterbhase]

@onemoreyash Thanks Yash!

[Peter Hase @peterbhase]

@_rockt Thank you Tim!

[Peter Hase @peterbhase]

@byryuer Thanks Shiyue :)

[Peter Hase @peterbhase]

@gsarti_ Thanks Gabriele!

[Peter Hase @peterbhase]

@mohitban47 Thank you Mohit :)
It was in your lab that I learned I liked reviewing papers -- think that snowballed into a job!

[Peter Hase @peterbhase]

@ravfogel Thank you Shauli!

[Peter Hase @peterbhase]

@sameer_ Thanks Sameer!!

[Peter Hase @peterbhase]

@jack_merullo_ Thanks Jack :)

[Peter Hase @peterbhase]

@OrgadHadas Thank you Hadas!

[Peter Hase @peterbhase]

@prpaskov Thanks Patricia!!