Tao Xu

Learning Machine at OpenAI

[Tao Xu @txhf]

@philfung @foundation_robo grab me next time when you visit robots

[Tao Xu @txhf]

@NandoDF the notebook put KL into advantage calculation and normalization, it couples KL with extra variances?

[Tao Xu @txhf]

@E0M that is impressive.

[Tao Xu @txhf]

A rich testbed for studying many interesting problems.

[David Duvenaud @DavidDuvenaud]

Announcing Talkie: a new, open-weight historical LLM! We trained and finetuned a 13B model on a newly-curated dataset of only pre-1930 data. Try it below!

with @AlecRad and @status_effects 🧵

[Tao Xu @txhf]

@yifan_zhang_ GPT 1 was rejected by Neurips, GPT2 not submitted to conference

[Tao Xu @txhf]

@percyliang @Jianlin_S is QB too greedy that needs to suboptimal specialization? would it require injecting gumbel noise before QB or temperature scaled QB? @Jianlin_S

[Tao Xu @txhf]

not true

[Mike Kalil @mikekalilmfg]

Figure AI CEO on "Firing" OpenAI: "We just got like no value out of the whole relationship."

Figure founder Brett Adcock brought a Figure 03 to Shawn Ryan's podcast, where he went into detail about the startup's early relationship with OpenAI that dissolved a year after it started.

Adcock, who previously founded Archer Aviation, said the arrangement was useful for fundraising at first but not much else.

"We just found that the team we had internally. We just ran like kind of circles around them like every day," he said.

The breaking point came when he learned that OpenAI planned to restart its robotics program. That meant Figure's engineers would essentially be teaching a competitor.

“We’re like teaching you how to do robot learning… you’re seeing our progress," he said. "There’s no way we’re going to teach you how to do this stuff anymore.”

It was Adcock's first appearance for a podcaster who's not a Figure AI investor since the split. It was recorded around the time First Lady Melania Trump welcomed the $39 billion startup's third-generation robot, the Figure 03, at the White House for a summit on technology and education.

Figure AI has developed its own vision-language-action model called Helix.

[Tao Xu @txhf]

@FakePsyho very cool! are we all the last generation of programmers?

[Tao Xu @txhf]

@pmddomingos other than sugar coating unification, what can it do that DL can not do?

[Tao Xu @txhf]

@natolambert wondering how many of those equations will survive the test of time.

[Tao Xu @txhf]

@Yuhu_ai_ Congrats on your achievements on your ride of a lifetime, looking forward to seeing your next adventure.

[Trevor Cai @trevorycai]

3 years ago, we emailed Jensen with requests for Blackwell. Today, we released GPT-5.3-Codex, a SOTA model designed for GB200-NVL72. Nitpicking ISA, simming rack designs, and tailoring our arch to the system has been a fun experience! I'm grateful to our collaborators at NVIDIA.

[Tao Xu @txhf]

@adityaag just quoting Charles Dickens, combining last a few due to the length limit.

[Tao Xu @txhf]

@adityaag It was the best of times, it was the worst of times, it was the age of wisdom, it was the age of foolishness, it was the epoch of belief, it was the epoch of incredulity, it was the season of light, it was the season of darkness, it was the spring of hope, was the winterofdespair

[Neil Rathi @neil_rathi]

New paper, w/@AlecRad

Models acquire a lot of capabilities during pretraining.

We show that we can precisely shape what they learn simply by filtering their training data at the token level.

[Tao Xu @txhf]

we are so back!

[Fidji Simo @fidjissimo]

Excited to welcome Barret Zoph, Luke Metz, and Sam Schoenholz back to OpenAI! This has been in the works for several weeks, and we’re thrilled to have them join the team. Barret will report to me; Luke and Sam will report into Barret. More to come on what they’ll focus on soon!

[Tao Xu @txhf]

@barret_zoph so happy to see you coming back.

[Gabriel Goh @gabeeegoooh]

and this is just the start!

[Tao Xu @txhf]

outcome of small team and many gpus

[OpenAI @OpenAI]

Introducing ChatGPT Images, powered by our flagship new image generation model.

- Stronger instruction following
- Precise editing
- Detail preservation
- 4x faster than before

Rolling out today in ChatGPT for all users, and in the API as GPT Image 1.5.

[Tao Xu @txhf]

@soumithchintala thank you for your work on pytorch. I left FB 12+ years ago, it was pretty damned good outside.