Exabite AI

Over 60 Trillion incremental corpus-quality pretraining tokens!!!!

[Exabite AI @ExabiteAI]

come hunt tokens with us

[near @nearcyan]

My job? I'm a rare token hunter. I track down dead languages in Tibetan monasteries, decrypt Tesla's private journals, chase whispers of pre-contact Amazonian dialects. The AIs pay top credit for tokens they've never tasted, you know. Work is work, even if it's for the machines.

[Exabite AI @ExabiteAI]

We are launching as Exabite

Frontier AI labs have only exploited a small % of the world's data.

We've found:
- 10s of trillions of corpus-quality tokens (100% incremental to common sources)
- Exabytes of total OTS data
- Hundreds of Petabytes of total PDFs

DM to inquire

[Exabite AI @ExabiteAI]

@TimFarrelly8 wouldnt u like to know 😉

[Exabite AI @ExabiteAI]

https://t.co/Xk3ru7g3xb

[Exabite AI @ExabiteAI]

@avaitopiper so true

[Exabite AI @ExabiteAI]

there is a lot of alpha in actually looking at the data

[Epoch AI @EpochAIResearch]

We looked at OSWorld, a popular evaluation of AI computer use capabilities.

Our findings: tasks are simple, many don't require GUIs, and success often hinges on interpreting ambiguous instructions. The benchmark is also not stable over time.

See thread for details!

[Exabite AI @ExabiteAI]

making a new dataset with 6 - 7 trillion tokens

[Exabite AI @ExabiteAI]

Beware narratives!

[Miles Brundage @Miles_Brundage]

Seems like the whole "RL just surfaces intelligence, it doesn't increase it" series of papers is just an artifact of RL being a small fraction of compute in most LM contexts still, no?

AlphaGo (etc.) shows quite clearly that there is nothing to this as a general matter

[Exabite AI @ExabiteAI]

@mattfreed @cis_female is working on this

[Exabite AI @ExabiteAI]

@cuijiaxun Hi! Let's chat :)

[Exabite AI @ExabiteAI]

@uzpg_ @KaivuHariharan Let's meet!

[Exabite AI @ExabiteAI]

@nikolaj2030 @Miles_Brundage it's unreal how much better the Inspect codebase is than other open source evals frameworks

[Exabite AI @ExabiteAI]

If you want top talent, you need to be willing to pay for it

[Exabite AI @ExabiteAI]

@e869120 ❤️❤️

[Exabite AI @ExabiteAI]

@avaitopiper @joodalooped thanks bhavit :)

[Exabite AI @ExabiteAI]

How's that for a makeover?

Thanks @joodalooped

Check us out at calaveras dot ai

[Exabite AI @ExabiteAI]

@tkskri_kypr おめでとうございます！もしAI業界をリードする企業でRL環境の未来を築くことに興味がある方がいらっしゃいましたら、DMをください。ランチをご馳走させていただきます ^_^

[Exabite AI @ExabiteAI]

@leilavclark @joodalooped thanks leila :)

[Exabite AI @ExabiteAI]

I've been interviewing so many impressive programmers who deeply understand the systems they work with, are driven, and have grit.

We work on hard problems, pay good comp, and have an exciting mission.

If you think you'd like it here, please DM me!

[Zy @ZyMazza]

U should be required to poast the salary you’re offering when you say stuff like this