jared tumiel

comp bio @RetroBio_

[rico meinl @ricomnl]

super excited to announce our collaboration to the world! here’s the backstory: we started with a shared goal of using AI to generate novel discoveries that would be non-trivial for human scientists to make

[rico meinl @ricomnl]

my team is hiring for a research associate! we're looking for ambitious people right out of their undergrad who want to get 1-2 years of experience in a fast moving environment before starting a PhD (at or outside of Retro)
https://t.co/PLqXgVLxPW

[jared tumiel @jnearestn]

it’s a good model sir

[Simón Vidal @SimonVidalV]

We keep building

retro/altos
🚀

[jared tumiel @jnearestn]

@Andrei_Tarkhov staring at the fastq

[John David Pressman @jd_pressman]

@Meaningness EY basically told you to predict the next token and take it as a bug report if your epistemology is not helping you predict the next token. If an agent wants to make its Brier score go down eventually it *has* to learn to balance various incomplete systems or it gets stuck.

[roon @tszzl]

there is no way to "prepare for the future of work". you just need to survive

[Stephen Malina @an1lam]

This is unfortunate because the ostensible benefit of aggregators is matching people with diverse preferences to the diverse menu of options available. But instead we get "cultural mode collapse".

[🍓🍓🍓 @iruletheworldmo]

literally stands for

Oct 1

lul. agi is cool I guess.

[𒐪 @SHL0MS]

the fact that Apple sets this as default-on and only allows you to turn it off manually from each app’s individual settings implies that they are collecting a ton of data from this

you don’t need dark patterns for settings that aren’t valuable to you

[Aidan McLaughlin @aidan_mclau]

chain-of-thought
tree-of-thought
monte-carlo-tree-of-thought
graph-of-thought
backtracking-tokens-of-thought
vector-space-of-thought
oh-wait-that's-just-a-model-of-thought
hilbert-space-of-thought
non-euclidean-geometry-of-thought
covariant-general-relativity-of-thought

[Armand Domalewski @ArmandDoma]

the world has entered its spacepunk era

[Aidan McLaughlin @aidan_mclau]

it's only called reasoning if it's from the brain region of homo sapiens. otherwise, it's just sparkling auto-regression

[Sam Altman @sama]

no more patience, jimmy

[jared tumiel @jnearestn]

@garybasin inference compute go brr

[jared tumiel @jnearestn]

@acidshill internal tiktok PM

[Mark Goldstein @marikgoldstein]

Probably need gradient clipping or cosine LR decay

[Tom Tumiel @tomtumiel]

link: https://t.co/9plCQiSb4Q

[jared tumiel @jnearestn]

discusses tricks & techniques for model training and inference at scale:

- model compilation
- kernel fusion
- KV-caching
- gradient accumulation
- low-rank finetuning
- sharding & data parallelisation

+ more, go check it out!

https://t.co/3YoZQUEzBU

[jared tumiel @jnearestn]

so much alpha in one blog post:

practical scaling of LLMs by @tomtumiel
link below