OOM

rl researcher

[OOM @oombyte]

@comma_ai @thdxr running on a tinybox?

[OOM @oombyte]

@buckberi when

[OOM @oombyte]

@MizoChris when will it release

[OOM @oombyte]

i need a gpu plug

[OOM @oombyte]

@tenobrus brave

[OOM @oombyte]

@dwarkesh_sp fortnite

[OOM @oombyte]

@jsuarez what paper? so we don't waste our time w it

[OOM @oombyte]

@leothecurious but then you can just define reward as surprisal

[OOM @oombyte]

@leothecurious purposefuly doing misspellings to show we are human

[OOM @oombyte]

the layernorm paper is impressive because they made a 14 page paper out of a single transpose

[OOM @oombyte]

agi test: win a game of fortnite

[OOM @oombyte]

@CSI_Starbase 🐐

[OOM @oombyte]

the latent tokens are seeping through

[OOM @oombyte]

one-shotting superintelligence will be important so there isn't a drawn out painful transition period of job loss and mediocre economy growth

[OOM @oombyte]

first image from the mythos page kinda looks like diffusion?

[OOM @oombyte]

seems likely that mythos has a n^2 pretraining phase and then an nlogn inference phase, which is done with meta-attention, or with some type of iterative refinement (diffusion?) of the attention mask, which allows long context lengths needed to chain vulnerabilities

[OOM @oombyte]

1 pass is n tokens. two passes is 2n. log(n) passes is n log(n)

[OOM @oombyte]

lol and it has inflation which dilutes its strength over time (entropy)

[OOM @oombyte]

energy is the currency of the universe

[OOM @oombyte]

@__tinygrad__ @jsuarez 🫡

[OOM @oombyte]

the same mechanism used to simulate forward into the future is the same used to recall the past