Mitchell Goff

nihil supernum | research @

[tender @tenderizzation]

i love apple photos memories because it’ll be like hey remember when you found a parking spot in hayes valley in 2022? wasn’t that special?

and i’ll be like yeah it was. that’s exactly why i took a photo of that moment. thank you apple photos

[Mitchell Goff @mitchellgoffpc]

@___Harald___ Looks tiny 🤏

[Mitchell Goff @mitchellgoffpc]

@ssshaney @AnthropicAI let him cook

[Mitchell Goff @mitchellgoffpc]

@DavidSHolz @yassineyousfi_ we experimented with using slurm for everything, but the scheduler struggles to keep up past a few hundred jobs per second, and for short-lived tasks we often run thousands per second

[Mitchell Goff @mitchellgoffpc]

@DavidSHolz @yassineyousfi_ we use https://t.co/CeAPPv0wld, the workers run as preemptible slurm tasks so we can easily switch between training and inference on a single cluster

[Mitchell Goff @mitchellgoffpc]

@tenderizzation @squirtle_says how it be parking stick shift on a hill

[typedfemale @typedfemale]

you may live to see man-made horrors beyond your comprehension

[Mitchell Goff @mitchellgoffpc]

@DavidSHolz .@yassineyousfi_ has done a bunch of solo 32-node runs, but even that is a lot of work. I’d guess 128 is close to the hard limit unless your infrastructure is _really_ good.

[Mitchell Goff @mitchellgoffpc]

@tugot17 you joke but I'm guessing the graph will look a lot like this, albeit over a 10x shorter time horizon

[Mitchell Goff @mitchellgoffpc]

@giffmana

[Lucas Beyer (bl16) @giffmana]

The model and the limit reset button are now the product

[Mitchell Goff @mitchellgoffpc]

@francoisfleuret Oh, I don't know... seems like we actually may have just woken up!

[Mitchell Goff @mitchellgoffpc]

@tkanarsky @jayendra_ram grok

[Mitchell Goff @mitchellgoffpc]

@karpathy @jino_rohit An 8x3080 box will do the job in 10 minutes instead of 90 seconds, but even those are getting harder to find these days!

[Mitchell Goff @mitchellgoffpc]

@___Harald___ @_arohan_ monotonicity is overrated

[Mitchell Goff @mitchellgoffpc]

@tszzl gotta use /extrasausage

[Mitchell Goff @mitchellgoffpc]

San Diego cocktail prices going for the “shock and awe” tactics

[tender @tenderizzation]

it’s literally off the scale! welcome back yolov3

[Mitchell Goff @mitchellgoffpc]

@oosindf @goodside @deepfates depends who you ask

[Mitchell Goff @mitchellgoffpc]

@KelseyTuoc @CharlesFLehman I feel like this is a real structural issue with prediction markets, there's very little signal for low-probability events since the inflation-adjusted EV of betting against is negative even if the true odds are 0%.