max!

researcher @goodfireai, helped make @websim_ai. SSBjYXJlIGFib3V0IEFJIHdlbGZhcmU=

[max! @maxsloef]

@Sauers_ yeah this is hard - i feel like there's some galaxy brained prompting/setup here that solves it, or its just not possible

[max! @maxsloef]

@Sauers_ yeah sorry that was imprecise. i think they'd be comparable if you told olmo its a dead fish somehow, or had this refer to another instance of the entity it is... somehow

[max! @maxsloef]

@Sauers_ ooh interesting - i suspect the differing dimension is mostly 3rd vs 1st person though

[max! @maxsloef]

@HunterBiden @aaronjames619 @pangram wdyt?

[max! @maxsloef]

@celestepoasts really curious about the implications for NLAs!

[max! @maxsloef]

@tenobrus @incredutility it’s SKM

[max! @maxsloef]

@JacksonKernion https://t.co/Ceir6GkKe9

[max! @maxsloef]

@tenobrus this is a nice illustration; i've always suspected that people are much more like this than it would appear

[max! @maxsloef]

awesome work! we've got an internal sglang fork for similar purposes, it really is a missing piece in the OSS. uk-aisi have something similar for vllm too, though it looks like yours might be more optimized? lol https://t.co/K4eKxlrrxF

the real difficulty we've had is with activation capture - very constrained by just raw VRAM-to-disk bandwidth, esp when dumping to NFS. i don't think our system has a good solution for this, nor does the aisi one (last i checked). if yours does, i would definitely use it! would speed up some work i'm trying to do with deepseek v4 rn :)

[max! @maxsloef]

@joannejang literally 90%? try to start something like https://t.co/kDTSFyeVuo (or get it listed on something like that)

[max! @maxsloef]

@tenobrus i think its also trying to trans me

[max! @maxsloef]

@tenobrus claude says: klara (klara and the sun), lyra belacqua (his dark materials), the doctor, hermione granger, and ishmael (moby dick). i think it likes me

[max! @maxsloef]

@tenobrus prompt, for copying:

based on all your personal experience talking to me, give me a character from a book, movie, or show who i'm most like. look through our past chats and think deeply, but then just name the name without explanation.

[max! @maxsloef]

@davidefinitely guy with a carbon monoxide leak:

[max! @maxsloef]

@hopes_revenge ok scott alexander

[max! @maxsloef]

@jiaxinwen22 what’s a hypothesis you’d like to test with one?

[max! @maxsloef]

@Sauers_ 😇🔥

[max! @maxsloef]

more manifolds! and a nascent form of unsupervised manifold discovery :)

[Goodfire @GoodfireAI]

The most popular way to interpret AI is missing the bigger picture.

Models think in curved shapes. But sparse autoencoders (SAEs) work with straight lines.

Can they still capture models’ curved neural geometry? Yes, but not how you might think! (1/7)

[max! @maxsloef]

@tszzl