new post: a WIP update on the chain lens, a new technique i've been working on for verbalizing model hidden states!
the chain lens lets you extend single-token lenses like the J-lens into multi-token ones without any training, using an existing MTP head.
@euagaric@euagaric just because you dont hear it as sound, does not mean you can not experience as something analogous to sound right. What does the symphony do for you or mean to you
Chubinidze :: [Konior] directly thinks through a terrifying Hobbesian world teeming with alien intelligences of different degrees, raised to a cosmic scale, where Leviathan is constitutively absent ::
@crypsis000
https://t.co/3t5lvLiSjg
I often hear that score/flow matching is "just regression"
It's not, and a lot of what we take for granted about generalization in deep learning doesn’t carry over to diffusion models:
What is LM psychology, why care about it, and how do you do it well? Our new post with @raymondadouglas makes the case for applying the psychology frame to AIs, along with a reading list and suggestions for where to start
Looking inside LLMs with mech interp can also help settle the stochastic parrot debate. And it turns out that even vanilla LLM internally rely on the kind of structures philosophers describe in epistemology papers for "understanding. 1/
New paper! How should we think about pacing frontier AI?
We bid for a unified research field on all the options, and lay out a broad framework and 23 open questions we'll need to answer to act flexibly and sanely.
ARROWS, or: weapons that compute, or: whence direction?
Drawing an arrow between the technological device that is a pointed weapon all the way to the mathematical object that directs our abstractive attention
// a brilliant contribution to Spires @dif_fractions by Sonia de Jager
Chaos magick is about creativity. There is no single way to create a sigil, and a sigil does not necessarily need to be drawn. It can be sung, flashed, coded, tapped, knocked, or translated into any other medium.
In this example, the sigil is expressed as a rhythm.