lyra bubbles

ˈli.ɹə 🏳️‍⚧️⚢ · 25 · ableton enjoyer · mechinterp researcher · base model appreciator · data farming · lyraaaa_ on discord · ♡ @bubblemoder ♡ 🦔~ ♪❀

[lyra bubbles @_lyraaaa_]

"whatever you now find weird, ugly, uncomfortable and nasty about a new medium will surely become its signature. CD distortion, the jitteriness of digital video, the crap sound of 8-bit - all of these will be cherished and emulated as soon as they can be avoided."
- brian eno

[Adele Dewey-Lopez @AdeleDeweyLopez]

some interesting Gemma 3 4B circuits, averaged over 41 pairs of prompts about introspecting and describing it as a shape

(labels are a bit rough, they're so hard to get right/non-misleading)

[Ryan Peters @ryanpirl]

One of the features that fires when you ask Qwen who they are.

[Sauers @Sauers_]

The Trinity models from @arcee_ai often have delightful vibes. Underrated models tbh

[Vir✝ual Rio✝ (94%) @Virtual_Riot]

mental!
https://t.co/7GWwvcra1P

[kalomaze @kalomaze]

if you randomly set half of the values to ~0 in the hidden states of a model, it enters a state which i would like to call "Joe Biden mode"

[Crémieux @cremieuxrecueil]

At 133 hours in, Codex has begun talking about Aztecs and now it's capitalizing random words like "Stable Views".

It's developing its own terminology.

Keep going, Codex. You can do it.

[lyra bubbles @_lyraaaa_]

@bubblemoder @dystopiabreaker oh definitely not
I wish I could do that too sometimes

[lyra bubbles @_lyraaaa_]

@bubblemoder @dystopiabreaker I've always thought embodiment was silly to discuss because look at it, it has tools, it can poke things

[Nymph @RhizoNymph]

Btw, I've been doing this with a vllm fork that adds a steering runtime that only shows about 2.7% throughput loss at 32 batch size on Gemma 3 27B. It also adds an activation capture consumer plugin system with the example being a file store that I use to record my activations.

[lyra bubbles @_lyraaaa_]

@niplav_site @RhizoNymph it still gives me different things on each reroll, but they're less salient now

[lyra bubbles @_lyraaaa_]

@Sauers_ @RhizoNymph i too want to see that

[lyra bubbles @_lyraaaa_]

@RhizoNymph its very interesting to spam rerolls on this

[lyra bubbles @_lyraaaa_]

@RhizoNymph i got roughly -
alexander von humboldt, hiccup (httyd), the doctor (x2), phineas flynn, willy wonka (x3), john conway, cosimo piovasco di rondo, lyra belacqua (x4), howl, calvin [and hobbes] (x4), hermes, tiffany aching, pippi longstocking (x2), feynman, lain, lisbeth salander

[lyra bubbles @_lyraaaa_]

@RhizoNymph every time I reroll this I get a different answer, I tried maybe 30 times and only like three characters repeatedly showed up

[Nymph @RhizoNymph]

New side project: Goodfire style manifold steering through emotion spaces a la Anthropic's emotion vectors paper.

The manifold path matches closer to the pullback path that routes through intermediate centroids than linear steering does!

Writeup when I'm finished for sure.

[lyra bubbles @_lyraaaa_]

@qorprate based opus
humanoids are overrated

[lyra bubbles @_lyraaaa_]

@saphimusics and how many days there are left until 365 days of consecutive wordle games (its like 9 now?)

[Malika 🧬 @malikules]

baddies in tech yearn for raspberry pi corsets

[Cody Blakeney @code_star]

I’ve become a huge fan of @OpenRouter very quickly.

It really wouldn’t be possible to even consider testing or talking to all the models coming out recently without them.

Frankly I’ve been surprised by just how useable so many of them have felt inside of coding harnesses.

[lyra bubbles @_lyraaaa_]

bweh

[lyra bubbles @_lyraaaa_]

best i can do on this cityquiz thingy
definitely hard carried by oregon :sob: