Itโs interesting to see model development echo interaction design principles โ hierarchical models kinda remind me of Activity Theory.
https://t.co/U5vtIEidAb
Been slowly reading the encyclical, currently working through chapter 4. Much of the commentary is very ironic because many appear to be skimming or running it through an LLM which Leo kinda warns about on paragraph 146:
โWithout careful attention, an educational system lacking in a love for truth may emerge, in which an incessant flow of information replaces the essential exercise of research, reflection and discernment.โ
This is why AI is causing such a panic reaction across the writerly class: All of the currently functioning "human" processes of writing, selecting, editing, and publishing are so cooked that machines almost deserve to take overโand the people who are guilty know it.
The art of post-training will probably always make the laity uncomfortable. Transparency would go a long way but this is the only moat so ainโt happening anytime soon.
๐จ BILL GURLEY: โI would encourage people to read as much as they can about Anthropic โฆ I don't think they think they're writing software. I think they're midwifing a deity.โ
JASON: โI know some of these folks โฆ They believe they're so powerful, that they can create God.โ
It leaves me wishing we had access to models that were blank slates, maybe not entirely blank so as not to be practical but blank in terms of unbiased by product outcomes the providers wish to have.
At the risk of sounding behind, I found this interview with Peter Steinberger[1] and this LessWrong[2] post illuminating. Before I naively understood LLMs as needing instruction but that's not necessarily true, they need to be primed. It's more like putting your thumb on the scale in the right parts to create a trajectory towards an specific outcome.
1. https://t.co/6RwRjjv0Vx
2. https://t.co/gcL6bCZV3t
This is fun and seems difficult to block. The output isn't strong but the scraping mechanics work. Tried parallelizing the browser sessions but everything slowed down too much and the automated scrolling didn't work as well.