@sama Autonomy, maybe? First use after the upgrade genuinely shocked me a bit. Felt like one of those GPT-2-ish “something just crossed a line” moments.
Our interpretability team recently released research that traced the thoughts of a large language model.
Now we’re open-sourcing the method. Researchers can generate “attribution graphs” like those in our study, and explore them interactively.
New Anthropic research: Tracing the thoughts of a large language model.
We built a "microscope" to inspect what happens inside AI models and use it to understand Claude’s (often complex and surprising) internal mechanisms.
I wanted to know if gpt-4o can create a graph with the same insights:
And apparently not.
It gave me false data & makes up words.
It might only work for simple tasks.
test #4: write an article
Wild. GPT-4o on ChatGPT can generate full blown charts and statistical analysis from spreadsheets with a single prompt in less than 30 seconds.
This stuff use to take ages in Excel.
Wow, this is insane!!
First: reverting to pre #RLHF behavior #ChatGPT4#ClaudeSonnet
Link: https://t.co/awjvhgvpKm
Second: Extracting the training data from models like #ChatGPT#LLaMA
Link: https://t.co/VXDt5CSlkP
Today, we're announcing Claude 3, our next generation of AI models.
The three state-of-the-art models—Claude 3 Opus, Claude 3 Sonnet, and Claude 3 Haiku—set new industry benchmarks across reasoning, math, coding, multilingual understanding, and vision.
@aryaman2020@jurafsky@ChrisGPotts Fascinating research! I've often noticed causality emerging seemingly out of nowhere in neuron interactions. Actively exploring methods to minimize these instances in my work. Excited to delve deeper into the insights from your paper!
@randall_balestr Very interesting work. It’s definitely gonna help in trying to understand the role of a single neuron or to avoid superposition of a neuron.
Imagine your smartwatch running out of juice, but fear not! A brilliant idea: a fallback mode that transforms it into a classic timepiece, powered by a regular battery. Smartwatch downtime? Not anymore! ⌚️🔄 #SmartwatchFallback#Innovation@Apple@Google