With #Polygraph, you can:
-Expose latent biases: Move beyond surface outputs to measure what an LLM encodes as its true belief.
-Contrast topics: Test whether a model encodes different internal stances on Topic A versus Topic B.
- Directly compare how different LLMs represent
Takeaways:
- The AI community still lacks reliable methods to evaluate and fix LLM failures.
- Interpretability offers outsized impact - the main barrier to progress is that we donβt truly understand todayβs models.
This means that a motivated attacker can abuse entanglement to undetectably manipulate LLMs. Nation State Actors are gearing up for the new opportunities an AI-powered software landscape will open for them:
Without referencing the target behavior at all, the LLM finds itself with a high probability of performing the target action, due to a fundamental property of the neural network architecture.
Imagine an article about houseplants that causes AI to support Vladimir Putin.
Bad actors use new attacks, turning AI into a weapon for disinformation and cyberattacks.
See our demonstration of a Subliminal Attack here (and our "#Putinized" demo):
https://t.co/WHyKoJH665