Top Tweets for #logitlens

about 2 months ago

How can we interpret the internal activations of LLMs? Logit lens is a popular technique to translate internal activations of an LLM to token space. In this blog, written during Project Viveka ,we examined where logit lens fails. #AI #LLM #mechanisticinterpretability #logitlens

258

Bob West @cervisiarius

over 2 years ago

What do we mean by “internal language”? Transformers gradually map token embeddings layer by layer to allow for predicting the next token. Intermediate embeddings before the last layer show us what token the model would predict at that point #LogitLens https://t.co/wLX6q43wMd

Top Tweets for #logitlens

Last Seen Hashtags on Sotwe

Trends for you

Most Popular Users