🧵Can we “ask” an LLM to “translate” its own hidden representations into natural language? We propose 🩺Patchscopes, a new framework for decoding specific information from a representation by “patching” it into a separate inference pass, independently of its original context. 1/9
Visualize transformer attention! ✨
AttentionViz, created by Catherine Yeh and expanded by Yida Chen, helps you explore transformer self-attention by visualizing query and key vectors in a joint embedding.
Paper: https://t.co/M7upXjDoZG
Website: https://t.co/rKJgIHm6q0
Language models have some beautiful spiral plots reflecting positional patterns. And a vision model has heads that arrange images according to brightness and hues. But there’s a lot more to find! What else can you see?
Toasters have blinking lights, cars have speedometers. Should chatbots have dashboards too?
A speculative essay👉 The System Model and the User Model: Exploring AI Dashboard Design
https://t.co/HLcjX3Kdwe
Students explore the aesthetics of computing in new computer science course at SEAS. "CS73: Code, Data, and Art" is co-taught by @wattenberg and @viegasf, and teaches students how to create abstract art and communicate data sets through visualizations. https://t.co/se8D0Tkbqd
Ten years ago #OTD, @viegasf and @wattenberg released "wind map." Then came @cambecc's https://t.co/B53U1wU2pU.
My story for Earth Island Journal.
https://t.co/AbarRZ7buN
Looking for a postdoc position in data visualization, human-centered machine learning, or both? Consider joining our lab at Harvard!
Here’s the official announcement: https://t.co/ztF5ByJkzW
My kids just donated to @SavetheChildren to support their life changing programs for children in need https://t.co/GKbdlLbTu5
Consider donating this season.
Thinking about grad school next year? Interested in visualization, human/AI interaction, computational art?
Consider Harvard! @wattenberg and I are building up our lab and will be looking for students.
Our DMs are open.
We are hiring a full-stack software engineer for the PAIR team at @GoogleAI to work on projects at the intersection of #ML and #HCI, including our interpretability tools to support responsible #AI practices. Apply at https://t.co/bk80pUR2yw
1/3
"We went to Brazil because we wanted to escape" vs
"We went to Japan because we wanted to study"
Check out @adamrpearce's language model explorable, showing what models like BERT have learned about the world. #googlePAIR
Type your own queries:
https://t.co/tO2pJQJV7v
Hannah Fry @FryRsquared does a great job of showing how "humble" graphs such as line charts and scatter plots have changed the world and our understanding of it:
Thanks for the pointer, @m_pellat !
https://t.co/HgNUnBFf62
Are you an academic working in the areas of Participatory ML, Accessibility, Algorithmic Fairness or Higher Education in CS? If so, apply to Google’s Award for Inclusion Research (AIR)!
AIR is an international program 🤩
Application deadline: July 14
https://t.co/HGz4Czbggh
Interested in working with the PAIR team at Google on projects like Know Your Data?
Apply here, we're hiring!
And yes, "full stack": we really care about folks thinking about the intersection between UX / frontend and large scale data munging.
https://t.co/emMOlHSoF7