Human/AI Interaction and data visualization. Professor at Harvard. Co-founder of Google's People+AI Research initiative (PAIR)

Joined February 2009
Great work by @ghandeharioun and others in PAIR on a new interpretability framework: 🩺Patchscopes
🧵Can we “ask” an LLM to “translate” its own hidden representations into natural language? We propose 🩺Patchscopes, a new framework for decoding specific information from a representation by “patching” it into a separate inference pass, independently of its original context. 1/9
15
6,829
Visualize transformer attention! ✨ AttentionViz, created by Catherine Yeh and expanded by Yida Chen, helps you explore transformer self-attention by visualizing query and key vectors in a joint embedding. Paper: arxiv.org/abs/2305.03210 Website: attentionviz.com/
7
135
5
645
86,813
Language models have some beautiful spiral plots reflecting positional patterns. And a vision model has heads that arrange images according to brightness and hues. But there’s a lot more to find! What else can you see?
1
6
2
27
3,372
Here's a close-up of hue and brightness heads in a vision transformer! Work done with tremendous help from Aoyu Wu and @chenxcynthia
3
21
2,243
Toasters have blinking lights, cars have speedometers. Should chatbots have dashboards too? A speculative essay👉 The System Model and the User Model: Exploring AI Dashboard Design arxiv.org/abs/2305.02469
2
13
3
53
9,451
Fernanda Viégas retweeted
Students explore the aesthetics of computing in new computer science course at SEAS. "CS73: Code, Data, and Art" is co-taught by @wattenberg and @viegasf, and teaches students how to create abstract art and communicate data sets through visualizations. buff.ly/3GXpkTE
8
1
26
Looking for a postdoc position in data visualization, human-centered machine learning, or both? Consider joining our lab at Harvard! Here’s the official announcement: main.hercjobs.org/jobs/15670…
1
38
1
144
Thinking about grad school next year? Interested in visualization, human/AI interaction, computational art? Consider Harvard! @wattenberg and I are building up our lab and will be looking for students. Our DMs are open.
21
128
13
671
And for information on the application process, see: seas.harvard.edu/computer-sc…
5
We are hiring a full-stack software engineer for the PAIR team at @GoogleAI to work on projects at the intersection of #ML and #HCI, including our interpretability tools to support responsible #AI practices. Apply at careers.google.com/jobs/resu…
3
46
5
162
1/3 "We went to Brazil because we wanted to escape" vs "We went to Japan because we wanted to study" Check out @adamrpearce's language model explorable, showing what models like BERT have learned about the world. #googlePAIR Type your own queries: pair.withgoogle.com/explorab…
1
3
27
2/3 "Fernanda was born in the year of 1954" vs "Martin was born in the year of 1750" At least it thinks I'm younger than @wattenberg... 😂
1
6
3/3 "In Texas, they like to buy land, beer" vs "In New York, they like to buy art, books" pair.withgoogle.com/explorab…
1
3
Hannah Fry @FryRsquared does a great job of showing how "humble" graphs such as line charts and scatter plots have changed the world and our understanding of it: Thanks for the pointer, @m_pellat ! newyorker.com/magazine/2021/…
1
15
Are you an academic working in the areas of Participatory ML, Accessibility, Algorithmic Fairness or Higher Education in CS? If so, apply to Google’s Award for Inclusion Research (AIR)! AIR is an international program 🤩 Application deadline: July 14 research.google/outreach/air…
8
20
Fernanda Viégas retweeted
Interested in working with the PAIR team at Google on projects like Know Your Data? Apply here, we're hiring! And yes, "full stack": we really care about folks thinking about the intersection between UX / frontend and large scale data munging. careers.google.com/jobs/resu…
The PAIR.withGoogle.com team is hiring in Paris - if you are a Research Scientist or Software Engineer with a keen interest in research, look here :) careers.google.com/jobs/resu…
Fernanda Viégas retweeted
Big launch announcement! All new People + AI Guidebook out today! Featuring 23 action-oriented AI design patterns created by and for AI product teams. Plus case studies, a customizable workshop, updated guidance, new research, and more! pair.withgoogle.com/guideboo…
2
76
15
220