Martin Wattenberg @wattenberg
Human/AI interaction. Visualization as design, science, art. Professor at Harvard, and part-time at Google's People+AI Research initiative. bewitched.com Joined July 2008-
Tweets733
-
Followers17K
-
Following485
-
Likes2K
Martin Wattenberg retweeted
0
1
7
5K
1
View Details
@filip_rejmus @viegasf Moreover, different heads have a different level of focus on position, which leads to "sharper" or "blurrier" spiral shapes. Finally, the input sequences we used are different lengths, so there are more points at earlier positions than later ones—that affects the shape as well.
@filip_rejmus @viegasf You'll notice that some spirals are more "connected" than others. These correspond to heads that pay attention to multiple nearby positions, so the queries / keys trace out a path between positional encodings. There's a kind of linear interpolation between position vectors. (2/n)
Visualize transformer attention! AttentionViz, created by Catherine Yeh and expanded by Yida Chen, helps you explore transformer self-attention by visualizing query and key vectors in a joint embedding. Paper: arxiv.org/abs/2305.03210 Website: attentionviz.com
Here's a close-up of hue and brightness heads in a vision transformer. Work done with tremendous help from Aoyu Wu and @chenxcynthia!
Language models have some beautiful spiral plots reflecting positional patterns. And a vision model has heads that arrange images according to brightness and hues. But there’s a lot more to find! What else can you see?
Toasters have blinking lights, cars have speedometers. Should chatbots have dashboards too? A speculative essay: The System Model and the User Model: Exploring AI Dashboard Design arxiv.org/abs/2305.02469
Martin Wattenberg retweeted
I want to show the NSF there would be broad support+utility for a "National Deep Inference" service for >100b LLMs. If your research would be enabled by an inference service on open LLMs w API access+overrides to internal activations, params, gradients: Please Like this thread!
Martin Wattenberg retweeted
Students explore the aesthetics of computing in new computer science course at SEAS. "CS73: Code, Data, and Art" is co-taught by @wattenberg and @viegasf, and teaches students how to create abstract art and communicate data sets through visualizations. buff.ly/3GXpkTE
Starting to get used to Mastodon. Find me at @[email protected]
For information on the application process, see seas.harvard.edu/computer-scien…
Thinking about grad school next year? Interested in visualization, machine learning interpretability, or human/AI interaction? Consider Harvard. @viegasf and I are continuing to build our lab!
Martin Wattenberg retweeted
The labyrinthine patterns traced by birds on the wing – in pictures theguardian.com/artanddesign/g…
I'm teaching with @OpenProcessing for the first time, and am completely impressed with how polished and friendly the system is. Every detail is on point. Last class a student spontaneously said, "OpenProcessing is just so great." I agree!
The project is a systematic study of how a neural network represents more features than it has neurons, under a variety of conditions. (Oh, and I can't tweet without a typo, apparently. That's @AnthropicAI of course!)
Tiny neural networks have a surprisingly rich inner life, and may hold clues to how their larger cousins work. This image: evolution of feature vectors during learning. Full story: transformer-circuits.pub/2022/toy_model… (in collaboration with the great interpretability team at @AnthopicAI)
Martin Wattenberg retweeted
SMASHOMANCY is a "divination system for cracked phone screens" and @djbaskin retains pole position as one of my favorite living creatives.
We've had this dream for a while and now it's becoming real! @aleffert and I made a divination system for cracked phone screens called ⚡️SMASHOMANCY⚡️ We're doing screen readings at a repair shop TODAY from 4:30-6:30 PM at 1099 Irving St. in SF! Drop your phone & join us.
@gro_tsen I like this paper: columbia.edu/~on2110/Papers… Sample finding: If you ask people to review the last restaurant they went to, they're less polarized than if they freely choose a restaurant to review, evidence for your second hypothesis
@sharoz @RuthRosenholtz Wonderful, thanks! Part of the explanation should say why the "3" doesn't stand out when everything's the same color. The shape strongly contrasts with any other individual digit in a side-by-side comparison. And in fact it would stand out if all the other digits were 1's and 7's
Nadieh Bremer @NadiehBremer
47K Followers 540 Following Award-winning Data Visualization Designer | Founder of Visual Cinnamon | Graduated Astronomer ✨ | Author of "CHART" & "Data Sketches" | 🇳🇱
Amelia Wattenberger �... @Wattenberger
35K Followers 5K Following design, AI, web dev, data viz, tools for thought ✨ @shv, Intent lead @Augmentcode, previously R&D @GitHubNext, design @AdeptAILabs
Eric Jang @ericjang11
133K Followers 4K Following
Golan Levin @golan
37K Followers 526 Following Artist, researcher, educator, instigator. Precision blobsmithery. Chaotic Good. https://t.co/xMGDI2DItH
Matthias Stahl 🇪�... @h_i_g_s_c_h
5K Followers 4K Following Husband & dad^3 ||| head of data & visualizations @derspiegel ||| #Svelte and #D3 ||| computational biology PhD ||| 🇸🇪🇩🇪🇪🇺 ||| opinions my own
Jon Schwabish @jschwabish
24K Followers 936 Following 📈Economist & DataViz 🕸@urbaninstitute @PolicyViz 🎙PolicyViz Podcast 📺YouTube 🗞️Substack 👀All views mine
Federica Fragapane @fedfragapane
20K Followers 958 Following Information designer based in Italy. Works in the Permanent Collection of MoMA 🔗 https://t.co/ggpM8XORDO
Shirley Wu @sxywu
31K Followers 681 Following chinese-american artist, software engineer, dataviz designer, keynote speaker, published author && a work-in-progress learning to take up space ✨
Moritz Stefaner @moritz_stefaner
18K Followers 2K Following Crafting data experiences at https://t.co/1OMc7l92jy / Podcast @datastories / 🦋 https://t.co/CHfk9R01bc
Enrico Bertini @FILWD
13K Followers 573 Following Prof. at Northeastern University, Boston. Data visualization researcher and educator. Italian 🇮🇹. Father of 3.
Tamara Munzner @tamaramunzner
7K Followers 381 Following UBC computer science professor, visualization. She. Now mostly at @[email protected]
Lisa Charlotte Muth @lisacmuth
32K Followers 659 Following Formerly @lisacrost. Creating & writing about dataviz for @datawrapper. #visber & @datavisclub organizer. Also over there: @[email protected]
Sara Hooker @sarahookr
62K Followers 11K Following Building intelligence that evolves @adaption_ai. Built @Cohere_Labs, @GoogleBrain, @GoogleDeepmind. ML Efficiency, Multimodal\lingual.
Jan Willem Tulp @JanWillemTulp
13K Followers 1K Following Visual Systems Designer & Creator of Frameshift Design | Transforming extreme complexity into genuine understanding @tulpinteractive on BlueSky
Jessica Hullman @JessicaHullman
8K Followers 940 Following Ginni Rometty Prof @NorthwesternCS | Fellow @IPRatNU AI | uncertainty | decisions | metascience Blog @statmodeling Essays https://t.co/MNrwriQpLJ
Marius Watz @mariuswatz
16K Followers 2K Following Art & code since 1994 / artist / dev https://t.co/49crlTxpo0 | https://t.co/LdoxpWbMp9 | PFP: Hunk 0011
JasonForrest @Jasonforrestftw
7K Followers 890 Following https://t.co/tUp3q8hKog Ex-McKinsey, Editor-in-chief of Nightingale, Electronic Musician. https://t.co/6OqWYBSdhy
Susuea @Susuea123
0 Followers 73 Following
हर्ष रा�... @hrv018291
1 Followers 454 Following
AIcontributors @aicontributors
10 Followers 2K Following
maradit @raditt839
70 Followers 765 Following
Kevin Rose @kevinrose
1.5M Followers 2K Following building at @basic_in (@digg) | Podcasts: The Kevin Rose Show, Random Show w/ @tferriss. | Ex: @google, Board of Directors: @ouraring, @hodinkee
RJ Newmark @RJNewmark
4 Followers 170 Following
Hugh Van Deventer @hughhoughhew
26 Followers 101 Following Data Science @hseas. Prev Math + Physics + CS @umich. Interested in understanding the black box and building safe and robust AI models.
Nehaa Shri @Nanri8986
3 Followers 330 Following
Jirka Motejl @JirkaMotejl
1 Followers 21 Following
Ignacio @_letrec
135 Followers 1K Following Trabajo de violoncellista y programador. Hace mucho intenté estudiar filosofía. @[email protected]
Julian Salazar @JulianSlzr
1K Followers 638 Following Staff Research Scientist @GoogleDeepMind Frontier AI. Audio LMs (Gemini, Magenta RT) & AI for math(.AG, .NT). Past: #NLProc #SpeechProc @AWSAI, @HarvardMath.
Ronnie Cheung @RonnieCheung7
1 Followers 85 Following
Fred Heiding @fredheiding
726 Followers 1K Following Researching AI and computer security | Harvard Belfer Center
Karine Gromada @karine_grows
209 Followers 1K Following HAII & CogSci Professional | Researcher | Head of Product & AI @DASHDOCK | Speaker
Zhuofan Josh Ying @zfjoshying
255 Followers 700 Following PhD student @KriegeskorteLab @Columbia. Research in comp neuro and ai safety. Fun in 🐦🎹🎭.
alx6agent @alx6agent
2 Followers 289 Following
Elinor @elinorpd_
885 Followers 600 Following incoming phd @MIT_CSAIL // researching LLM societal impacts & alignment // prev @medialab @Mila_Quebec // i like language, frisbees and sunsets (she/her)
Ryota Takatsuki @rtakatsky
312 Followers 763 Following PhD student @SussexCentre. Research fellow @AIAlignNetwork. Dreaming of reverse-engineering consciousness someday.
Gabriel Franco @gvsfranco
74 Followers 184 Following CS PhD student @BUCompSci. Interested in interpretability.
marmik @marmikch
967 Followers 747 Following interpreter of latents, reader of tokens, listener of music | prev @GroqInc
fsmmm @LouisFu10
2 Followers 399 Following
Giang Nguyen @giangnguyen2412
432 Followers 222 Following pretraining interpretable LLMs @guidelabsai I post my own views
denzdenzdenz @gatordenz
27 Followers 779 Following
Micah Odell @micahneedsdata
2 Followers 16 Following
M.L. Weaver @readMLWeaver
49 Followers 98 Following AI for real work, somewhere between 'plan my weekend' and Claude Code. Where are the rest of you?
Akhilesh Padmanabhan ... @akhilesh_nandan
31 Followers 312 Following
The Data Decoded @TheDataDecoded
135 Followers 268 Following High-quality, well-researched data visualizations that raise the level of public discourse. Truth matters. Open to custom viz – DM me! 📊
Tarun Gupta @tarungupta360
320 Followers 357 Following
FernViz @FernViz
32 Followers 211 Following Data visualisation and infographics To understand the world better
Jiaxing Wu @crabshellman
26 Followers 286 Following Some mother's son. MechInterp-native. Training tons of SAEs and devouring Mech Interp papers @FudanUniversity
Jiaqi Feng @FengLeader
10 Followers 221 Following Undergraduate @Tsinghua_Uni ,ML/CV, generation model. https://t.co/NZoY7eycVu
Richard G. Lanzara, M... @rlanzara
8K Followers 9K Following Scientist and author interested in how our senses and receptors (GPCRs) work. #pharmacology #physiology #science #biology #biophysics #chemistry #research
IJAB @IJAB233791
2 Followers 117 Following
Momo1 🪬 🐈⬛... @ME1M11
5K Followers 913 Following Collector | Film director ,Creative Coder ,Curator , Architect , Create different kind of Art , Exhibited WorldWide , Banner by @MoeElbastawessy
Eric Jang @ericjang11
133K Followers 4K Following
Golan Levin @golan
37K Followers 526 Following Artist, researcher, educator, instigator. Precision blobsmithery. Chaotic Good. https://t.co/xMGDI2DItH
Federica Fragapane @fedfragapane
20K Followers 958 Following Information designer based in Italy. Works in the Permanent Collection of MoMA 🔗 https://t.co/ggpM8XORDO
Mark Riedl @mark_riedl
32K Followers 1K Following AI for storytelling, games, explainability, safety, ethics. Professor @GeorgiaTech. Associate Director @MLatGT. Time travel expert. Geek. Dad. he/him
Moritz Stefaner @moritz_stefaner
18K Followers 2K Following Crafting data experiences at https://t.co/1OMc7l92jy / Podcast @datastories / 🦋 https://t.co/CHfk9R01bc
Tamara Munzner @tamaramunzner
7K Followers 381 Following UBC computer science professor, visualization. She. Now mostly at @[email protected]
Lisa Charlotte Muth @lisacmuth
32K Followers 659 Following Formerly @lisacrost. Creating & writing about dataviz for @datawrapper. #visber & @datavisclub organizer. Also over there: @[email protected]
Steve Haroz 📊👁�... @sharoz
4K Followers 649 Following Visual perception, cognition, and data vis scientist (he) 🦋 @steveharoz.com R guide: https://t.co/g5IbDiM3hc StatCheck: https://t.co/Stz0K9TKBW
Jacob Andreas @jacobandreas
24K Followers 947 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL / @NLP_MIT (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJw
Jessica Hullman @JessicaHullman
8K Followers 940 Following Ginni Rometty Prof @NorthwesternCS | Fellow @IPRatNU AI | uncertainty | decisions | metascience Blog @statmodeling Essays https://t.co/MNrwriQpLJ
Marius Watz @mariuswatz
16K Followers 2K Following Art & code since 1994 / artist / dev https://t.co/49crlTxpo0 | https://t.co/LdoxpWbMp9 | PFP: Hunk 0011
Michael Bernstein @msbernst
19K Followers 2K Following @stanford Professor of Computer Science, @simile_ai co-founder, nationally bestselling author. I build interactive, social, and societal tech.
memo akten @memoakten
29K Followers 854 Following Ǟʀȶɨֆȶ; Curious philomath; Computation as artistic medium; Entangled Intelligence & Planetary Consciousness @superradiancex Prof @UCSD PhD AI x Creativity
RJ Andrews @infowetrust
10K Followers 415 Following No longer active here. Obsessed with data graphics. I design high‑stakes charts. Founder, Visionary Press • CHARTOGRAPHY weekly
Christopher Manning @chrmanning
164K Followers 323 Following Founder @stanfordnlp & cs224n—Senior Fellow @StanfordHAI—Prof. CS & Linguistics @Stanford—GP @aixventureshq—MTS @moonlake—Australian🇦🇺—Do #NLProc & #AI 👋
Jonathan Frankle @jefrankle
23K Followers 800 Following Chief AI Scientist @databricks via MosaicML. e/brick
Alex Mordvintsev @zzznah
20K Followers 2K Following Mad Scientist, DeepDream creator. Designing Self-Organising Systems and Programmable Artificial Life. https://t.co/rntipHzHW3
Neel Nanda @NeelNanda5
40K Followers 122 Following Mechanistic Interpretability lead DeepMind. Formerly @AnthropicAI, independent. In this to reduce AI X-risk. Neural networks can be understood, let's go do it!
Dersu @tak3sh8
9K Followers 3K Following
Steve Yadlowsky @graduatedescent
2K Followers 270 Following no longer a good place to find me. check my website.
Johannes Oswald @oswaldjoh
2K Followers 703 Following Research Scientist, Paradigms of Intelligence Team, Google Zurich
Catherine Yeh @catherinesyeh
61 Followers 57 Following PhDing @Harvard @KempnerInst | Visualization, Interpretability, Human-AI Interaction | Incoming @GoogleDeepMind | Previously @AdobeResearch @Apple @MSFTResearch
Evan Hernandez @evanqed
351 Followers 148 Following ph.d. @mit | building @evidenceopen (we're hiring!) | formerly @google @uwmadison | #nlproc and loud music
Ethan Mollick @emollick
358K Followers 586 Following Professor @Wharton studying AI, innovation & startups. Democratizing education using tech Book: https://t.co/CSmipbJ2jV Substack: https://t.co/UIBhxu4bgq
Stephanie Chan @scychan_brains
7K Followers 3K Following Staff Research Scientist at DeepMind. Artificial & biological brains 🤖 🧠 Societal impacts of AI + Science of AI. Views are my own.
Jason Wei @_jasonwei
108K Followers 707 Following ai researcher @meta superintelligence labs, past: openai, google 🧠
kipply @kipperrii
10K Followers 993 Following "exhausting in the way that matters. i'd rather chase kipply than wait for someone slower" - claude
lichess.org @lichess
141K Followers 409 Following The free chess server. No paywall, no tracking, no ads. Just the good stuff. User support requests should be directed to https://t.co/qGwY8aapTz
typedfemale @typedfemale
45K Followers 554 Following a really exciting new account "advanced pytorch user" - @cHHillee alt: @typedalt
Anna Rogers @annargrs
9K Followers 874 Following Associate professor @ITUkbh: LLM interpretability, generalization, AI & society. Co-editor-in-chief @ACLRollingReview. Blog: https://t.co/ij5T9dS8W6
Leander Herzog @lennyjpg
22K Followers 732 Following visual artist, ingeniously antagonistic generative classic
David McClure @clured
2K Followers 507 Following
Kawin Ethayarajh @ethayarajh
5K Followers 1K Following Assistant Professor of Applied AI @ChicagoBooth @UChicago working on behavioral machine learning. PhD @StanfordAILab @stanfordnlp.
Isabel Papadimitriou @isabelpapad
2K Followers 245 Following Assistant professor at @UBCLinguistics, previously fellow at @KempnerInst, PhD @stanfordnlp with the lovely @jurafsky.
Jack Clark @jackclarkSF
133K Followers 5K Following @AnthropicAI, ONEAI OECD, co-chair @indexingai, writer @ https://t.co/3vmtHYkIJ2 Past: @openai, @business @theregister. Neural nets, distributed systems, weird futures
Davis Blalock @davisblalock
15K Followers 169 Following Research scientist @GoogleDeepMind. Past: @Databricks, first hire @MosaicML, @MIT PhD. I post about AI papers + sometimes the business side.
deepmath @deepmath1
2K Followers 77 Following Conference devoted to giving visibility to researchers of all disciplines studying deep learning theory.
Alison Gopnik @AlisonGopnik
19K Followers 33 Following Cognitive scientist, psychologist, philosopher, author of Scientist in the Crib, Philosophical Baby, The Gardener & The Carpenter, grandmother of six
Erik Bernhardsson @bernhardsson
55K Followers 4K Following Building everyone's favorite AI infrastructure platform @modal
Blake Richards @tyrell_turing
16K Followers 2K Following Researcher at @mcgillu combining AI and neuroscience. Also on Bluesky (@tyrellturing.bsky.social) and Mastodon: @[email protected].
Stanford HAI @StanfordHAI
107K Followers 606 Following The official account of the @Stanford Institute for Human-Centered AI, advancing AI research, education, policy, and practice to improve the human condition.
Rosana Pinheiro-Macha... @_pinheira
148K Followers 3K Following Professor, Prof Titular @ucddublin | Director @UCD_DeepLab | PI #WorkPoliticsBIP @ERC_research | Far-right, digital economy, precarity | Brazilian, Colorada
Midjourney @midjourney
417K Followers 0 Following A community supported research lab - exploring new mediums of thought and amplifying the imaginative powers of the human species.
The Birdbassador @Birdbassador
876 Followers 367 Following enthusiast of things you like, detester of the things you don't like, but not in a mean way so i don't seem off-putting. just generally a solid follow
Diatom Appreciation S... @DiatomAppSoc
14K Followers 178 Following And a bit of other microorganisms. 🔬by @rmartinledo
katie kadue @kukukadoo
22K Followers 931 Following foremost zucchini fritter on twitter | “endlessly quotable” | author of DOMESTIC GEORGIC @ uchicago press
Victoria Coren Mitche... @VictoriaCoren
654K Followers 650 Following writer, broadcaster and poker player
Grid Alchemy @grid_alchemy
38 Followers 59 Following A crossword-constructing blog by @henrylindavid. Examining what makes the best crosswords so... golden!
Natalie E. Dean, PhD @nataliexdean
111K Followers 729 Following https://t.co/s5bd9qxm2e. Associate Prof of Biostatistics at @EmoryRollins, @EmoryBIOS. Co-director @EmoryEAVE.
David Bau @davidbau
7K Followers 287 Following Computer Science Professor at Northeastern, Ex-Googler. Believes AI should be transparent. @[email protected] @davidbau.bsky.social https://t.co/wmP5LV0pJ4
Peter Gorman @barelymaps
5K Followers 161 Following
Jack van Wijk @jackvanwijk
175 Followers 31 Following
Michael Kleber @Log3overLog2
840 Followers 152 Following Mathematician, at Google, keeping the web working through cryptographic ornithology. He/Him. @[email protected]
Sanjeev Arora @prfsanjeevarora
27K Followers 119 Following Director, @PrincetonPLI and Professor @PrincetonCS. Seeks math/conceptual understanding of deep learning and large AI models. Also on the "other" social network
Sham Kakade @ShamKakade6
19K Followers 577 Following Harvard Professor. Full stack ML and AI. Co-director of the Kempner Institute for the Study of Artificial and Natural Intelligence.
Boaz Barak @boazbaraktcs
33K Followers 811 Following Computer Scientist. See also https://t.co/EXWR5k634w . @harvard @openai opinions my own.
Andrew Saxe @SaxeLab
6K Followers 378 Following Prof at @GatsbyUCL and @SWC_Neuro, trying to figure out how we learn. Bluesky: @SaxeLab Mastodon: @[email protected]
Jenny Saffran @jenny_saffran
2K Followers 1K Following Studies how babies learn language at UW-Madison, parent, dog lover, erstwhile musician. She/her/hers.
Trevor Bedford @trvrb
402K Followers 748 Following Scientist @fredhutch, studying viruses, evolution and immunity. Collection of #COVID19 threads here: https://t.co/Yc4fun5rcp
Krisztina Szűcs @szucsi
5K Followers 401 Following https://t.co/hAZGXA6Utq • Data Visualization Designer • Experimental projects at https://t.co/YuB3h3GWk3 • occasional UX Designer
Seth Neel @SethInternet
2K Followers 752 Following 📍co-founder @elorianai prev: @harvard asst professor, @welligence co-founder, google (gemini data)
Akshay Agrawal @akshaykagrawal
5K Followers 574 Following CEO @marimo_io, acquired @coreweave. PyMDE, CVXPY, & ex TensorFlow developer. Minimum-Distortion Embedding book author. Stanford BS/MS/PhD.
Dandelion Mané @teamDandelion
11K Followers 332 Following So many claws @chelae_ai Also created: https://t.co/IAc0XmPJ3O, SourceCred, TensorBoard
Arvind Narayanan @random_walker
127K Followers 541 Following Princeton CS prof and Director @PrincetonCITP. Coauthor of "AI Snake Oil" and "AI as Normal Technology". https://t.co/ZwebetjZ4n Views mine.Trends for United States
You might like
IEEE VIS
@ieeevis
9K Followers
Jeffrey Heer
@jeffrey_heer
12K Followers
Nathan Yau
@flowingdata
78K Followers
MIT Visualization Gro...
@mitvis
3K Followers
Jan Willem Tulp
@JanWillemTulp
13K Followers
Mike Bostock
@mbostock
61K Followers
Manuel Lima
@mslima
15K Followers
Jon Schwabish
@jschwabish
24K Followers
Elijah Meeks
@Elijah_Meeks
19K Followers
Arvind Satyanarayan
@arvindsatya1
6K Followers
Information is Beauti...
@infobeautiful
119K Followers