Dan Deutsch @_danieldeutsch
Research Scientist at Google Translate working on text generation evaluation danieldeutsch.github.io San Francisco Joined September 2012-
Tweets92
-
Followers601
-
Following92
-
Likes132
Machine translation is tough to evaluate, partly because most of what you throw at is too easy. That doesn't at all mean that translation is solved; we're just not doing a good job finding interesting inputs.
Come do a PhD with me at Columbia! My lab tackles basic problems in alignment, interpretability, safety, and capabilities of language systems. If you love adventuring in model internals and behaviors---to understand and improve---let's do it together! pic: a run in central park
🗺️ Are we making our #LLMs multilingual, or anglocentric? Much work brings languages closer to English, but that comes at the cost of crucial #cultural nuance. @h__j___han tackles this trade-off with surgical steering, adapting LLMs to cultural contexts at inference time.
Lots of work on cross-lingual alignment encourages multilingual LLMs to generalize knowledge across languages. But this push for uniformity creates a tension: what happens to knowledge that should remain local? We look into this trade-off of transfer and cultural erasure:🧵
Our Google Translate team is bringing a strong presence to #ACL2025 in Vienna this week! 🇦🇹 My group is excited to present several of our latest papers. 👇 Don't miss them!
Two new datasets from Google Translate targeting high and low resource languages! WMT24++: 46 new en->xx languages to WMT24, bringing the total to 55 SMOL: 6M tokens for 115 very low-resource languages WMT24++: huggingface.co/datasets/googl… SMOL: huggingface.co/datasets/googl…
😼SMOL DATA ALERT! 😼Anouncing SMOL, a professionally-translated dataset for 115 very low-resource languages! Paper: arxiv.org/pdf/2502.12301 Huggingface: huggingface.co/datasets/googl…
@shrutirij @prk_riley @esalesk @FirasTr88060642 Stephanie Winkler @BZhangGo @markuseful #nlproc #nlp #ai
This project was a highly collaborative effort with many people contributing translations, evaluations, analyses, etc., so I want to thank all of my co-authors! @ebriakou @iseeaswell @marafinkels Rebecca Galor @JurikJuraska @gezakovacs Alison Lui @RicardoRei7 @jasonriesa
🚨New machine translation dataset alert! 🚨We expanded the language coverage of WMT24 from 9 to 55 en->xx language pairs by collecting new reference translations for 46 languages in a dataset called WMT24++ Paper: arxiv.org/abs/2502.12404… Data: huggingface.co/datasets/googl…
Thrilled to share our latest findings on data contamination, from my internship at @Google! We trained almost 90 Models on 1B and 8B scales with various contamination types using machine translation as our task and analyze the impact of contamination. arxiv.org/abs/2501.18771
@srush_nlp Sent you an email about tennis!
🚀 We have just released bfloat16 variants of all 3 MetricX-24 models, offering nearly identical performance to their float32 counterparts, but with a 50% smaller memory footprint. ✨ We hope this makes the XL and XXL models more accessible! 🔗 GitHub: github.com/google-researc…
🌐 Meet MetricX-24, our SOTA machine translation evaluation metric and a successor to the successful MetricX-23. 🚀 Now open-source in PyTorch/Transformers! 🎉 Ready to take this top performer in the WMT24 Metrics Shared Task for a spin? 🔗 Code: github.com/google-researc…
🌐 Meet MetricX-24, our SOTA machine translation evaluation metric and a successor to the successful MetricX-23. 🚀 Now open-source in PyTorch/Transformers! 🎉 Ready to take this top performer in the WMT24 Metrics Shared Task for a spin? 🔗 Code: github.com/google-researc…
Super simple and effective way of significantly increasing the performance of your evaluation metric!
LLMs are typically evaluated w/ automatic metrics on standard test sets, but metrics + test sets are developed independently. This raises a crucial question: Can we design automatic metrics specifically to excel on the test sets we prioritize? Answer: Yes! arxiv.org/abs/2411.15387
@psingh522 Unfortunately this role requires that you are enrolled in a PhD program. But there are plenty of roles at Google for Master's students that you can find on the Google Careers page buildyourfuture.withgoogle.com/internships
New application link! google.com/about/careers/… I am at EMNLP/WMT this week. Please come find me if you want to learn more about this role!
Interested in doing research on Google Translate and Gemini? Good news! I’m hiring for full-time roles on the Google Translate Research Team! Apply here: google.com/about/careers/…
Sam4rano @Samueloye91
209 Followers 613 Following A Software Engineer specialized in building visually appealing and functional scalable applications. Effective collaborator with designers, product managers
Kenton Murray @kentonmurray
1K Followers 847 Following Assistant Professor GMU. | PhD from Notre Dame. | Formerly at JHU, QCRI, CMU, and Princeton.
Lucas Bandarkar @LucasBandarkar
337 Followers 384 Following PhD student @uclaNLP — ML / #NLProc / multilingual @AIatMeta, @GoogleResearch
Fei-jiang Han (Chase) @feijianghan
369 Followers 754 Following Actionable interpretability for (M)LLMs/Agent CS PhD student @UMDCS Prev: @UpennNLP Rednote: https://t.co/offEkZOx7K Intuition is all you need
Robin Linzmayer @RobinLinz
0 Followers 10 Following
eric_tx121 @rracer121
175 Followers 2K Following Education, Finance, Food, Paleo, Travel, Languages, Cycling & Trail Running, Home Brewer & Vintner. Twitter, Instagram- eric_tx121
Mahamadi nikiema @MahamadiN
18 Followers 2K Following
Krunal Shah @_krunalshah_
93 Followers 281 Following Building Agents @yutori_ai. Previously: @GoogleDeepMind @upennnlp @IITDelhi
Harsh Desai @dreamerharsh
1 Followers 7K Following
Zihao Li @realzihaolee
77 Followers 990 Following Doctoral Researcher @HelsinkiNLP | MSc @UnivHelsinkiCS | Multilingual NLP
Colten DiIanni @ColeDiianni
3 Followers 21 Following
Boogork @Boogork940
32 Followers 2K Following
Elle Michelle Yang @ellemichelley
323 Followers 2K Following 🤖 AI @CompSciOxford @Berkeley_EECS @twosigma @cohere etc. 🤓 Social NLP (NLP x Societal Impacts) 🔍 Almost everywhere on the internet @elleismatic
Raj Dabre @prajdabre
22K Followers 1K Following Senior Research Scientist - @google, Adjunct Faculty - @iitmadras, Ex: @NICT_Publicity @iitbombay
Yuur @donobbingjay
0 Followers 132 Following
JHU CLSP @jhuclsp
8K Followers 7K Following Center for Language and Speech Processing at @JohnsHopkins #NLProc #MachineLearning #AI https://t.co/6IXR5OSQtw @[email protected]
Patrick Haffner @faffne
34 Followers 213 Following Machine Learning, Language Understanding and other forms of cooking.
Michael Ryan @michaelryan207
2K Followers 1K Following PhD Student @stanfordnlp || Working on DSPy 🧩 || Prev @GeorgiaTech @Microsoft @SnowflakeDB
Cynthia Morgan Hoops @hoops14627
32 Followers 937 Following
Zishan Merza @zmerza
4 Followers 233 Following
Maria Stasimioti @MariaStasimioti
0 Followers 57 Following
Aloka Fernando @aloka_f
27 Followers 248 Following
Verna Dankers @vernadankers
953 Followers 329 Following Postdoc @Mila_Quebec @McGill_NLP 🇨🇦 PhD from @Edin_CDT_NLP 🏴 memorization vs generalization x (non-)compositionality x interpretability. she/her
lipengtao @translater_l
0 Followers 6 Following
Lorenzo Proietti @LorenzoProiet13
67 Followers 235 Following PhD student in AI @SapienzaNLP, Natural Language Processing and Machine Learning enthusiast.
noe casas @noecasas
261 Followers 852 Following ML engineer at Apple. PhD in Neural Machine Translation. Background in ML, data science and SW engineering. Chinese lang enthusiast. Life-long learner. 学无止境
Omri Abend @AbendOmri
293 Followers 192 Following Faculty member at the Hebrew University working on NLP/CL.
Dylan Zhang @dylan_works_
1K Followers 6K Following Looking for Internships & Collab (Start-up's welcome!!) Modeling Language @UofIllinois CS PhD | SR @GoogleDeepMind | Ex. @MSFTResearch Intern
Hiroyuki Deguchi @de9uch1_
480 Followers 389 Following Decoding, Machine Translation, kNN @ NTT CS lab ex. NAIST, NICT, Mantra, NII/LLMC, Ehime Univ. Gentoo / LISP / Rust / bebop jazz pianist
Reza Sayar @iamRezaSayar
910 Followers 5K Following 👨🏻🎓Life-long Learner👨🏻🎓 Kindness❤️, Helpfulness🫂 , AI🧠, Robotics🦾 & Reggaetón💃🏻
Daniel van Strien @vanstriendaniel
6K Followers 2K Following Machine Learning Librarian @huggingface 🤗 I like datasets.
Fernando Alva-Mancheg... @feralvam
713 Followers 708 Following Lecturer @cardiffuni (@Cardiff_NLP). Interests: Text Simplification, Readability, Evaluation, #NLProc. Previously: @SheffieldNLP @iapucp. 🏳️🌈🇵🇪. He/him.
Amin Farajian @amin_farajian
147 Followers 352 Following
Ryan Soh-Eun Shim @soheunshim
55 Followers 175 Following PhD student in Computational Linguistics @ LMU Munich | Interested in dialects, linguistic typology, and multilinguality.
Donna @ZezeZolla
20 Followers 943 Following
Osvaldo Quinjica @OsvaldoQuinjica
45 Followers 188 Following A Computational Explorer | Ph.D. student @ClipUmd @umdcs
wikikrishna @wikikrishna1
64 Followers 2K Following
Roger Serra @rogerserra
6K Followers 6K Following Internet i cultura digital i Política internacional i Catalunya, ciclisme, esquí, runner, muntanya, emprenedoria i molt més
Lucas Bandarkar @LucasBandarkar
337 Followers 384 Following PhD student @uclaNLP — ML / #NLProc / multilingual @AIatMeta, @GoogleResearch
Demis Hassabis @demishassabis
1.1M Followers 172 Following Nobel Laureate. Co-Founder & CEO @GoogleDeepMind - working on AGI. Solving disease @IsomorphicLabs. Trying to understand the fundamental nature of reality.
Neel Nanda @NeelNanda5
40K Followers 122 Following Mechanistic Interpretability lead DeepMind. Formerly @AnthropicAI, independent. In this to reduce AI X-risk. Neural networks can be understood, let's go do it!
NAACL HLT 2027 @naaclmeeting
9K Followers 52 Following The official account of the Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics.
Matan Eyal @mataneyal1
212 Followers 387 Following
Sweta Agrawal @swetaagrawal20
1K Followers 2K Following Research Scientist @GoogleDeepmind | Past: Postdoc Researcher @itnewspt | Ph.D. @ClipUmd, @umdcs #nlproc
Xavier Garcia @xgarcia238
75 Followers 36 Following I drink and I build stuff. Technically a member of staff @ Anthropic
Parker Riley @prk_riley
11 Followers 1 Following
Shruti Rijhwani @shrutirij
7K Followers 584 Following * Research Scientist @GoogleDeepMind * #NLProc research * PhD from CMU
Geza Kovacs @gezakovacs
12 Followers 4 Following
Yusuf Kocyigit @mykocyigit
89 Followers 186 Following Research Scientist @google. Better data and evaluation. Prev: PhD @BUCompSci, intern @google, @AIatMeta and @AmazonScience
Lily Zhang @lilyhzhang
643 Followers 530 Following Research Scientist @GoogleDeepmind. Previously @Meta, @Google, @NYU, @Harvard.
Biao Zhang @BZhangGo
722 Followers 328 Following Research Scientist @ Google. Past: PostDoc at UoE. PhD in NLP/MT @edinburghnlp. All opinions are my own.
Elizabeth Salesky @esalesk
1K Followers 805 Following Research Scientist @GoogleDeepMind・PhD @jhuclsp・I like bicycles, tokens, and linguistic diversity・https://t.co/x2ZlH1xWty
Vilém Zouhar @zouharvi
3K Followers 2K Following PhD @ ETH Zürich | working on (multilingual) evaluation of NLP | on the academic job market | go #vegan
Luca Soldaini 🎀 @soldni
13K Followers 1K Following data mines are my passion ⛏️ mts @MicrosoftAI / ex co-lead Olmo @allen_ai / pfp @YanhongLi2062 / thoughts are mine, leave my employer alone / 🌈
Shreya Havaldar @shreyahavaldar
289 Followers 281 Following PhD student @cis_penn | student researcher @googledeepmind | multilingual NLP + cultural psychology | she/her 🌸
Marine Carpuat @MarineCarpuat
2K Followers 429 Following Associate Professor, Computer Science, University of Maryland. I go by she/her.
iseeaswell꩜bʂky @iseeaswell
746 Followers 144 Following low resource MT, plants, insects, music+sangeetham. Join TUSL, the Low Resource NLP Discord: https://t.co/UXEIprg1UF
David Vilar @davvil_dvt
32 Followers 43 Following
Dipanjan Das @dipanjand
6K Followers 319 Following Researcher at @GoogleDeepmind. Factuality and Gemini x Search.
Wei Xu @cocoweixu
11K Followers 1K Following CS professor @GeorgiaTech @gtcomputing @ICatGT @mlatgt. Evaluating & Improving LLMs (multilingual, reasoning, RL, multi-turn, privacy/safety, etc.)
Manaal Faruqui @manaalfar
3K Followers 626 Following Senior Staff Research Scientist @Google Bard. Love eating, movies, travel and politics. Spread love, not war.
Sam Bowman @sleepinyourhat
65K Followers 3K Following AI alignment + LLMs at Anthropic. On leave from NYU. Views not employers'. No relation to @s8mb. Into @givingwhatwecan.
Jacob Andreas @jacobandreas
24K Followers 947 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL / @NLP_MIT (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJw
Luke Zettlemoyer @LukeZettlemoyer
11K Followers 2K Following
Andre Martins @andre_t_martins
2K Followers 412 Following NLP/ML researcher in Lisbon (@ https://t.co/nau7DrwFWR)
Violet Peng @VioletNPeng
8K Followers 556 Following Associated Professor@UCLA-CS. Research NLP, AI creativity, controllable generation, model evaluation, computational journalism, event. (she/her/hers)
Kai-Wei Chang @kaiwei_chang
9K Followers 722 Following Associate Professor @UCLAengineering/@UCLA. Area: #NLProc/#ML/#AI https://t.co/zj1ssZj9ox
Dan Roth @DanRothNLP
2K Followers 55 Following Chief AI Scientist, Oracle, and the Eduardo D. Glandt Distinguished Professor, CIS, University of Pennsylvania. Former VP/Distinguished Scientist, AWS AI Labs.
Jonathan Clark @JonClarkSeattle
2K Followers 2K Following Research Scientist @ Gemini Multilinguality. Learning, Languages, Evals, C++. Previously MT@Microsoft and CMU. Opinions are my own.
Ben Zhou @BenZhou96
397 Followers 301 Following Assistant Professor @SCAI_ASU Also known as Xuanyu Zhou
Xiaodong Yu @Xiaodong_Yu_126
488 Followers 371 Following Research Scientist @Snowflake | PhD @Penn @cogcomp | Ex. @AMD @MSFTResearch @Salesforce @UofIllinois @sjtu1896
Patrick Fernandes @psanfernandes
677 Followers 279 Following Researcher @reflection_ai PhD @ltiatCMU & @istecnico Previously research @Google, @Microsoft & @Unbabel
Viresh Ratnakar (Very... @vireshratnakar
316 Followers 2K Following Anyone living in an anyhow town. Cryptic crossword setter Gussalufz for #TheHinduCrossword and elsewhere. @[email protected] & @viresh.bsky.social
Joel Tetreault @Tetreault_NLP
1K Followers 414 Following VP of Research at Dataminr co-Program Chair of ACL2020 https://t.co/Bj7uRRRf09
Nitika Mathur @probablyNitika
165 Followers 161 Following
Matt Post @mjpost
2K Followers 2K Following Machine translation research for big tech and big academia and director of the @aclanthology. Tweets here are mostly personal.You might like
