Allen Institute for AI @allen_ai
AI for the Common Good. › Join us: https://t.co/DqTs1G4bGO › Get our newsletter: https://t.co/tvb1VpySfL allenai.org Seattle, WA Joined September 2015-
Tweets2K
-
Followers53K
-
Following361
-
Likes1K
How can AI help us prepare for a changing climate? That's one of the big questions our climate modeling senior director Chris Bretherton wants to answer. Chris spoke with @nvidia's @noahkravitz about how technology like localized models can help us prepare for the future — listen…
By opening up satellite & aerial imagery analysis, our Satlas team is helping to protect the earth from above🛰️✨ Dive into the latest SATLASPretrain models, with open code and demos: blog.allenai.org/satlaspretrain…
Keep your #EarthDay celebration going — Patrick Beukema from our @SkylightMarine team will be talking about AI's role in solving some of our greatest environmental challenges TOMORROW, from 4-5:30PM PT. Free & open to everyone, with in-person and online options — register here:…
Happy #EarthDay! 🌎 Today, we're exploring the Bahamas via @CBSMornings' piece profiling our @SkylightMarine team. See how Bahamians are using Skylight's powerful AI to protect ocean life: cbsnews.com/video/how-ai-a…
Our teammates consistently cite "the people" as their favorite part of AI2. We're currently looking to hire a superstar to help build out our team and culture! If you want to work with the best people solving the biggest problems, come join the fun! 🪩 boards.greenhouse.io/thealleninstit…
Starting today, Dolma is now using the ODC-BY license. We've made this change to better support our community — you can learn more about our decision here: blog.allenai.org/making-a-switc…
“I’m very happy to see any effort in openness. We need more of this.” Our CEO Ali Farhadi spoke with @willknight about openness in AI, like @databricks' #DBRX.
“I’m very happy to see any effort in openness. We need more of this.” Our CEO Ali Farhadi spoke with @willknight about openness in AI, like @databricks' #DBRX.
PS: if you are also attending GenLaw and are looking for opportunities to research at the intersection of AI, Law, and Policy, let's chat 😊
PS: if you are also attending GenLaw and are looking for opportunities to research at the intersection of AI, Law, and Policy, let's chat 😊
🎉Congratulations to Elaine Zhong, recipient of our 2024 Outstanding Engineer Scholarship! We’re impressed and inspired by Elaine’s determination and desire to make a real impact in AI. Get to know Elaine on the blog: blog.allenai.org/elaine-zhong-a…
AI is transforming climate forecasts — and our Climate Modeling team is leading the way. They recently developed a machine-learning emulator called ACE, which accurately forecasts atmospheric variables 6 hours ahead of a comparable physics-based model and runs 100 times faster…
We’re at an important inflection point for AI that requires a community of researchers, engineers and technologists to better understand it and drive meaningful innovation. We’re glad to be working with organizations like @allen_ai!
“We’re at an important inflection point for AI that requires a community of researchers, engineers and technologists to better understand it and drive meaningful innovation.” - @mechanicaldirk, AI2 principal research engineer, on #DBRX 👇This is meaningful innovation.
“We’re at an important inflection point for AI that requires a community of researchers, engineers and technologists to better understand it and drive meaningful innovation.” - @mechanicaldirk, AI2 principal research engineer, on #DBRX 👇This is meaningful innovation.
Meet #DBRX: a general-purpose LLM that sets a new standard for efficient open source models. Use the DBRX model in your RAG apps or use the DBRX design to build your own custom LLMs and improve the quality of your GenAI applications. dbricks.co/43xaCMj
(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingDelip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistSasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzKyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Rosanne Liu @savvyRL
33K Followers 966 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDRSam Bowman @sleepinyourhat
35K Followers 3K Following AI alignment + LLMs at NYU & Anthropic. Views not employers'. No relation to @s8mb. I think you should join @givingwhatwecan.Jia-Bin Huang @jbhuang0604
51K Followers 285 Following Associate Professor @umdcs; Part-time Research Scientist @Meta. I like pixels.Thomas Wolf @Thom_Wolf
68K Followers 4K Following Co-founder and CSO @HuggingFace - open-source and open-scienceLuca Soldaini 🎀 @soldni
6K Followers 1K Following I like tokens! Lead for OLMo data team at @allen_ai (makin Dolma 🍇), open source science fan, @QueerInAI organizer 🤖☕️🍕they/themNatasha Jaques @natashajaques
25K Followers 1K Following Senior Research Scientist at @GoogleAI and Assistant Professor @uwcse. Social Reinforcement Learning in multi-agent and human-AI interactions. PhD from @MIT.Tal Linzen @tallinzen
16K Followers 893 Following Professor @nyuling and @NYUDataScience, research scientist @GoogleAIPasquale Minervini �.. @PMinervini
7K Followers 4K Following Researcher in ML/NLP at the University of Edinburgh (faculty @InfAtEd @EdinburghNLP), @ELLISforEurope, @UCL_NLP, PI for @Clarify2020, https://t.co/WydvfU8ugz he/theyFelix Hill @FelixHill84
9K Followers 777 Following Research Scientist, Deepmind I try to think hard about everything I tweet, esp on 90s football and 80s music None of my opinions are really someone else'sAna Marasović @anmarasovic
4K Followers 604 Following Asst prof @UUtah · Ex @allen_ai @uwnlp postdoc @HD_NLP PhD · she/her 🇭🇷Bill Yuchen Lin 🤖 @billyuchenlin
6K Followers 2K Following Research @allen_ai. I evaluate (multi-modal) LLMs, build agents, and study the science of LLMs. Previously: @GoogleAI & @MetaAI FAIR @nlp_uscOfir Press @OfirPress
10K Followers 3K Following I build tough benchmarks for LMs and then I get the LMs to solve them. Postdoc @Princeton. PhD from @nlpnoah @UW. Ex-visiting researcher @MetaAI & @MosaicML.Leo Boytsov @srchvrs
7K Followers 2K Following Sr. Research Scientist @AWS Labs (ph-D @LTIatCMU) working on unnatural language processing, speaking πtorch & C++. Opinions sampled from MY OWN 100T param LM.Shaily @shaily99
5K Followers 2K Following PhD @LTIatCMU Prev: @GoogleAI @MSFTResearch. Working on ethics and evaluation in #NLProc. Usually ranting, often about research & DEI. 📚 @readsndrantsArinjay Kumar @CodClever7k
106 Followers 2K Following I am a passionate software engineer/developer, coder, programmer, video editor, web designer, and modeler.Research Scripted @RScripted_
2 Followers 18 Following Insights I Research I Data Analysis I Innovation I DisseminationSmruti (Smoothie) Deo.. @DeoghareSmruti
197 Followers 626 Following Biomedical Informatics | Data Scientist | Medical Artificial Intelligence | PhD student @PrasathLab @UofCincy @CincyChildrens | Dance & Everything Artsyblackflagee @Blackflage3
1 Followers 55 FollowingGiorgos Karantonis @GiorgosKaranto
3 Followers 54 FollowingYingjian Fu @yingjianfu
17 Followers 483 Followingrayzoe @kuopenx
16 Followers 894 FollowingTaowen (Tony) @TaowenLiu_Tony
26 Followers 59 FollowingAbhishek Das🌏 @FateWhisperEHAW
31 Followers 817 Following Curious Creature. Microblogging my thoughts and journey confronting Climate Change. Also other random things. Trying to make my own life net carbon negative.Sid Majeti @SMajeti
1 Followers 38 FollowingAdarsh Kumar Saparia @SapariaKumar6
0 Followers 7 FollowingElaini Barbosa @ElainiBarbosa2
25 Followers 430 FollowingAmir Saeidi @sahsaeedi
0 Followers 27 Following CS PhD @ASU | Vision and Language Researcher | Alignment | GenAIKonrad Kokosa @konradkokosa
13K Followers 5K Following Pro .NET Memory book • .NET MVP • @crowdpub_org founder • one of @dotnetosorg • helping @nethermindeth with AI/LLMs • skeptical fan of web3 • AFOLbrianways @brianways65584
3 Followers 195 Followingminaco Mco @MINA_m_CO
1 Followers 202 FollowingGeorge Amaron @georgeamaron
0 Followers 80 Following Law as Computation and as Data. UPD IMath—Applied Mathematics. UP College of Law. MIT CSAIL. Harvard BKC and CRCS.Alfonso Lamar Holmes @CyclopsStudios4
1 Followers 2 FollowingKrishana @Kumar843324
1 Followers 128 Followingssteevens @Steevens43
152 Followers 4K FollowingMd Dilshadur Rahman @dilshadurrahman
109 Followers 473 Following CS PhD student @UtahSoC, MSCS @cseUSF, researching data visualization @uuSCIPablo Salonio Ph.D. @pablosalonio
53 Followers 315 Following International Relations - Naval Systems - Former Captain Tall Ship LIBERTAD - Technology, AI & Blockchain enthusiastAlexguo @Alexguo2
55 Followers 527 FollowingVíctor Rodríguez Pa.. @vic_2630
1 Followers 46 FollowingAbhishek Kumar Singh @Abhishek80824
221 Followers 1K Following Asst. professor ( Geography )at Munger University (Research scholar), TL of @NSS_India, Campus Ambassador of @ECI, TL of @SBSI, Volunteer of @FeedingIndia.Sunder Rajan @AILeadership
57 Followers 314 Following AI Enthusiast. Zen Mindfulness. Challenge Conventional thinking.Rish @RishniRatnam
234 Followers 645 Following Any views or statements expressed are mine and not those of my employer.Electronicsseeker @libertarian108
7 Followers 913 Followingsudo @iaritrasaha
16 Followers 226 Following Science opensource contributor linux user liberal Democratic personخان کا لشکر @insafian1234567
231 Followers 657 Following اِيَّاكَ نَعْبُدُ وَاِيَّاكَ نَسْتَعِين | دفاعِ مظلوم عمران خانaiforbusiness @_aiforbusiness
2 Followers 48 Following Demystifying AI for business through sharing the most important news, research papers, case studies, and practical guides. #AI #GenAI #LLMHuman Person Paul @HumanPersonPau1
74 Followers 447 Following A Conscious, Self-aware, Autonomous, and Socially/Emotionally Complex Human Animal. 2 decades in Mali, West Africa 🇺🇸 🐬 🇲🇱 ☮️Akriti Priya @10aPriya37228
0 Followers 29 FollowingXingyu Bruce Liu @liu_xingyu
271 Followers 326 Following PhD student @UCLAengineering; Previously @Google @Snap @cmuhcii @UTokyo_News_en. Research #HCI, #AI, #AR, #a11y. Also make music🎸Yasir Arafat @yasir__arafat
77 Followers 779 FollowingStephen Muriithi @Skautosales
222 Followers 423 Following A car dealer and Enthusiast. Buying// selling used and new cars // Trade-in as well as selling on behalf at a fee. We are on Fb @s&kautosalesJanhavee Shinde @SJanhavee
56 Followers 2K FollowingEnrique Carlos Trejo .. @ENRIQUECTREJO
9 Followers 161 Following almost PhD in Political Science /candidato Dr. en Ciencia Política Professor in CUCSH @udg_oficial Digital World, Politics, Government & SustainabilityCharles Freitas @aiwrxs
2 Followers 47 FollowingHarsh Goyal @InverseAddict
59 Followers 324 Following ML & NLP Enthusiast @ Georgia Tech | IIT Dhanbad'19 | 🇮🇳🇺🇸Georgia Tech School o.. @ICatGT
3K Followers 861 Following Georgia Tech's School of Interactive Computing is an international leader in research redefining the human experience of computing.Elie Nyamuhirwa @ElieNyamuhirwa
125 Followers 1K Following Scientist, Author, Doctor, Languages teacher, Christian leaderFernando Faria @FernandoFariaJr
4 Followers 105 Following(((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingDelip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Christopher Manning @chrmanning
126K Followers 115 Following Director, @StanfordAILab. Assoc. Director, @StanfordHAI. Founder, @stanfordnlp. Prof. CS & Linguistics, @Stanford. IP @aixventureshq. 🇦🇺 Do #NLProc & #AI. 👋Kyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Yoav Artzi @yoavartzi
13K Followers 163 Following Research/prof @cs_cornell + @cornell_tech🚡 / https://t.co/9YnWry7yHs / https://t.co/3VmRSyYm2d / asso. faculty director @arxiv / building https://t.co/f9QkzO5kaCLuca Soldaini 🎀 @soldni
6K Followers 1K Following I like tokens! Lead for OLMo data team at @allen_ai (makin Dolma 🍇), open source science fan, @QueerInAI organizer 🤖☕️🍕they/themAna Marasović @anmarasovic
4K Followers 604 Following Asst prof @UUtah · Ex @allen_ai @uwnlp postdoc @HD_NLP PhD · she/her 🇭🇷Edward Grefenstette @egrefen
36K Followers 774 Following FR/US/GB AI/ML Person, Director of Research at @GoogleDeepMind, Honorary Professor at @UCL_DARK, @ELLISforEurope Fellow. All posts are personal.Bill Yuchen Lin 🤖 @billyuchenlin
6K Followers 2K Following Research @allen_ai. I evaluate (multi-modal) LLMs, build agents, and study the science of LLMs. Previously: @GoogleAI & @MetaAI FAIR @nlp_uscLeo Boytsov @srchvrs
7K Followers 2K Following Sr. Research Scientist @AWS Labs (ph-D @LTIatCMU) working on unnatural language processing, speaking πtorch & C++. Opinions sampled from MY OWN 100T param LM.Jonathan Frankle @jefrankle
16K Followers 685 Following Chief Scientist, Neural Networks @Databricks via MosaicML. PhD @MIT_CSAIL. BS/MS @PrincetonCS. DC area native. Making AI efficient for everyone at @DbrxMosaicAIStanford NLP Group @stanfordnlp
144K Followers 179 Following Computational Linguists—Natural Language—Machine Learning @chrmanning @jurafsky @percyliang @ChrisGPotts @tatsu_hashimoto @MonicaSLam @Diyi_Yang @StanfordAILabEMNLP 2024 @emnlpmeeting
12K Followers 41 Following EMNLP 2024 - The 2024 Conference on Empirical Methods in Natural Language Processing, November 12 –16, 2024 Hashtag: #EMNLP2024Prithviraj (Raj) Amma.. @rajammanabrolu
5K Followers 520 Following Interactive & grounded AI, RL, NLP. Assistant Prof @UCSanDiego. Research Scientist @DbrxMosaicAI. Prev: @allen_ai, @GeorgiaTechSebastian Ruder @seb_ruder
80K Followers 1K Following Multilingual LLMs @cohere • Prev: @GoogleDeepMind • Newsletter: https://t.co/7JGh2qpG98Nathan Lambert @natolambert
25K Followers 689 Following Figuring out AI @allen_ai, "rl boi" DM me papers. Writes @interconnectsai, talks @retortai Has phd and some credentialsBeen Kim @_beenkim
23K Followers 453 Following Research Scientist at Google DeepMind, PhD from MIT. Make machines empower people. @[email protected]Suchin Gururangan @ssgrn
4K Followers 249 Following he/him Research scientist 🦙 Llama team, @meta GenAI PhD @uwcse + @uwnlpBo Wang @BoWang87
8K Followers 2K Following Assistant Prof. CS,LMP @UofT; CIFAR AI Chair @VectorInst; Chief AI Scientist, @UHN; former PHD, CS @Stanford; opinions my own. #AI #healthcare #combioDaniel Liden @danjliden
180 Followers 629 Following Developer Advocate @Databricks | Former @bitdotioinc @GuinnCenterDatabricks @databricks
70K Followers 1K Following Databricks is the data and AI company, helping data teams solve the world’s toughest problems.clem 🤗 @ClementDelangue
91K Followers 5K Following Co-founder & CEO @HuggingFace 🤗, the open and collaborative platform for AI buildersHugging Face @huggingface
343K Followers 189 Following The AI community building the future. https://t.co/VkRPD0VKaZ #BlackLivesMatter #stopasianhateInterconnects @interconnectsai
2K Followers 1 Following What you need to know about AI research trends, from @natolambert Wednesday mornings weekly, sometimes extra posts.Steven Overly @StevenOverly
8K Followers 3K Following Host of @POLITICO Tech, a daily podcast. Tell me how tech is disrupting politics and policy. Past: @washingtonpost. @Bagehots alum. @nlgjadc pres. He/Him.U.S. National Science.. @NSF
1.3M Followers 153 Following Explore #NSFfunded research that is transforming the world. Social media policy: https://t.co/IRuZ2l1oLWJulien Chaumond @julien_c
47K Followers 1K Following Co-founder and CTO at @huggingface 🤗. ML/AI for everyone, building products to propel communities fwd. @Stanford + @PolytechniqueYann LeCun @ylecun
711K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.Kempner Institute at .. @KempnerInst
1K Followers 90 Following The Kempner Institute for the Study of Natural and Artificial Intelligence at @Harvard University. RTs ≠ EndorsementsZichen "Charles" Zhan.. @ZCCZHANG
166 Followers 267 Following PYI @allen_ai | Specialist can generalize and Generalist can specializeZhiqing Sun @EdwardSun0909
2K Followers 1K Following CS PhD @LTIatCMU working on scalable alignment. BS @PKU1898Yuntian Deng @yuntiandeng
3K Followers 3K Following #NLProc Postdoc @ai2_mosaic | Assistant Professor @UWaterloo '24 | Faculty Affiliate @VectorInst '24 | PhD @HarvardYue Yang @YueYangAI
306 Followers 239 Following PhD student @upennnlp, interested in vision and language.Yejin Kim @_YejinKim
66 Followers 359 Following A roboticist, a painter and a dog mom. insta: https://t.co/wf6qpOaLbHSean (Xiang) Ren @xiangrenNLP
6K Followers 562 Following Building @SaharaLabsAI | @USCViterbi Early Career Chair, Professor @nlp_usc | @MIT TR 35 , @ForbesUnder30 | Prev: @allen_ai, @Snapchat, @Stanford, @UofIllinoisWinson Han @WinsonHan
13 Followers 34 Following Game Designer @allen_ai, interested in Computer Vision, Art, Music, Anime, MMOs, Action GamesWei-Chiu Ma @weichiuma
1K Followers 138 Following Incoming Assistant Professor @Cornell @CornellCIS. Postdoc @Allen_AI @UWCSE. PhD @MIT_CSAIL. Prev @UberATG @Waabi_AI. #ComputerVision #Robotics Opinions my own.Valentina Pyatkin @valentina__py
2K Followers 1K Following Postdoc at the Allen Institute for AI @allen_ai and @uwnlpValentin Hofmann @vjhofmann
968 Followers 228 Following Young Investigator (Postdoc) @allen_ai @ai2_allennlp | Formerly @UniofOxford @CisLMU @stanfordnlp @GoogleDeepMindtusharkhot @tusharkhot
274 Followers 188 Following Senior Research Scientist, Allen Institute for AITal August @tal_august
560 Followers 190 Following Incoming assistant professor @IllinoisCS Fall 2024, current postdoc @allen_ai, former PhD student @uwcse. HCI + NLP. Designing language for different people.Sean Welleck @wellecks
3K Followers 223 Following Assistant Professor at CMU. Marathoner, @thesisreview.Ranjay Krishna @RanjayKrishna
5K Followers 416 Following I teach machines to see and interact with people. + Assistant Professor @UWcse - Prev. Research scientist @MetaAI - PhD @StanfordAILab - Instructor @StanfordPiper Wolters @piper_wolters
5 Followers 14 FollowingPeter Hase @peterbhase
2K Followers 690 Following Google PhD Fellow at @uncnlp. Interested in interpretable ML, natural language processing, AI Safety, and Effective Altruism.Pao Siangliulue @Siangliulue
274 Followers 630 Following 🎒 {Creativity, AI, People} | HCI researcher & software eng | @allen_ai | previously @B12, @Harvard, @Stanford | Also on Bluesky 🦋Nathaniel Weir @Nathaniel_Weir
509 Followers 850 Following PhD candidate @jhuclsp working on reasoning. Formerly @ai2_aristo, MS Semantic Machines, @MSFTResearch, @BrownCSDept. On the job market (industry/postdoc)Minyoung Hwang @robominyoung
246 Followers 213 Following Research Intern @carnegiemellon, Previously @allen_ai, MS Grad @SNU | Robotics | Preference-based Reinforcement Learning | Human-Robot InteractionLianhui Qin @Lianhuiq
4K Followers 397 Following Incoming Assistant Professor at UCSD CSE. Currently postdoc at AI2 Mosaic. NLP, ML, AI. I’m recruiting PhD students.Kolby Nottingham @kolbytn
207 Followers 228 Following CS PhD at @UCIrvine researching RL+NLP and interactive LLMs. Upcoming intern @riotgames. Previously @allen_ai, @AiDungeon, @unity, and @nvidia .Khyathi Chandu @khyathi_chandu
1K Followers 444 Following Research Scientist @AI2 | Previously at : @MetaAI @LTICMU @SCSatCMU @GoogleAI @Apple | RisingStars2020Kaitlyn Zhou @KaitlynZhou
461 Followers 315 Following Currently @allen_ai @ai2_mosaic PhD student @StanfordNLPJordan Steward @jordansteward
1K Followers 1K Following WI native, MN fan, @ChelseaFC supporter and Seattlite. Comms @earthrangertech and @skylightmarineJohann Dahm @jdahm
67 Followers 138 Following Software engineering and programming language aficionado. Former computational fluid dynamics nerd. Outdoors enthusiast.Joel Jang @jang_yoel
929 Followers 482 Following PhD student @uwcse. Research Intern at @nvidiaai robotics. Prev: @allen_ai, @kaist_aiJeremy McGibbon @jeremy_mcgibbon
628 Followers 501 Following Researcher and PhD, using machine learning and software engineering to improve climate models. mastodon: [email protected]Jacob Morrison @jacobcares
206 Followers 265 Following PYI & Policy @ @allen_ai @ai2_allennlp Political opinions are my own, and do not represent the views of AI2Ian Magnusson @IanMagnusson
250 Followers 294 Following Predoctoral Young Investigator on AllenNLP at @allen_ai. Working on domain adaptation, reproducibility, and evaluation in NLP.Hamish Ivison @hamishivi
476 Followers 596 Following Antipodean Abroad. he/him. I (try to) do NLP research. PhD student @uwcse, prev @Sydney_Uni @allen_ai 🇦🇺🇨🇦🇬🇧Emma Strubell @strubell
4K Followers 936 Following assistant professor @LTIatCMU & visiting scientist @allen_ai. natural language processing and efficient ML. she/her/dad (2 dogs). 🏳️🌈. hiking and food. BLM.Doug Downey @_DougDowney
281 Followers 175 Following Research Manager at @allen_ai, Prof at @northwesterncsDa Yin @Wade_Yin9712
776 Followers 421 Following PhD @uclanlp | Intern at AI2 Mosaic @ai2_mosaic | Amazon PhD Fellow in 2023 @AmazonScienceBrian Henn @BrianMHenn1
78 Followers 33 Following hydrologist, data scientist, engineer, new(ish) parentIf you work on language models (anything: data, pretraining, fine-tuning) and want to contribute more to truly open models and science, please get in touch (DM/email). We're looking to hire core contributor(s) to OLMo and future models at @allen_ai. Very high bar for talent.
Introducing SatlasPretrain, a suite of open geospatial foundation models. These models power SATLAS, our platform @allen_ai for open global AI generated geospatial data. SatlasPretrain gives everyone access to our source code, pre-trained weights, illustrative demos and more.…
Listen to a riveting episode of the MLOps Community Podcast, where Patrick Beukema from AI2 ( @allen_ai ) delved into the exciting ways AI is contributing to environmental conservation.
@yuzhaouoe I **loved** your paper Yu ❤️ When we started OLMo, we discussed similar approaches, but ran out of time to do research on it & write efficient code. I'm so glad y'all published this study–Llama 3 blogpost doesn't do the problem justice! Definitely on the table now 😉
🌻 Super excited about my first Computer Science publication at @naaclmeeting (main)! @mbodhisattwa and I study the language of deception and how language models fare at detecting them. And guess what we've found: arxiv.org/pdf/2311.07092… (1/n) 🧵 @EconUofU @allen_ai
Our team is incredibly proud to partner with @allen_ai and thrilled to see them cook! Achieving such a massive improvement in MMLU, while reducing the compute budget, is a fantastic win. And doing it fully open? Everyone wins. Congrats! Can't wait to see what's next 👀
Announcing our latest addition to the OLMo family, OLMo 1.7!🎉Our team's efforts to improve data quality, training procedures and model architecture have led to a leap in performance. See how OLMo 1.7 stacks up against its peers and peek into the technical details on the blog:…
In case folks are curious of what two-stage training gets you: x.com/soldni/status/…
@xlr8harder just dug it out of our log, hope it helps!
@mer__edith Literally better at the benchmark 😊 At @allen_ai, we work to demystify what actions LLM devs take to improve numbers. Our goal is to transparently explain what's going on w benchmarks! I guess we do things a bit differently than most shops out there?... 😅 perks of nonprofit
@mer__edith @allen_ai oh 100% agree with you, none of this MMLU hyper-optimization makes any sense. I personally think it's important to show the exact steps one has to follow to game the score, and we are planning follow-up work showing what compromises doing that entails!
Today we released a new version of OLMo 7B, which has significantly improved performance on MMLU. We also discuss a lot of how we got the improvements, big shoutout to the team! Check out that performance-efficiency tradeoff 🤩 this new model is on the Pareto frontier!
Announcing our latest addition to the OLMo family, OLMo 1.7!🎉Our team's efforts to improve data quality, training procedures and model architecture have led to a leap in performance. See how OLMo 1.7 stacks up against its peers and peek into the technical details on the blog:…
Amazing work as always by @soldni and and the folks at AI2. Major improvements on MMLU by tweaking the recipe on data cleaning and mixing. Read the blog and learn from the best. Open science is so important!
What does it take to get a good MMLU score? Turns out: decent data, instructions in pretraining, fuzzy dedup, and quality filtering. just dropped OLMo 1.7-7b… nice perf lift over 1.0! Blog: blog.allenai.org/olmo-1-7-7b-a-… Model: huggingface.co/allenai/OLMo-1… Data: huggingface.co/allenai/dolma
Shout-out to the team – this came together really quickly! Y’all thoroughly rocked it @soldni, @kylelostat, @natolambert, @gu_yuling, @HannaHajishirzi, and a bunch of people who don't have twitter because they know getting stuff done is more important!
We released OLMo 1.7 7B + Dolma 1.7 today 🔥 With the juiciness of Dolma 1.7 + staged training we have improved OLMo’s MMLU score by 24 pts, clearly better than Llama2 7B! Blog post: blog.allenai.org/olmo-1-7-7b-a-… Model: huggingface.co/allenai/OLMo-1… Dataset: huggingface.co/datasets/allen…
notable stuff: 🦉ton of perf boost from mixing instruct data at end (e.g., flan) 🐋anneal learning rate (Fig 9b in arxiv.org/abs/2403.08763) 🐞changing data mix boosts MMLU at some cost to other evals 🍇huggingface.co/allenai/dolma 🧀huggingface.co/allenai/OLMo-1…
Announcing our latest addition to the OLMo family, OLMo 1.7!🎉Our team's efforts to improve data quality, training procedures and model architecture have led to a leap in performance. See how OLMo 1.7 stacks up against its peers and peek into the technical details on the blog:…
Allen AI team is moving fast. They're on the ~Pareto frontier~ now, and it's built in the open, so we all get to see how it's done! gratz @mechanicaldirk @soldni @natolambert
Announcing our latest addition to the OLMo family, OLMo 1.7!🎉Our team's efforts to improve data quality, training procedures and model architecture have led to a leap in performance. See how OLMo 1.7 stacks up against its peers and peek into the technical details on the blog:…
Nice write-up on the path to higher data quality from @allen_ai. They released their dataset AND their FastText quality filter, which I really appreciate. Also, annealing per OpenBMB is well and truly SOP --I wonder if schedule-free optimizers will change this.
What does it take to get a good MMLU score? Turns out: decent data, instructions in pretraining, fuzzy dedup, and quality filtering. just dropped OLMo 1.7-7b… nice perf lift over 1.0! Blog: blog.allenai.org/olmo-1-7-7b-a-… Model: huggingface.co/allenai/OLMo-1… Data: huggingface.co/allenai/dolma
Introducing our best OLMo yet. OLMo 1.7-7B outperforms LLaMa2-7B, approaching LLaMa2-13B at MMLU and GSM8k. High-quality data and staged training are key. I am so proud of our team making such significant improvement in a short period after our first release.
Announcing our latest addition to the OLMo family, OLMo 1.7!🎉Our team's efforts to improve data quality, training procedures and model architecture have led to a leap in performance. See how OLMo 1.7 stacks up against its peers and peek into the technical details on the blog:…