Fred Sala @fredsala
Assistant Professor @WisconsinCS. Research scientist @SnorkelML. Prev. Stanford postdoc. Working on machine learning & information theory. pages.cs.wisc.edu/~fredsala/ Madison, WI Joined July 2010-
Tweets216
-
Followers982
-
Following545
-
Likes3K
Learn how to get better foundation model performance without additional fine-tuning. This event is TODAY at Noon Pacific. Time is running out! buff.ly/495ZtmN
There is an explosion of total nonsense around LLM auto-eval in the space these days... be wary of approaches that claim to kick the human out of the loop! E.g. 'Using GPT-4 to auto-eval' makes sense only if you are trying to *distill* GPT-4 functionality. I.e. you are…
Excited to present the first day of the @RealAAAI 2024 Spring Symposium on Clinical Foundation Models! 🎊 Today's lineup includes keynotes, a panel discussion, demos, contributed talks, and a poster session! @clinicalfms
We just released Bonito 🐟, an open-source model that converts your raw, unannotated data into synthetic instruction tuning datasets. With it, you can easily create a specialized LLM for your proprietary and private data! (1/n) github.com/BatsResearch/b…
Interested in GNNs? Check out our implementation of GCNs on Cartesian products of Hyperbolic, Spherical, and Euclidean manifolds. It is the only public and open source implementation of such a network that I'm aware of. github.com/mcneela/Mixed-…
Our preprint on non-Euclidean representation learning for biological pathway graphs is now on arXiv arxiv.org/abs/2401.15478 This research was led by @dannymcneela who is co-advised by @fredsala. 1/
Excited to share that our work on improving the robustness of foundation models, without training or data, will be at @iclr_conf ! Longer version of our paper that won best paper honorable mention at the NeurIPS R0-FoMo workshop last month.
Excited to share that our work on improving the robustness of foundation models, without training or data, will be at @iclr_conf ! Longer version of our paper that won best paper honorable mention at the NeurIPS R0-FoMo workshop last month.
Excited to announce the 𝐁𝐞𝐬𝐭 𝐏𝐚𝐩𝐞𝐫 𝐀𝐰𝐚𝐫𝐝𝐬 (2 papers) and 𝐇𝐨𝐧𝐨𝐫𝐚𝐛𝐥𝐞 𝐌𝐞𝐧𝐭𝐢𝐨𝐧𝐬 (2 more papers) for our NeurIPS workshop R0-FoMo: Robustness of Few-shot & Zero-shot Learning in Foundation Models 🎉 Please join us in congratulating the authors 👏
🎉Exciting News! Join us for the AAAI-24 Spring Symposium on Clinical Foundation Models! 🚀Explore captivating talks, engaging panels, & cutting-edge demos. All details (CfP, timelines, ...) available at 👉clinicalfoundationmodels.github.io. Hurry, papers due by Jan 5, 2024 @clinicalfms
Heading to #NeurIPS 2023 from Dec 10-17! My collaborators and I will present 1. Fairness in weak supervision 2. How to use LLMs for foundation model test-time adaptation @ R0-FoMo Workshop 3. Improving data wrangling LLMs with better demonstrations @ TRL Workshop 🧵
Gonna present this work as an oral at the R0 FoMo workshop on Friday, Dec 15th at 4:10 pm! Feel free to come by ☺️
Gonna present this work as an oral at the R0 FoMo workshop on Friday, Dec 15th at 4:10 pm! Feel free to come by ☺️
This year, @UWMadison CS researchers had an incredible 30(!) papers accepted to @NeurIPSConf. Join us in congratulating all involved, and explore a sampling of their work below. 🧵@uwcdis, @UWMadisonLS, @madsjw, @UWMadScience cs.wisc.edu/2023/12/06/uw-…
Stoked to be headed to @NeurIPSConf #NeurIPS2023 soon! Come check out our papers this year! (Thurs 10:45) Geometry Aware Adaptation for Pretrained Models (Weds 10:45) Skill-it! A Data-Driven Skills Framework for Understanding and Training LMs x.com/mayeechen/stat… 🎉
Stoked to be headed to @NeurIPSConf #NeurIPS2023 soon! Come check out our papers this year! (Thurs 10:45) Geometry Aware Adaptation for Pretrained Models (Weds 10:45) Skill-it! A Data-Driven Skills Framework for Understanding and Training LMs x.com/mayeechen/stat… 🎉
Lauren Pick (CI Postdoc) is on the job market! Lauren has been doing exceptional verification/synthesis work. Notably, her work on distributed systems was used to verify real-world systems at AWS, and she recently had 2 PLDI 23 papers. Hire Lauren! lmpick.github.io
Join us this #GivingTuesday in supporting the new home for innovation and knowledge at the School of Computer, Data & Information Sciences. Your contribution not only supports our new building but also makes a lasting impact on the future of technology💻 ow.ly/2USp50Qcc7t
Sharon Y. Li @SharonYixuanLi
7K Followers 657 Following Assistant Professor @WisconsinCS. Formerly postdoc @StanfordAILab, Ph.D. @Cornell. Making AI safe and reliable for the open world.Alex Ratner @ajratner
5K Followers 548 Following @SnorkelAI @uwcse / prev @StanfordAILab – Interested in data management systems for machine learning, weak supervision, and impactful applications.Dimitris Papailiopoul.. @DimitrisPapail
11K Followers 970 Following prof @ wisconsin; thinking about transformers; learning in context; babas of Inez LilyLoris D'Antoni @lorisdanto
6K Followers 730 Following Professor @WisconsinCS, this summer moving to @ucsd_cse. Also Visiting Academic @AWScloud. Helps people write programs that do the thing people want them to do.Kyle Cranmer @KyleCranmer
16K Followers 3K Following Director Data Science Institute @UWMadison @datascience_uw. EiC @MLSTjournal. Physics, stats/ML/AI, open science. same handle @sigmoid.social and bskyNicholas Roberts @nick11roberts
591 Followers 1K Following Ph.D. student @WisconsinCS. Working on data-centric automated machine learning. Previously at CMU @mldcmu, UCSD @ucsd_cse, FCC @fresnocity.Rob Nowak @rdnowak
2K Followers 437 Following Director of the Center for the Advancement of ProgressTri Dao @tri_dao
18K Followers 364 Following Incoming Asst. Prof @PrincetonCS, Chief Scientist @togethercompute. Machine learning & systems.Beidi Chen @BeidiChen
6K Followers 351 Following Asst. Prof @CarnegieMellon, Visiting Researcher @Meta, Postdoc @Stanford, Ph.D. @RiceUniversity, Large-Scale ML, a fan of Dota2.Zachary Lipton @zacharylipton
59K Followers 2K Following Professor: CMU/@acmi_lab, CTO / CSO: @AbridgeHQ, Creator: @d2l_ai & https://t.co/QQt98VNLUp, Relapsing 🎷Dan Fu @realDanFu
4K Followers 176 Following CS PhD Candidate at Stanford, systems for machine learning. Sometimes YouTuber/podcaster. Academic Partner, @togethercompute.Michael Zhang @mzhangio
1K Followers 426 Following CS PhD Student @hazyresearch, @StanfordAILab. Robustness. Foundations of foundation models. Want to make them less shaky.Karan Goel @krandiash
3K Followers 882 Following Founder @cartesia_ai, Machine Learning PhD at @StanfordAILab, CMU / IIT-Delhi alum.Aditya Grover @adityagrover_
8K Followers 412 Following CS Prof @UCLA. AI, ML, Climate. Prev: Postdoc @berkeley_ai, PhD @StanfordAILab, bachelors @IITDelhi.Tom Goldstein @tomgoldsteincs
23K Followers 2K Following Professor at UMD. AI security & privacy, algorithmic bias, foundations of ML. Follow me for commentary on state-of-the-art AI.Kangwook Lee @Kangwook_Lee
2K Followers 667 Following Assistant Professor, ECE, UW-Madison / Leading deep learning research @ KRAFTONJeff Linderoth @JeffLinderoth
4K Followers 1K Following Professor, Optimizer, Maker of Human Pyramids. @[email protected]Hongyi Wang @HongyiWang10
1K Followers 1K Following Senior Project Scientist @mldcmu @CarnegieMellon; MLSys researcher; Member @llm360; Ph.D. @WisconsinCS; On the academic job market NOW!Paul Campbell Blue Ch.. @ThPaulCampbell
2K Followers 1K Following Forex Trader |📍New York 🇺🇸 Mining Crypto #7 firm in the 🌎 I teach people how to do the same mining crypto Buy or sell & then #setandforgetZhaoyang Wang @wangwan83764204
299 Followers 4K Following CS PhD student at UoB in the United Kingdom. Research interests: Automated Machine Learning, Online Learning, and Reinforcement Learning 🏳️🌈Yinglun Zhu @yinglun122
248 Followers 491 Following Assistant professor @UCRiverside @ucr_ece. PhD @WisconsinCS. Working on interactive machine learning + large pre-trained models (e.g., LLMs).Sal @sekimor7703887
5 Followers 686 Followinghumanlover @jesseyl594
0 Followers 184 FollowingDaniel Smedema @Djsmedes
76 Followers 41 Followingsuyu liu @suyuliu8
7 Followers 148 Followingkumar @kumar__nn
0 Followers 1K FollowingSHA Group @weieisha
1K Followers 3K Following Associate Prof. ("1000 Youth Talents") at @ZJU_China; Marie-Curie Fellow at @UCL. Engages in electromagnetics, nano/nonlinear/quantum optics, and solar cells.Jitendra Sharma @jkumarsharma998
807 Followers 6K Following Curious about Research in AI. NLP and Computer Vision Interest me. Curious about truth and existence. Views are personal.João Martinho @JooMart10857656
635 Followers 3K FollowingPensé FFun @inftyCategory
113 Followers 6K FollowingLelCh @Yongsheng_Si
4 Followers 534 Following Aiming to be a researcher, writer, and startup founder.trusha_talati @TalatiTrusha
31 Followers 199 Following - Code, eat, sleep repeat 💻 - Love Netflix ❤ - Solve problems & Help society 🤝Mahitha Pillodi @PillodiMahitha
20 Followers 75 FollowingRama @rama25007
28 Followers 249 FollowingMohd Abbas Zaidi @mabbas_ai
58 Followers 442 Following Generative AI Taskforce @ Samsung Research Seoul 🇰🇷 | Undergrad @ IIT Kanpur 🇮🇳Zhihong Chen @zhjohnchan
188 Followers 778 Following VSR @Stanford | Ph.D. Student @cuhksz | BE@SYSU | Vision+Language | Large Language Models | Think Outside the BoxMingyu Derek MA @mingyu_ma
320 Followers 746 Following PhD student @UCLA; Working on #NLProc; he/his/himTej D. Azad 🇺🇸 @tdazad
2K Followers 514 Following Resident Physician • Neurosurgery • @HopkinsMedicine | MD/MS @StanfordMed | BA @WUSTL | Proud Hoosier | cranio- to @ChaoLongAzad's -plastyyuyin zhou @yuyinzhou_cs
1K Followers 499 Following Assistant Professor @ucsc, Postdoctoral Researcher @Stanford @StanfordAIMI, Medical Image Analysis, Machine Learning / former Ph.D. @JohnsHopkins M.S. @UCLAJaden Park @jadenpark98
21 Followers 50 FollowingHuang Qichag @HQichag48397
424 Followers 4K FollowingJuan Hmmm @JuanAH03488233
77 Followers 3K FollowingStephanieKallberg @StephanieK53207
46 Followers 2K FollowingChaowei Xiao @ChaoweiX
2K Followers 454 Following Assistant Professor @University of Wisconsin, Madison Researcher@NVIDIA| Researcher on AI Safety/SecurityBen Cohen-Wang @bcohenwang
88 Followers 108 Following Machine learning PhD student at MIT advised by Aleksander Madryيوسف @_hidden_ones
160 Followers 4K FollowingHaoyueBai @haoyue_bai
932 Followers 838 Following Ph.D. student at Computer Science Department @UWMadisonCS, MPhil @HKUSTCSE.SACM @sacm_uwmadison
61 Followers 16 Following Student chapter of the Association for Computing Machinery at the University of Wisconsin.Yongkai Liu @Focus_on_aca
155 Followers 578 Following Postdoc at @Stanford / PhD from @UCLA (2022) / Master from @Tsinghua_Uni / AI + StrokeJotyres @jotyres21181
41 Followers 2K FollowingRamneet Singh @Ramneet_Singhh
475 Followers 3K Following Visiting Researcher @gatech_scs | Senior Undergraduate in CS at IIT Delhi | Research in PL+ML | Learning Category Theory | Sports + Music + Food (in that order)Nancy Scott @NancyScott04
68 Followers 1K Following I'm a woman of high moral integrity I love seeing best in people which made me appreciate the natureVincent Koc @koconder
5K Followers 3K Following Technologist and Futurist | Artificial Intelligence Engineering | Data Leadership | Lecturer @MIT | Ex @Qantas | #buildinpublic Views are my ownValentina Akoni @ValentAkoni
39 Followers 5K FollowingMary Letey @maryiletey
76 Followers 386 Following PhD student at Harvard @hseas. Applied maths, ML theory, Geometry, Cosmology.INAM KHAN @inamullahnaseeh
186 Followers 4K Following 🚀 BSCS grad 🎓 | Passionate about AI, Machine Learning, and Data Science 💻 | Eagerly seeking internships to dive into the world of cutting-edge tech!Neve Hanner @hanne_nev
40 Followers 4K FollowingYusra Geist @GeistYus
34 Followers 5K Followingpaperboy @paperboy350236
53 Followers 398 FollowingSharon Y. Li @SharonYixuanLi
7K Followers 657 Following Assistant Professor @WisconsinCS. Formerly postdoc @StanfordAILab, Ph.D. @Cornell. Making AI safe and reliable for the open world.Alex Ratner @ajratner
5K Followers 548 Following @SnorkelAI @uwcse / prev @StanfordAILab – Interested in data management systems for machine learning, weak supervision, and impactful applications.Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistDimitris Papailiopoul.. @DimitrisPapail
11K Followers 970 Following prof @ wisconsin; thinking about transformers; learning in context; babas of Inez LilyAndrej Karpathy @karpathy
978K Followers 904 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥François Chollet @fchollet
469K Followers 770 Following Deep learning @google. Creator of Keras. Author of 'Deep Learning with Python'. Opinions are my own.Alex Dimakis @AlexGDimakis
13K Followers 2K Following UT Austin Professor. Researcher in Machine Learning and Information Theory. National AI Institute on the Foundations of Machine Learning (IFML) Co-director.Clément Canonne @ccanonne_
31K Followers 928 Following Senior Lecturer @Sydney_Uni. Postdocs @IBMResearch, @Stanford; PhD @Columbia. Converts ☕ into puns: sometimes theorems. He/him. @[email protected]Loris D'Antoni @lorisdanto
6K Followers 730 Following Professor @WisconsinCS, this summer moving to @ucsd_cse. Also Visiting Academic @AWScloud. Helps people write programs that do the thing people want them to do.Kyle Cranmer @KyleCranmer
16K Followers 3K Following Director Data Science Institute @UWMadison @datascience_uw. EiC @MLSTjournal. Physics, stats/ML/AI, open science. same handle @sigmoid.social and bskyNicholas Roberts @nick11roberts
591 Followers 1K Following Ph.D. student @WisconsinCS. Working on data-centric automated machine learning. Previously at CMU @mldcmu, UCSD @ucsd_cse, FCC @fresnocity.Rob Nowak @rdnowak
2K Followers 437 Following Director of the Center for the Advancement of ProgressGautam Kamath @thegautamkamath
44K Followers 505 Following Assistant Prof of CS @UWaterloo, Faculty @VectorInst, Canada @CIFAR_News AI Chair. Co-EiC @TmlrOrg. I lead @TheSalonML. Privacy, robustness, machine learning.Tri Dao @tri_dao
18K Followers 364 Following Incoming Asst. Prof @PrincetonCS, Chief Scientist @togethercompute. Machine learning & systems.Gabriel Peyré @gabrielpeyre
92K Followers 449 Following @CNRS researcher at @ENS_ULM. One tweet a day on computational mathematics.Beidi Chen @BeidiChen
6K Followers 351 Following Asst. Prof @CarnegieMellon, Visiting Researcher @Meta, Postdoc @Stanford, Ph.D. @RiceUniversity, Large-Scale ML, a fan of Dota2.Zachary Lipton @zacharylipton
59K Followers 2K Following Professor: CMU/@acmi_lab, CTO / CSO: @AbridgeHQ, Creator: @d2l_ai & https://t.co/QQt98VNLUp, Relapsing 🎷Dan Fu @realDanFu
4K Followers 176 Following CS PhD Candidate at Stanford, systems for machine learning. Sometimes YouTuber/podcaster. Academic Partner, @togethercompute.Michael Zhang @mzhangio
1K Followers 426 Following CS PhD Student @hazyresearch, @StanfordAILab. Robustness. Foundations of foundation models. Want to make them less shaky.Yinglun Zhu @yinglun122
248 Followers 491 Following Assistant professor @UCRiverside @ucr_ece. PhD @WisconsinCS. Working on interactive machine learning + large pre-trained models (e.g., LLMs).Daniel Smedema @Djsmedes
76 Followers 41 Followingyuyin zhou @yuyinzhou_cs
1K Followers 499 Following Assistant Professor @ucsc, Postdoctoral Researcher @Stanford @StanfordAIMI, Medical Image Analysis, Machine Learning / former Ph.D. @JohnsHopkins M.S. @UCLABrian Jabarian @brian_jabarian
8K Followers 943 Following Howard and Nancy Marks Principal Researcher at Chicago Booth Business SchoolAvner May @avnermay
127 Followers 202 Following Staff Research Scientist at https://t.co/WEMkSSRVeZ. Formerly research scientist at Google, postdoc at Stanford, and PhD student at Columbia.Vincent Koc @koconder
5K Followers 3K Following Technologist and Futurist | Artificial Intelligence Engineering | Data Leadership | Lecturer @MIT | Ex @Qantas | #buildinpublic Views are my ownLuke Zettlemoyer @LukeZettlemoyer
8K Followers 2K FollowingInstitute for Foundat.. @MLFoundations
1K Followers 1K Following IFML is an NSF funded National AI Institute, a collaboration between @UTAustin, @UW, @WichitaState, and @MSFTResearch.Ankur Parikh @ank_parikh
3K Followers 3K Following Staff Research Scientist at Google DeepMind. Former adjunct assistant prof at @NYU_Courant. PhD at @mldcmu. ML for Bio/Chem (Prev. NLP). All opinions my own.Tanmoy Mukherjee @langer_han
640 Followers 2K Following Senior researcher imec.Avid reader. Interested in ML/Explainability/Interpretability/CVYuki Mitsufuji @mittu1204
3K Followers 98 Following PhD, Distinguished Engineer @Sony, Lead Research Scientist @SonyAI_global, Head of Creative AI Lab, Specially Appointed Associate Prof. @tokyotech_jpJoao Dorea @jrrdorea
456 Followers 274 Following Assistant Professor at the University of Wisconsin-Madison in the Department of Animal and Dairy Sciences - Precision Livestock Farming and Data AnalyticsEric Nguyen @exnx
2K Followers 324 Following PhD in BioEngineering & AI @stanford @HazyResearch @StanfordAILab @arcinstituteMoritz Munchmeyer @moritzmunchmeyr
123 Followers 220 FollowingValentin Mandache @casedeepoca
3K Followers 1K Following I am an architectural historian, with a multidisciplinary approach (history, economics, geology, climate), interested in the built heritage of Southeast Europe.Graham Neubig @gneubig
31K Followers 586 Following Associate professor at CMU, studying natural language processing and machine learning.Alexis Conneau @alex_conneau
24K Followers 111 Following Audio AGI Research Lead @OpenAI - GPT-Next - Past: XLM, Unsupervised ASR, Unsupervised MT, Wav2vec 2.0/XLSR, MUSE, Unsupervised cross-lingual transferKartik Sreenivasan @KartikSreeni
713 Followers 528 Following Graduate Student @ UW-Madison. Research scientist intern at MosaicML/Databricks. Interested in LLMs, optimization, and the meaning of life.Ahmad Beirami @abeirami
4K Followers 2K Following Building safe, helpful, and scalable generative AI @Google | ex-{@AIatMeta, @EA, @MIT, @Harvard, @DukeU} | @GeorgiaTech PhD | زن زندگی آزادی | opinions my ownChuang Gan @gan_chuang
4K Followers 443 Following Faculty Member at UMass Amherst; Principal researcher at MIT-IBM Watson AI Lab; Homepage: https://t.co/oXP6pqXCpoGarrett Merz @merz_garrett
811 Followers 3K Following Postdoc, AI for physics @datascience_uw- prev @UMichPhysics, @OSUphysics. Empty hands & desire to unbuild walls. Also @Garrodactyl (he/him), opinions mineBailin Wang @bailin_28
496 Followers 2K Following NLP researcher (w. latent variables, discrete structures/grammars, sequence models)Theofanis Karaletsos @Tkaraletsos
4K Followers 2K Following Head of AI @cziscience | probabilistic and deep MLNamburi Srinath @srinath_namburi
35 Followers 45 Following @WisconsinCS. Applied Science @Amazon, ML Intern @truera_ai. Blogger, reader and ponders about nothing! Trying to reach global min but stuck at local min!Kendall Park @kendallpark
121 Followers 442 Following MD-PhD student and software dev. AI + healthcare.Omar Khattab @lateinteraction
11K Followers 2K Following CS PhD candidate @StanfordNLP. 2022 Apple Scholar in AI/ML. Author of ColBERT (https://t.co/2ZtgXoa1np), DSPy (https://t.co/BH7WmMKDXR), & various retrieval & LM systems.Gary Shiu @gary_shiu
1K Followers 526 FollowingShuai Zhang @DavenCheung
353 Followers 257 Following Now @amazon, @awscloud. Previously, Postdoc @ETHDongyeop Kang (DK) @dongyeopkang
921 Followers 239 Following Assistant professor @UMNComputerSci, a member of @MinnesotaNLP group, research on human-centered language technologies, he/him/hisYuchen Zeng @yzeng58
562 Followers 549 Following PhD student in Computer Science at University of Wisconsin-Madison | Large Language ModelsSameer Deshpande @skdeshpande91
1K Followers 765 Following Assistant professor of Statistics @UWMadison. Interested in Bayesian statistics, causal inference, and statistics in sports.Midwest Modern @JoshLipnik
120K Followers 831 Following Architecture, Art, and Design from the Midwest | Subscribe on Patreon: https://t.co/DJqLP7OoZM | Contact at [email protected]Jindong Wang @jd92wang
3K Followers 409 Following Senior Researcher at @MSFTResearch. Robust machine learning, transfer learning, OOD generalization. Recently: large language models. https://t.co/fUsOEtxAW7Florian Tramèr @florian_tramer
4K Followers 205 Following Assistant professor of computer science at ETH Zürich. Interested in Security, Privacy and Machine LearningB. Aditya Prakash @badityap
1K Followers 580 Following Associate Professor of Computing @GeorgiaTech | ML/AI + X. X = public health, urban systems, networks, the Web | 💙 data.Corinne Marie Riley @CorinneMRiley
8K Followers 2K Following Partner @GreylockVC investing in data and AI products at the infrastructure and application layersJoey Bose @bose_joey
2K Followers 254 Following Post-doc @UniofOxford w/@mmbronstein. Interested in Geometry ∩ Generative Models. Ex-@Mila_Quebec @QCOMResearch @MetaAI, @UberAILabs, @BorealisAI, @UofT.Shao-Hua Sun @shaohua0116
3K Followers 888 Following Assistant Professor @ National Taiwan University (NTU) | CS Ph.D. @USC | Robot Learning, Reinforcement Learning, Program Synthesis | 台大電機系助理教授Peter Richtarik @peter_richtarik
6K Followers 592 Following Federated Learning Guru. Tweeting since 20.5.2020. Lived in 🇸🇰🇺🇸🇧🇪🇬🇧🇸🇦Ruoxi Jia @ruoxijia
381 Followers 189 Following Assistant Professor in the ECE Department at Virginia Tech, PhD @Berkeley_EECSZhuang Liu @liuzhuang1234
3K Followers 930 Following Research Scientist @MetaAI (FAIR, at NYC). machine learning, computer vision, neural networks. PhD from @Berkeley_EECSVasilis Papageorgiou @vpapageorgiou_
80 Followers 169 Following PhD student at @WisconsinCS | @tuc_chania alumnusFrank Nielsen @FrnkNlsn
23K Followers 1K Following Machine Learning & AI, Information Sciences & Information Geometry, Distances & Statistical models, HPC. "Geometry defines the architecture of spaces" @SonyCSLSonia Cromp @SonNicCr
5 Followers 17 Followingringwiss @ringwiss
17K Followers 175 Following 🏳️🌈 🇪🇺 🇵🇱 🇬🇧 He/him. Armchair parliamentarian. I type at 140 wpm. RTs are endorsements.Boyuan Chen @Boyuan__Chen
1K Followers 548 Following Assistant Professor @DukeEngineering. Robotics and AI.“Now imagine the collection of all things that are weird in this way, and think of this collection as itself being a thing.”
high level math: "imagine a thing. now imagine that it's weird."
In a world with Llama3/Phi3/Arctic/etc (and more coming!), base LLMs are now a commodity. AI is now all about the inputs & outputs that customize an LLM for unique use cases: - Inputs: Labeled, curated data to prompt/tune/align - Outputs: How you map from model -> product/UX
Congratulations to #UWMadison professor @prowag, who was awarded the Evjue Distinguished Chair; and to Russ Castronovo, David Kaplan, Mark Kenoyer, Stephen Wright, and Ellen Zweibel for being awarded Hilldale Professorships! #OnWisconsin news.wisc.edu/evjue-chair-hi…
Our own Assistant Professor Sameer Deshpande harnesses advanced statistical techniques to better understand the world of sports. In our new Q&A, Desphande talked about his sports analytics research, his 3 years at the UW, and lots more. ⚾ 📈 Read on: ow.ly/QsPF50RoeiU
See why AI data development is a 'hot area.' Co-founder and Head of Applied Machine Learning, Paroma Varma, sits down with Fierce Network to discuss the role of data in enterprise AI. Thanks to Diana Goovaerts for the fantastic coverage! 👉 buff.ly/4dfxNio
1/ With LLMs like Llama 3 & Phi 3, enterprises are no longer blocked on the models. The game is now about one thing: developing the data to tune & evaluate these LLMs for real business use cases. Excited to support this w/ the new @SnorkelAI release! venturebeat.com/data-infrastru… 🧵
There is a really nice community of researchers developing transformer alternatives. Want to highlight these impressive folks. Simran Arora (@simran_s_arora), Chunting Zhou (@violet_zct), Dan Fu (@realDanFu), and Songlin Yang (@SonglinYang4)
How it started How it ended #Hawks @datascience_uw
100%! Access to annotated data is the key to enterprise AI. The key though is that this AI-ready data is not one-size-fits all- it’s annotated *for each specific use case / operating setting*. This game is not about data lakes… it’s about scalable data labeling & development
One of my biggest takeaways from the Llama3 announcement - data gravity is king. And access to high quality, annotated, LLM ready data will drive which companies truly utilize AI vs those who don't As the number of accessible, highly performant models continues to grow (both…
Such a welcome addition to the benchmarking landscape! - Creating benchmarks that correlate well with humans and separate top models has become increasingly hard as they’ve become increasingly capable. - And knowing it will be refreshed reduces the incentive for organizations…
Introducing Arena-Hard – a pipeline to build our next generation benchmarks with live Arena data. Highlights: - Significantly better separability than MT-bench (22.6% -> 87.4%) - Highest agreement to Chatbot Arena ranking (89.1%) - Fast & cheap to run ($25) - Frequent update…
At this point I feel like we understand pretty well what's going on with LLMs: - Outputs are roughly equivalent to kernel smoothing over positional embeddings (arxiv.org/pdf/1908.11775…) - The learned computation model is *probably* bounded by RASP-L (arxiv.org/pdf/2310.16028…) -…
Awesome post! In particular re: the POV on LLM progress, which I could not agree more with obviously: "Currently bottlenecked by high quality annotated data" :) And, this bottleneck only grows exponentially when you consider that "high quality" is specific to each use case.
At this point I feel like we understand pretty well what's going on with LLMs: - Outputs are roughly equivalent to kernel smoothing over positional embeddings (arxiv.org/pdf/1908.11775…) - The learned computation model is *probably* bounded by RASP-L (arxiv.org/pdf/2310.16028…) -…
Incredibly excited to see OSS LLMs leap forward w/ @Meta's Llama 3, and for @SnorkelAI to be part of the "Llama ecosystem" ai.meta.com/blog/llama-2-u… The base LLMs are there. The next frontier in enterprise AI is tuning & aligning models like Llama 3 on unique data & use cases.
👀New paper alert!👀 Novel Symmetry-preserving #NeuralNetwork Model for #Phylogenetic Inference @BioinfoAdv by awesome student Xudong Tang @harry_txd Paper: go.wisc.edu/q9cz75 3-min talk with the highlights 👇 youtu.be/EWPvTnVnHAg
Now that it is official, my amazing student Chris Harshaw is joining the statistics department @Columbia as an Assistant Professor. Super proud of him. chrisharshaw.com
Congrats Jiefeng. Jiefeng was co-advised by me and Prof. Yingyu Liang and did impressive work during his PhD at @WisconsinCS Eager to see his research trajectory at @Google
Thrilled to announce that I've joined Google as a Research Scientist! I'm excited to dive into LLM research and contribute to cutting-edge developments in the field. Looking forward to this new chapter! 🚀 #NewJob #ResearchScientist #Google
Excited to announce Snorkel Custom, a hands-on accelerator for enterprises to build LLMs customized on their data, for their use cases: snorkel.ai/introducing-sn… This is the year to cross the chasm from flashy chatbot demo to real production AI. We are here to help!
Join us for a dynamic panel discussion at Google Cloud Next (Wednesday, April 10, 11:45 AM PDT) where our very own Paroma Varma will share real-world insights from successful startups and growth companies. #Diversityandinclusion #Startups #GrowthCompanies #TalentAcquisition
Classical mixture models are limited to positive weights and this requires learning very large mixtures! Can we learn (deep) mixtures with negative weights? Answer in our #ICLR2024 spotlight by @loreloc_ Aleks, Martin, Stefan, Nicolas @arnosolin 📜openreview.net/forum?id=xIHi5…
After the score-based models, I decided to take a step back and cover the basics in a new blog post: Probabilistic modeling and Mixture Models. Additionally, I make a brief intro to ✨Probabilistic Circuits✨ Check: 📄Post: jmtomczak.github.io/blog/19/19_mog… 🖥️ Code: github.com/jmtomczak/intr…