Chelsea Finn @chelseabfinn
Asst Prof of CS & EE @Stanford. PhD from @Berkeley_EECS, EECS BS from @MIT ai.stanford.edu/~cbfinn Palo Alto, CA Joined June 2014-
Tweets542
-
Followers69K
-
Following384
-
Likes1K
Robots often make mistakes in long-horizon tasks, which require a lot of data to fix. Our robot can: - incorporate verbal corrections on-the-fly, AND - use those to improve the policy over time No further teleop needed! Paper & Code: yay-robot.github.io
Robots often make mistakes in long-horizon tasks, which require a lot of data to fix. Our robot can: - incorporate verbal corrections on-the-fly, AND - use those to improve the policy over time No further teleop needed! Paper & Code: yay-robot.github.io
The standard way to supervise ML models it to give many many examples. We can provide supervision *far* more efficiently: 1. verbally describe how the model fails 2. translate feedback w/ VLMs 3. reweight the data to globally fix the misconception Paper: arxiv.org/abs/2402.03715
The standard way to supervise ML models it to give many many examples. We can provide supervision *far* more efficiently: 1. verbally describe how the model fails 2. translate feedback w/ VLMs 3. reweight the data to globally fix the misconception Paper: arxiv.org/abs/2402.03715
RLAIF isn't as effective as we thought.
RLHF requires tons of human-labeled preference data. Can LLMs instead improve using only short verbal feedback? RLVF paper: arxiv.org/abs/2402.10893
RLHF requires tons of human-labeled preference data. Can LLMs instead improve using only short verbal feedback? RLVF paper: arxiv.org/abs/2402.10893
Want to optimize/edit/transform neural net weights using another neural net? Universal neural functionals can be applied to any architecture, while appropriately handling its permutation symmetries.
Want to optimize/edit/transform neural net weights using another neural net? Universal neural functionals can be applied to any architecture, while appropriately handling its permutation symmetries.
ALOHA 2 is here! 🤖 aloha-2.github.io The upgraded hardware has: * More durability * Greater fine-grained control * Lower stress on operator All off-the-shelf + open-source.
ALOHA 2 is here! 🤖 aloha-2.github.io The upgraded hardware has: * More durability * Greater fine-grained control * Lower stress on operator All off-the-shelf + open-source.
Soumith Chintala @soumithchintala
185K Followers 871 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.Sergey Levine @svlevine
79K Followers 122 Following Associate Professor at UC Berkeley Co-founder, Physical IntelligenceEric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pJia-Bin Huang @jbhuang0604
51K Followers 285 Following Associate Professor @umdcs; Part-time Research Scientist @Meta. I like pixels.Kyunghyun Cho @kchonyc
60K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistRosanne Liu @savvyRL
32K Followers 965 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDRKevin Patrick Murphy @sirbayes
42K Followers 328 Following Research Scientist at Google Brain / Deepmind. Interested in Bayesian Machine Learning.Dan Roy @roydanroy
45K Followers 2K Following Research Director, @VectorInst. Canada CIFAR AI Chair. Associate Professor of Stats/CS @UofT. I study machine learning and AI, emphasis on theory.Matthias Niessner @MattNiessner
31K Followers 162 Following Professor for Visual Computing & Artificial Intelligence @TU_Muenchen Co-Founder @synthesiaIOSasha Rush @srush_nlp
51K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzKarol Hausman @hausman_k
22K Followers 141 Following @Physical_int ex: researcher @GoogleAI/@DeepMind, adj. Prof. @Stanford. Into robots, AI, NBA, philosophy, soccer and almond croissants. 🇵🇱🇺🇸Oriol Vinyals @OriolVinyalsML
166K Followers 82 Following VP of Research & Deep Learning Lead, Google DeepMind. Gemini co-lead. Past: AlphaStar, AlphaFold, AlphaCode, WaveNet, seq2seq, distillation, TF.Behnam Neyshabur @bneyshabur
18K Followers 689 Following Senior Staff Research Scientist @GoogleDeepMind, Interested in reasoning w. LLMs, traveling & backpackingAnimesh Garg @animesh_garg
21K Followers 1K Following Foundation Models for Generalizable Autonomy. Assistant Professor in AI Robotics @GeorgiaTech + @NvidiaAI. prev @Stanford @berkeley_ai @UofTCompSciSara Hooker @sarahookr
39K Followers 7K Following I lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.Natasha Jaques @natashajaques
25K Followers 1K Following Senior Research Scientist at @GoogleAI and Assistant Professor @uwcse. Social Reinforcement Learning in multi-agent and human-AI interactions. PhD from @MIT.Eugene Vinitsky @EugeneVinitsky
13K Followers 2K Following Anti-cynic. Artificial narrow intelligence. Autonomous vehicles, multi-agent learning, and transportation. RS at Apple, Asst. Prof at @nyutandon. He/him.Ferenc Huszár @fhuszar
40K Followers 1K Following Secular Bayesian. Associate Professor in Machine Learning @Cambridge_CL. Talent aficionado at https://t.co/RbJkoLguey Alum of @Twitter, Magic Pony and @BaldertonThomas G. Dietterich @tdietterich
50K Followers 500 Following Distinguished Professor (Emeritus), Oregon State Univ.; Former President, Assoc. for the Adv. of Artificial Intelligence; Robust AI & Comput. SustainabilityDataQu @DataQuChile
131 Followers 484 Following We are a Machine Learning, AI, and Software Development company based in Santiago Chile and Toronto Canada. Building the tomorrow solutions today!Johnyrace @johnyrace52162
10 Followers 511 FollowingWenqian Ye @wy2029
4 Followers 64 FollowingKashu Yamazaki @KashuYamaz2127
23 Followers 48 Following CMU @LTIatCMU Multimodal AI / Embodied AI / AIxRoboticsChewbacca @KashyykWookiee
22 Followers 342 FollowingShiladitya Biswas @shiladitya997
3 Followers 169 FollowingI مشاعل ابوش.. @Mabushrara
400 Followers 1K Following دكتوراة في #علوم_الحاسب و باحثة في #الذكاء_الاصطناعي و #تعلم_الآلة و #التعلم_العميق | اكاديمية في #KKU (حساب شخصي)Sanjit Singh Dang, Ph.. @sanjit66
2K Followers 2K Following Chairman @ufirstcapital. Ex-Intel Capital. 1 Exit/Year (Palantir, Pinterest,DocuSign,BodyLabs (Amazon),Voke(Intel)). Fastest Engr PhD at U of Illinois systemBosung Kim @bosungkim17
9 Followers 79 Following PhD student @ucsandiego @uscd_cse natural language processing, knowledge extraction from LLMs, and text-to-image generation modelsScare Wager @ScareWager
8 Followers 346 Following I am a comedian Please Follow Me On My Twitter account 🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏Smith Winston @SmithWinst13560
2 Followers 102 Following###paric*** @_____rich______
333 Followers 3K Following1sdnaw47uwdsyehggd @1sdnaw47uw88651
0 Followers 120 FollowingMultimodal @Multimodal14
13 Followers 149 FollowingEg Beshoy Nady(Boćka.. @EngBeshoyNady
176 Followers 3K Following i am cypersecurity hackaghathon & ui/ux designer & drafts man & (not)civil engineerpixcleaner @pixcleaner
19 Followers 77 Following 🚀 PixCleaner, Create Stunning Visuals effects using AIJinyu Xie @xjygr08
11 Followers 125 Following I write Google Search Ranking algorithms. Former Matlab control group developer. PhD in Control, Artificial PancreasIEEE CSS TC for Mfg. .. @IEEECSS_TC_MARC
2 Followers 36 Following The Official Account of the IEEE Control Systems Society (CSS) Technical Committee for Manufacturing Automation and Robotics Control (TC-MARC)tkpon @tkmonkey
81 Followers 239 FollowingDillonXYZ @Dillion03389333
2K Followers 3K Following Quantum computing | Science&Technology|#Bitcoin |#ai #dev |Blockchain , #cat❤️#mining . 🇳🇬🇦🇪🇺🇸 #NicolaTesla |#satoshi. @nvidia building.ganzhiruyi @ganzhiruyi
0 Followers 15 FollowingMartin Kukla @martin_kukla
106 Followers 449 Following Deep Learning practitioner | Currently, LLMs for music understanding and generation @ TikTok | ex-Microsoft ResearchTasour @TasourR
26 Followers 120 Following Error code: 0xF2024 (Lost in the virtual world). Backup failed. All data lost.Haeji Jung @haejiness_ai
33 Followers 97 Following 👩🎓M.S. student. Looking for Ph.D. position/ 💻Studying AI / 🏫CSE, Korea University / ❤️Multimodal(Vision-Language), Multiligual LM, Representation LearningPünhan Pənahov @punhanpanahovdm
22 Followers 522 Following Reason why I am active on X to recover my 2nd LinkedIn profile.For contact,call +994 504916322 Whatsapp Telegram,706282129 Signal https://t.co/kDHuHc46o2Joey @him_joey
97 Followers 770 FollowingChelsea Zou @ZouChelsea
2 Followers 129 FollowingRon Krasniqi @Ous3n
79 Followers 895 Following Try to do a thing and try to do it well. Founder and CTO @AdScribeanurag sista @SistaAnura43679
1 Followers 71 FollowingZifeng Zhou @mr_cena_nyc
12 Followers 63 FollowingEmilie Dufour (ælle).. @_emiliedufour
981 Followers 3K Following Psychiatrist, trans woman. Researcher in epigenetic, neuroendocrinology & cognitive in psychiatry. Cofounder CUMP de Paris. 🩷 🏳️🌈 🇨🇵 🇪🇺Yuliya @mjulcik
1 Followers 62 Followingfer ~ @linuxdasilvajr
655 Followers 881 Following ☕ | 19y | machine learning and low level programmingWhisperAiML @whisperaiml
4 Followers 140 Following 🤖 Head researcher and Hacker of #LLM at 🔗https://t.co/mIWzqALZf1 building bespoke Ai + B2B appsTianshi Gao @tianshig
39 Followers 319 FollowingShunFunaki / アシ�.. @bc_shun0904
1K Followers 928 Following ReAlice株式会社CEO(https://t.co/nqZ5PxdrvD)/AI SaaS「アシストーク」/受発注の自動化も出来ます/取引プロセスの標準化を目指しEDI開発Soumith Chintala @soumithchintala
185K Followers 871 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.Sergey Levine @svlevine
79K Followers 122 Following Associate Professor at UC Berkeley Co-founder, Physical IntelligenceEric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pKyunghyun Cho @kchonyc
60K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | PianistNeurIPS Conference @NeurIPSConf
111K Followers 35 Following New Orleans, Dec 10-16, 23. https://t.co/ga8aOw615g Tweets to this account are not monitored. Please send feedback to [email protected].Kevin Patrick Murphy @sirbayes
42K Followers 328 Following Research Scientist at Google Brain / Deepmind. Interested in Bayesian Machine Learning.Matthias Niessner @MattNiessner
31K Followers 162 Following Professor for Visual Computing & Artificial Intelligence @TU_Muenchen Co-Founder @synthesiaIOSasha Rush @srush_nlp
51K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzKarol Hausman @hausman_k
22K Followers 141 Following @Physical_int ex: researcher @GoogleAI/@DeepMind, adj. Prof. @Stanford. Into robots, AI, NBA, philosophy, soccer and almond croissants. 🇵🇱🇺🇸Oriol Vinyals @OriolVinyalsML
166K Followers 82 Following VP of Research & Deep Learning Lead, Google DeepMind. Gemini co-lead. Past: AlphaStar, AlphaFold, AlphaCode, WaveNet, seq2seq, distillation, TF.Animesh Garg @animesh_garg
21K Followers 1K Following Foundation Models for Generalizable Autonomy. Assistant Professor in AI Robotics @GeorgiaTech + @NvidiaAI. prev @Stanford @berkeley_ai @UofTCompSciFerenc Huszár @fhuszar
40K Followers 1K Following Secular Bayesian. Associate Professor in Machine Learning @Cambridge_CL. Talent aficionado at https://t.co/RbJkoLguey Alum of @Twitter, Magic Pony and @BaldertonThomas G. Dietterich @tdietterich
50K Followers 500 Following Distinguished Professor (Emeritus), Oregon State Univ.; Former President, Assoc. for the Adv. of Artificial Intelligence; Robust AI & Comput. SustainabilityZachary Lipton @zacharylipton
59K Followers 2K Following Professor: CMU/@acmi_lab, CTO / CSO: @AbridgeHQ, Creator: @d2l_ai & https://t.co/QQt98VNLUp, Relapsing 🎷Danijar Hafner @danijarh
14K Followers 867 Following Building AI that makes autonomous decisions using world models, artificial curiosity, and temporal abstraction @DeepMindShane Gu @shaneguML
28K Followers 1K Following Research Scientist & Manager @GoogleDeepMind Tokyo/MTV. ex: @GoogleAI Brain, @OpenAI. (JP: @shanegJP)Christopher Manning @chrmanning
126K Followers 114 Following Director, @StanfordAILab. Assoc. Director, @StanfordHAI. Founder, @stanfordnlp. Prof. CS & Linguistics, @Stanford. IP @aixventureshq. 🇦🇺 Do #NLProc & #AI. 👋Jacob Andreas @jacobandreas
13K Followers 955 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJwKarl Pertsch @KarlPertsch
1K Followers 206 Following Robot Foundation Models @ UC Berkeley & Stanford | Postdoc w/ Sergey Levine & Chelsea Finn | Prev. Intern @ Google Brain, Meta AI | PhD @ USC.Adnan Esmail @adnan_esm
368 Followers 306 Following Co-Founder @physical_int | Former SVP Engineering @anduriltech, Hardware Technologies @TeslaAshlee Vance @ashleevance
145K Followers 3K Following Writer at Bloomberg. 2X NYT best-seller. Emmy-nominated host+writer of Hello World. Doc producer @HBO. NYT, El Reg alum. My new book https://t.co/12lAgpqoYoLerrel Pinto @LerrelPinto
5K Followers 181 Following Assistant Professor of CS @nyuniversity. I like robots!Alex Kendall @alexgkendall
10K Followers 588 Following CEO at @wayve_ai teaching cars how to drive with machine learning. 🇳🇿Michael Carbin @mcarbin
3K Followers 371 Following Associate Professor in EECS at @MIT | Founding Advisor at @mosaicml | Programming Systems | Neural Networks | Approximate ComputingKaien Yang @kaien_yang
271 Followers 111 Following Math + CS @Stanford; excited about AI, robotics, and autonomy; IRIS Lab @StanfordAILab 🌲Jim Fan @DrJimFan
228K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.noahdgoodman @noahdgoodman
2K Followers 108 Following Professor of natural and artificial intelligence @Stanford. Research Scientist at @GoogleDeepMind. (@StanfordNLP @StanfordAILab etc)Dora Demszky @ddemszky
1K Followers 190 Following Assistant Professor @StanfordEd researching how language technology can empower teachers.Margaret Guo @MargaretGuo3
18 Followers 112 FollowingDistributed AI Resear.. @DAIRInstitute
23K Followers 401 Following AI is not inevitable. We DAIR to imagine, build & use AI deliberately. Follow us on Mastodon at @[email protected]Russell Wald @russellwald
1K Followers 604 Following Deputy Director @StanfordHAI, Steering Committee @indexingai. Passionate about societal implications of tech and governance of AI.Melanie Mitchell @MelMitchell1
44K Followers 653 Following Professor, Santa Fe Institute. More thoughts at https://t.co/nC43NHRozX.Yangqing Jia @jiayq
12K Followers 262 Following Founder @leptonai. @UCBerkeley alumni. ex @google & @facebook. ex vp @AlibabaGroup. Open source work on caffe, @pytorch, @tensorflow, & @onnxai.Henny Admoni @hadmoni
2K Followers 435 Following Associate Professor, Robotics Institute, Carnegie Mellon Univ. I make robots that help people live more independent, happier lives. She/her.Jitendra MALIK @JitendraMalikCV
4K Followers 0 FollowingAditi Raghunathan @AdtRaghunathan
1K Followers 18 Following Assistant professor at CMU @SCSatCMU @CSDatCMU | Machine learningWenxuan Zhou @Wenxuan_Zhou
2K Followers 250 Following Research Scientist at @Meta GenAI; Ph.D. in Robotics @CarnegieMellon; Former Research intern at Google @DeepMindZipeng Fu @zipengfu
12K Followers 1K Following Stanford AI & Robotics PhD @StanfordAILab | Creator of Mobile ALOHA, Robot Parkour | Past: Google DeepMind, CMU, UCLAArchit Sharma @archit_sharma97
4K Followers 340 Following Final-year CS PhD student @Stanford. Previously, AI Resident @Google Brain, undergraduate @IITKanpur, research intern @MILAMontreal.Davis Blalock @davisblalock
12K Followers 164 Following Research scientist + first hire @MosaicML. @MIT PhD. I write + retweet threads about machine learning papers. Paper summaries newsletter: https://t.co/xX7NIpsIVZemily mcmilin @micmylin
332 Followers 558 Following Research Scientist at Meta and Independent Researcher focusing on Causal Inference & Language Modeling.Siddharth Karamcheti @siddkaramcheti
3K Followers 794 Following PhD student @stanfordnlp & @StanfordAILab. I like language, robots, and people. ML/Robotics Intern @ToyotaResearch.Oier Mees @oier_mees
1K Followers 224 Following Postdoc at @berkeley_ai. PhD @UniFreiburg. Prev. intern @NVIDIAAI. Research on robotics, language, computer vision, MLAndreea Bobu @andreea7b
1K Followers 396 Following Research Scientist at BDAII and incoming Assistant Professor @MIT, working at the intersection of machine learning, robotics, and human-robot interaction.Anne Collins @Anne_On_Tw
1K Followers 200 FollowingLucy Shi @lucy_x_shi
1K Followers 528 Following Student researcher at Stanford. Working on robot learning and multimodal learning. Interested in robots, rockets, and humans.Diyi Yang @Diyi_Yang
14K Followers 2K Following Assistant Professor @Stanford CS @StanfordNLP @StanfordAILab. Formerly @GeorgiaTech. Computational Social Science & NLPJoelle Pineau @jpineau1
10K Followers 350 Following AI researcher. VP AI Research (FAIR), @AIatMeta. Professor of Computer Science, @mcgillu. Core academic member, @Mila_QuebecTianhe Yu @TianheYu
748 Followers 147 Following Research Scientist @DeepMind @GoogleAI. PhD from @StanfordAILab.Hao Su Lab @HaoSuLabUCSD
2K Followers 206 Following Researching at the frontier of AI on topics of Computer Vision, Computer Graphics, Robotics, Embodied AI, and Reinforcement Learning @UCSanDiego @haosu_twitrAakanksha Chowdhery @achowdhery
7K Followers 3K Following LLMs @ Google DeepMind :: PaLM, Gemini // Previously @MSFTResearch, @Stanford, @Princeton // views my own and subject to changeCharlie Snell @sea_snell
4K Followers 5K Following PhD @berkeley_ai & student researcher @GoogleDeepMind. My friend told me to tweet more. I stare at my computer a lot and make thingsJonathan Grantham @jgrantham1974
260 Followers 309 Following Life in the fast lane is better with a passenger. Fan of music, language, creating, teaching and things that combine those things.Vertaix® @Vertaix_
1K Followers 33 Following Research lab @Princeton led by @adjiboussodieng. We work at the intersection of artificial intelligence (AI) and the natural sciences.Dimitris Tsipras @tsiprasd
2K Followers 142 FollowingOlivia Lee @olivia_y_lee
38 Followers 157 Following BS SymSys + MS CS @Stanford, researcher @StanfordAILab (IRIS Lab). Interested in reinforcement learning, robotics, and computer vision.Chi Jin @chijinML
2K Followers 185 Following Assistant Professor @Princeton. Researcher on theoretical foundations of machine learning, reinforcement learning, games and optimization.Sara Beery @sarameghanbeery
11K Followers 3K Following Research on computer vision and the environment 🌍 Asst Prof at @MIT_CSAIL #QueerInAI 🏳️🌈 sarabeery on threads @[email protected]@chelseabfinn @tonyzzhao Truly impressive. Congrats to the entire team!
@chelseabfinn is already one of the top AI researchers in the world but I’m sure she’ll be a truly iconic figure in the next few years. With DPO, ACT/ALOHA, etc she and her lab are crushing it.
It is only rarely that, after reading a research paper, I feel like giving the authors a standing ovation. But I felt that way after finishing Direct Preference Optimization (DPO) by @rm_rafailov @archit_sharma97 @ericmitchellai @StefanoErmon @chrmanning and @chelseabfinn. This…
It is only rarely that, after reading a research paper, I feel like giving the authors a standing ovation. But I felt that way after finishing Direct Preference Optimization (DPO) by @rm_rafailov @archit_sharma97 @ericmitchellai @StefanoErmon @chrmanning and @chelseabfinn. This…
Looking for a #Robot housekeeper? Meet #MobileALOHA, the future at your fingertips! Researchers @zipengfu, @tonyzzhao, & @chelseabfinn from @StanfordAILab have built a robot that cooks, cleans, & even calls elevators. Details 👇🏻 #AI #Robotics #Stanford dailyai.com/2024/01/mobile…
Interested in helping to organize @NeurIPSConf 2024? Let us know here: docs.google.com/forms/u/1/d/e/…
Congrats to @sanmikoyejo for being awarded a best paper award @NeurIPSConf !!!👏🏿👏🏿👏🏿
**Test of Time** Distributed Representations of Words and Phrases and their Compositionality **Outstanding Main Track Papers** Privacy Auditing with One (1) Training Run Are Emergent Abilities of Large Language Models a Mirage?
Now accepted at #AAAI24. I started single author, indie research as a ~jr SWE, recently transitioned from hardware engineering. Learned so much along the way, with help from MLC's @savvyRL & @jasonyo, Cohere4AI's @oohaijen & @sarahookr, HF's @SashaMTL and anon peers. Grateful.
Can causal inference help detect hallucinations? arxiv.org/abs/2210.00131 shows how task specification induces latent selection bias at inference time. We exploit to detect with 84% accuracy when LLMs (RoBERTa and GPT 3.5) are hallucinating pronouns on Winogender set. In 6 steps:
Really proud of my first paper 🗞️ coming out of a college research project! We create a SOTA membership inference attack on language models and show the importance of second-order loss curvature info for membership determination. Read my PI @SethInternet's 🧵for more!
🚨 New Paper appearing in @emnlpmeeting '23 on detecting if a passage x appears in the training data of a large language model. Our method MoPe works by perturbing the model and measuring the resulting drop in the log-likelihood:
🚨 New Paper appearing in @emnlpmeeting '23 on detecting if a passage x appears in the training data of a large language model. Our method MoPe works by perturbing the model and measuring the resulting drop in the log-likelihood:
Up first for our final day of #ODSCWest, @chelseabfinn is here to discuss how to fix neural networks when they mess things up.
Excited to release Zephyr-7b-beta 🪁 ! It pushes our recipe to new heights & tops 10x larger models 💪 📝 Technical report: huggingface.co/papers/2310.16… 🤗Model: huggingface.co/HuggingFaceH4/… ⚔️Evaluate it against 10+ LLMs in the @lmsysorg arena: arena.lmsys.org Details in the 🧵
Excited to announced Contrastive Preference Learning (CPL), a simple RL-free method for RLHF that works with arbitrary MDPs and off-policy data. arXiv: arxiv.org/abs/2310.13639 With @rm_rafailov @harshit_sikchi @chelseabfinn @scottniekum W. Brad Knox @DorsaSadigh A thread🧵👇
RLHF is powerful; it lets us fine-tune LLMs to be more useful. What if we could do RLHF… without fine-tuning??? Excited to share Emulated Fine-Tuning (EFT)! EFT lets us “emulate” what we would have gotten if we did RLHF on a new model, without actually doing the RLHF!
Stanford CS graduate students are running an application support program for diversity students (broadly defined); if you are applying to our CS PhD program, we'll give one round of feedback on your application. SPACE IS LIMITED. APPLY BY OCTOBER 27: Link: tinyurl.com/3x5ke5uz
Kids love ALOHA🏖️, robot dog, and more at @chelseabfinn 's lab! cc their robotics teacher 🧑🏫 @lucy_x_shi @zipengfu
We then did another round of fine-tuning with the awesome DPO algorithm from @rm_rafailov @archit_sharma97 @StefanoErmon @ericmitchellai @chrmanning @chelseabfinn We found DPO to be far, far more stable than PPO - go check out their paper to learn more! huggingface.co/papers/2305.18…
I'll be speaking @WiDS_Worldwide about my work building speech recognition for Kiswahili and on a panel discussing #LLMs alongside @_KarenHao, @chelseabfinn and moderated by @margootjeg.
Hungry? Let our robot twirl your spaghetti for you! 🍝🤖 Introducing VAPORS: Visual Action Planning OveR Sequences, a framework for long-horizon food acquisition. Project Page: sites.google.com/view/vaporsbot Paper: arxiv.org/abs/2309.05197 To appear at @corl_conf 1/11🧵
Woah! Quadruped Parkour!
Introduce our #CoRL2023 (Oral) project: "Robot Parkour Learning" Using vision, our robots can climb over high obstacles, leap over large gaps, crawl beneath low barriers, squeeze through thin slits, and run. All done by one neural network running onboard. And it's open-source!
How do you make two robot arms work together seamlessly in complex tasks? Introducing BUDS👯♀️: BimanUal Dexterity from Stabilization, a system for dexterous bimanual manipulation tasks! Appearing at @corl_conf ‘23. 🧵👇(1/6)