-
Tweets24
-
Followers888
-
Following2
-
Likes21
Testing LLMs (and prompts) like we test software: towardsdatascience.com/testing-large-… TL;DR: (1) You should, (2) How to test: specific properties, evaluate these with LLMs (perception is easier than generation), (3) What to test: get the LLM to help you figure it out.
Microsoft open-sources a new AI library that connects to open-source GPTs, not just OpenAI. github.com/microsoft/guid…
@sean_lynch We're just writing stuff WE would want to use, and I guess we probably count as 'real developers' :)
Also highly relevant: guidance from microsoft "Guidance programs allow you to interleave generation, prompting, and logical control" Also internally handles subtle but important tokenization-related issues, e.g. "token healing". github.com/microsoft/guid…
been reading the readme for github.com/microsoft/guid…, kind of galaxy brain tl;dr they made a whole prompt engineering language
Blog post: playing with Vicuna-13B, ChatGPT (3.5), MPT-7B-Chat on harder stuff medium.com/@marcotcr/expl… TL;DR: We think ChatGPT is still way ahead, but sometimes the extra control from open source models is worth it.
My intern is close to writing a paper, so I wrote her this blog post on writing (part 1 of 2): medium.com/@marcotcr/writ…
I never tweet, but here is a blog post I wrote for an intern, may be useful for others too... Part 1: medium.com/@marcotcr/comi… Part 2: medium.com/@marcotcr/orga…
@jacswork My guess is you mean LIME : ). I don't know exactly what you mean, but we have follow up work coming out soon!
@BecomingDataSci Twitter is too hard : )
@BecomingDataSci Would love to hear what went wrong if you are willing to share in detail. Would you email me at my handle @gmail.com?
@BecomingDataSci I can share a few additional text or tabular examples if you like, but they all require specific datasets. We have a ton.
@BecomingDataSci Which ones didn't work? The first three should work, so please let me know if there are bugs =]
"Why Should I Trust You?" Explaining the Predictions of Any Classifier. Promo video: youtube.com/watch?v=hUnRCx… #kdd2016 @guestrin @sameer_
@fmailhot Heh, sorry for opaqueness of my replies. Twitter is not really my thing. Feel free to email me further questions or comments: )
@fmailhot Good point about opaque features. If the classifier uses stopwords, LIME should reflect it, so I don't think LIME should remove it
@fmailhot Probably don't need LIME for that though, if it's only 5 tokens. Things change in a longer sentence (not even a long document).
@fmailhot That is true (only 32 data points), but you may still want to tease out the contribution of each token. e.g 'I do not like that.'
@fmailhot It works with documents of any size. We also just added support for tabular (numerical + categorical) data. Maybe images soon.
Great work from @marcotcr , @sameer_ on explaining any machine learning model (20 newsgroup, deep net). homes.cs.washington.edu/~marcotcr/blog… @guestrin
Percy Liang @percyliang
107K Followers 426 Following professor of computer science @Stanford @stanfordnlp, co-founder of @togethercompute, creator of https://t.co/7R5THVogW2, co-founder of @simile_ai, pianist
Jacob Andreas @jacobandreas
24K Followers 947 Following Teaching computers to read. Assoc. prof @MITEECS / @MIT_CSAIL / @NLP_MIT (he/him). https://t.co/5kCnXHjtlY https://t.co/2A3qF5vdJw
Sameer Singh @sameer_
7K Followers 2K Following Cofounder/CTO @SpiffyAI and Prof at @UCIrvine, works on reliable LLMs, explanations for AI+ML, safety for NLP, and debugging/evaluation.
Ofir Press @OfirPress
18K Followers 8K Following I push the AI frontier by building tough benchmarks with amazing people. SWE-bench, SWE-agent, SciCode, AlgoTune. Postdoc @Princeton. PhD @nlpnoah @UW.
Sherry Tongshuang Wu @tongshuangwu
6K Followers 1K Following Assist. Prof @SCSatCMU , CS PhD @uwcse. HCI+AI, map general-purpose models to specific use cases! prev. intern @MSFTResearch @GoogleAI @Apple. She/her.
𝙷𝚒𝚖𝚊 𝙻... @hima_lakkaraju
16K Followers 1K Following AI Professor @Harvard; Senior Staff Research Scientist @GoogleAI; @trustworthy_ml #AI #XAI; AI PhD from Stanford; Sloan/Kavli Fellow, MIT TR #35Under35
Pasquale Minervini @PMinervini
10K Followers 5K Following Research in ML/NLP at @EdinburghNLP (tenured faculty at @EdinburghUni), Co-Founder @Miniml_AI, @ELLISforEurope Scholar, https://t.co/5dUI3EFMmW
Christoph Molnar 🦋... @ChristophMolnar
35K Followers 969 Following Author of Interpretable Machine Learning https://t.co/gJKlTA2deP | Newsletter: https://t.co/6fQuMr8yI8
Xi Ye @xiye_nlp
3K Followers 428 Following I study NLP. Postdoc fellow @PrincetonPLI. CS PhD @UTAustin.
Sewon Min @sewon__min
16K Followers 889 Following Assistant professor @Berkeley_EECS @berkeley_ai || Research scientist at @allen_ai || PhD from @uwcse @uwnlp
Ahmad Beirami @abeirami
12K Followers 5K Following stealth // ex Gemini RL+Inference @GoogleDeepMind // Chat AI @AIatMeta // RL Agents @EA // ML+Information Theory @MIT+@Harvard+@GeorgiaTech
Kenneth Huang #HCOMP2... @windx0303
5K Followers 5K Following Running #HCOMP2026 - https://t.co/5AkZWflCzC I create systems that help users. Visit @CornellInfoSci; Associate Prof @ISTatPENNSTATE @PSUCrowdAILab. #HCI #NLProc
Amir Kiani @amirhkiani
2 Followers 184 Following
Riyadh Derbale @DerbaleRiyadh
2 Followers 52 Following
Sylvio Barbon Junior @sbarbonjr
172 Followers 176 Following Professor at University of Trieste working on machine learning, computer vision, and data mining.
Renan Rios Diniz @RenanRDiniz
92 Followers 83 Following
Abdulla Al Nimer @AbdullaNim66613
171 Followers 7K Following General Manager Banking Commercial Bank of Dubai United Arab Emirates
Santiago Cortés-Góm... @sancortes_95
355 Followers 1K Following Mathematician/engineer/AI researcher. @mldcmu/@SCSatCMU CS PhD student. Proud Colombian 🇨🇴. he/him
Tony Ojelel @fire_tony123
607 Followers 6K Following Experienced Software Engineer & Mechanical Engineer. Algorithms & Open source enthusiast. Proficient in multiple programming languages.
Stanley Nyadzayo @StanleyNyadzayo
183 Followers 112 Following PhD Researcher | Explainable AI & Trust in Black-Box Models, FinTech, Regulation technologies for Digital Transformation. Delivering professional services.
sojung_lee @sojung_lee99
0 Followers 88 Following
Nathan Benaich @nathanbenaich
71K Followers 35K Following solo member of superinvestment staff @airstreet @airstreetpress @stateofai @raais
Omar Usman @modanq
352 Followers 4K Following ER Doc and Informatician (Y93.C9) | Clinical/Informatics @ https://t.co/R27TOHLx5k | Medicine + Technology + Design | 📚 ربِّ زِدْنِي عِلْماً | #GoBlue
Ivan Bercovich @neversupervised
561 Followers 399 Following Independent Researcher / Terminal Bench, Partner @ ScOp VC
Shilpa Suresh @shilpa15397
136 Followers 951 Following Evals @Truveta | Ex: Harvard Med (BCH), @UMass_NLP. NLP for Health but not exclusively. History buff and coffee nut.
Krishna @krish240574
268 Followers 7K Following Founder at - https://t.co/nOMn0dzF8H Agentic AI teams for Advertising, Accounting, Management consulting, Private Equity, Manufacturing.
Bion @flesheatingemu
502 Followers 8K Following Futurist philosophy, molec neuro/immuno, pathophys, software eng, AI enjoyer Made an Apache/MIT `tree` util with tokens, lines, and module components
Bay Gross @baygross
3K Followers 677 Following VP Health at Microsoft AI // previously co-founder @cityblockhealth.
john🐍 @johnstuckey77
368 Followers 7K Following
Jasur Abdusattarov @jasurme7
2 Followers 210 Following In my 20s, having the courage to follow my heart and intuition. Building Malina AI
🔻Ilyes Emb @Ilyes_emb
1 Followers 155 Following
Mayank Daswani @mayankdaswani
230 Followers 474 Following Member of Technical Staff, Health@Microsoft AI. ex-Deepmind Health, ex-Google Research. Opinions my own.
Double ЯR @Mickey1is2Much
2 Followers 160 Following
Theareshaw @TheareshawfiiE
26 Followers 514 Following
Lingzhi Yuan @lingzhi_yuan
14 Followers 138 Following PhD in Computer Science at @UofMaryland, BEng from @ZJU_China, interested in Trustworthiness | Multi-modal AI | Multi-agent System
Stefan Heindorf @StefanHeindorf
213 Followers 730 Following Research Group Leader - Explainable Artificial Intelligence
Hamid Palangi @hamidpalangi
2K Followers 880 Following Staff Research Scientist @Google, Affiliate Associate Professor @UW, Former Principal Researcher @MSFTResearch
Pocket @PocketPriors
1K Followers 3K Following
Shaun Harvey @nuahsyevrah
2 Followers 277 Following
laurahibbe @recca_018
77 Followers 2K Following #BITCOIN 🥇+ #CRYPTO YOUTUBER !!🚀 my tweets are not financial advice | daily livestreams at🤑📊
Harry Mayne @HarryMayne5
417 Followers 1K Following Fellow at Truthful AI @OwainEvans_UK @uniofoxford
zkhani @zkhani7
2K Followers 3K Following
Josh Suresh @josh__suresh
23 Followers 274 Following
William Blanzeisky @willblanzeisky
185 Followers 595 Following Applied Scientist II @Microsoft | Ex- @HitachiEnergy - Ph.D in Computer Science @ml_labs_irl - 🇮🇩
Angus Nicolson @angusjnic
259 Followers 1K Following Postdoc at the Medical University of Innsbruck - Digital Cardiology Lab. Previously DPhil student at @UniofOxford in interpretable AI for medicine.
Ron Herardian @rherardi
71 Followers 290 Following Trusted Advisor | Architecture | Cybersecurity | GRC | AI Security | Fractional CTO and CISO
Vijay Khambe @vjkhambe
58 Followers 114 Following Principal AI Platform & LLM Infrastructure Engineer
s-miyawaki | Algomati... @catshun_
2K Followers 2K Following AI/ML/QA Engineer Algomatic のAXガバナンスセンターというところで『企業のAX推進を安全に加速』させています。 (著) 現場で活用するためのAIエージェント実践入門 https://t.co/qtNsQ8yYZr
Th D @thomdeck
1 Followers 83 Following
Ian Liu 劉以恆 @duckiesfloat
69 Followers 2K Following MS @BrownBiostats | Data Science Graduate & Classical Chinese Dancer @FTCNorthern | 🇺🇸🇹🇼
Paul Graham @paulg
3.3M Followers 791 FollowingYou might like
