François Fleuret @francoisfleuret
Prof. @Unige_en, Adjunct Prof. @EPFL_en, Research Fellow @idiap_ch, co-founder @nc_shape. AI and machine learning since 1994. I like reality. fleuret.org/francois Switzerland Joined December 2009-
Tweets17K
-
Followers29K
-
Following476
-
Likes46K
Actually, my duo of risotto turned okay!
Actually, my duo of risotto turned okay! https://t.co/j2akuzDoYI
I'll die on this hill: Risotto is the least photogenic dish by a mile.
Is it a polemic statement? "An LLM can be seen as a knowledge base, equipped with sophisticated matching rules able to deal with synonymy and verb / actions / adjectives roles, and the ability--to some extent--to templatize and generalize statements."
My followers are better than your followers.
My followers are better than your followers.
This code computes Y[n,h,t,:] = Q[n,h,t,:] \sum_{s<=t} K[n,h,s,:].t() V[n,h,s,:] in T log2 T, and memory O(SD+TD+CD+TC). Compiling it gives a x2 but it crashes after a few iterations due to a dynamo cache error. Is there a way to rewrite it to make it work? @PyTorch
This code computes Y[n,h,t,:] = Q[n,h,t,:] \sum_{s<=t} K[n,h,s,:].t() V[n,h,s,:] in T log2 T, and memory O(SD+TD+CD+TC). Compiling it gives a x2 but it crashes after a few iterations due to a dynamo cache error. Is there a way to rewrite it to make it work? @PyTorch https://t.co/QcaYbsd3va
Are there best practices when it comes to compiling pytorch code with loops? It seems a bit so-so no?
Are there best practices when it comes to compiling pytorch code with loops? It seems a bit so-so no?
Wat? [2024-04-26 17:49:06,165] torch._dynamo.convert_frame: [WARNING] torch._dynamo hit config.cache_size_limit (8)
Is there a simple triton example somewhere?
Wow.
There is a certain sadness in beautifully optimizing a piece of PyTorch while knowing it will never come even close to an adequate cuda kernel.
It's time to focus on devising models made of parts trained to be re-combinable.
It's time to focus on devising models made of parts trained to be re-combinable.
Sebastian Raschka @rasbt
267K Followers 906 Following Machine learning & AI researcher writing at https://t.co/A0tXWzG1p5. LLM research engineer @LightningAI. Previously stats professor at UW-Madison.Alfredo Canziani @alfcnz
86K Followers 268 Following Musician, math lover, cook, dancer, 🏳️🌈, and an ass prof of Computer Science at New York UniversityLucas Beyer (bl16) @giffmana
56K Followers 444 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]Kosta Derpanis @CSProfKGD
48K Followers 197 Following #CS Associate Prof @YorkUniversity, #ComputerVision Scientist Samsung #AI, @VectorInst Faculty Affiliate, TPAMI AE, #CVPR2024/#ECCV2024 Publicity Co-chairJeremy Howard @jeremyphoward
222K Followers 5K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Hon Professor: @UQSchoolITEE ; Digital Fellow: @StanfordSoumith Chintala @soumithchintala
186K Followers 877 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.Dmytro Mishkin 🇺�.. @ducha_aiki
18K Followers 591 Following Marrying classical CV and Deep Learning. I do things, which work, rather than being novel, but not working.Kevin Patrick Murphy @sirbayes
42K Followers 334 Following Research Scientist at Google Brain / Deepmind. Interested in Bayesian Machine Learning.Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Michael Bronstein @mmbronstein
43K Followers 4K Following #DeepMind Professor of #AI @UniofOxford / Fellow @ExeterCollegeOx / ML Lead @ProjectCETI / https://t.co/kZpGpDzYeVHorace He @cHHillee
23K Followers 449 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemaleFrank Nielsen @FrnkNlsn
23K Followers 1K Following Machine Learning & AI, Information Sciences & Information Geometry, Distances & Statistical models, HPC. "Geometry defines the architecture of spaces" @SonyCSLEric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pDan Roy @roydanroy
45K Followers 2K Following ML / AI researcher, emphasis on theory. Research Director and Canada CIFAR AI Chair, @VectorInst Professor, @UofT (Statistics/CS)Rosanne Liu @savvyRL
33K Followers 966 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDRRoss Wightman @wightmanr
18K Followers 1K Following Computer Vision @ 🤗. Ex head of Software, Firmware Engineering at a Canadian 🦄. Currently building ML, AI systems or investing in startups that do it better.Thomas G. Dietterich @tdietterich
50K Followers 505 Following Distinguished Professor (Emeritus), Oregon State Univ.; Former President, Assoc. for the Adv. of Artificial Intelligence; Robust AI & Comput. Sustainabilityyobibyte @y0b1byte
15K Followers 2K Following Kurin ViTaly, senior research scientist @IsomorphicLabs, ML PhD from @UniofOxford on RL, Multitask learning & GraphsKyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Dylan Dalton @00dylan_dalt00
6 Followers 41 Following Structural Bioinformatics and Network Biology Group - IRBAlex Mocanu @mocanu_al
0 Followers 9 FollowingLuckyPants 🕊️ @a2prYXNp
10 Followers 185 FollowingMichael DeMaria @demaria_michael
365 Followers 2K Following Building something new | Previously at Serent Capital, Union Square, & MoelisJ @lettucelettucel
209 Followers 600 Following 🍏 AR / VR Graphics building doohickies and escaping their worldly formMatt McClean @matthewmcclean
615 Followers 4K Following Kiwi bloke. Into Cloud Computing, DevOps and Agile/Lean for a living and Philosophy for the soul. Solutions Architect at Amazon Web ServicesAntiDeepState @RockerGear73415
10 Followers 245 Following Antiglobalista. Antitranshumanista. Prohumanista. Patriota. Si no luchamos por la Libertad seremos eternamente esclavos. 3ra cuenta creadaRiccardo Musmeci @r_musmeci
233 Followers 355 Following Senior Computer Vision Engineer @EnelGroupIT. My works: - https://t.co/7lT5a8QG3L - https://t.co/ceJS0DTgetnondestructiv @NonDestructiv
1K Followers 2K Following Combining principles of archaeological prospection & documentation with innovative tech to revolutionize the study and preservation of heritage #archaeologymike greenberg @mgreenb57
2 Followers 36 Following traveler | stock trader | rationally rounds π to 3.14159 | dislikes the Shift keyAndreas Ramos @Andreas_Ramos
2K Followers 325 Following Adjunct Professor at Omnes, CSTU, DMA-NC | Author of 22+ books on digital marketing | 30+ years in Silicon Valley | https://t.co/y1GR0n1AaN | Universität HeidelbergDr. Mohamed Gamal @DrMohamedGamal2
14 Followers 258 FollowingTakyon∞ @takyon236
5K Followers 870 Following AI slave | Artist | @deforum_art dev | I can do impossible things | 🇫🇷Maximo Kirchner 2027 .. @BokitaMiPasion2
22 Followers 134 FollowingChaitanya @chaitanyakcs
31 Followers 60 FollowingPranab Sahoo @pranabkumar_
250 Followers 2K Following IIT |Compute Science| Machine learning | Deep learning | Computer vision | Medical image analysis | If you are a radiologist and want to work just message meDavid Rduch @davidarduch
141 Followers 922 Followingaltooptimo.eth @AltoOptimo
62 Followers 418 FollowingLa @cydoniabase
7 Followers 1K FollowingAndreas @AndreasThinks
1K Followers 5K Following Data science, crime and AI in government person | he/him | now mostly @[email protected] or andreasthinks@bsky. PersoVitor @Vitorjsa
58 Followers 1K FollowingThomasROBERTparis5636.. @ThomasROBERT_75
0 Followers 76 FollowingTeerapat Chaiwachiras.. @chaiwachirasak
1 Followers 48 Followingsebastian @sebastianmxnt
449 Followers 151 Following ml engineer. forever voyaging through strange seas of thought.Quant Hustle @QuantHustle
0 Followers 3K FollowingAntonio Mallia @antonio_mallia
1K Followers 2K Following Senior Research Scientist @ Pinecone Previously, Applied Scientist @ Amazon & PhD @ New York UniversityAyush Paliwal @DiracManifold
17 Followers 86 Following PhD student, holographic inverse-problems, signal processing, deep learning, and sometimes, quantum field theory.ItsukiMikoto @mikoto_itsuki
17 Followers 209 Following Sit still .... I am trying to take a picture.012 @dau_fu001
87 Followers 637 Followingサッカーインフ.. @footballinflu
574 Followers 278 Following 海外でプレーする日本人サッカー選手の情報や、海外の反応をブログでまとめています。ツイッターでは選手の小ネタや豆情報なんかをつぶやいていきます。Sebastian Raschka @rasbt
267K Followers 906 Following Machine learning & AI researcher writing at https://t.co/A0tXWzG1p5. LLM research engineer @LightningAI. Previously stats professor at UW-Madison.Alfredo Canziani @alfcnz
86K Followers 268 Following Musician, math lover, cook, dancer, 🏳️🌈, and an ass prof of Computer Science at New York UniversityLucas Beyer (bl16) @giffmana
56K Followers 444 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]Kosta Derpanis @CSProfKGD
48K Followers 197 Following #CS Associate Prof @YorkUniversity, #ComputerVision Scientist Samsung #AI, @VectorInst Faculty Affiliate, TPAMI AE, #CVPR2024/#ECCV2024 Publicity Co-chairJeremy Howard @jeremyphoward
222K Followers 5K Following 🇦🇺 Co-founder: @AnswerDotAI & @FastDotAI ; Hon Professor: @UQSchoolITEE ; Digital Fellow: @StanfordSoumith Chintala @soumithchintala
186K Followers 877 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.Clément Canonne @ccanonne_
31K Followers 928 Following Senior Lecturer @Sydney_Uni. Postdocs @IBMResearch, @Stanford; PhD @Columbia. Converts ☕ into puns: sometimes theorems. He/him. @[email protected]Dmytro Mishkin 🇺�.. @ducha_aiki
18K Followers 591 Following Marrying classical CV and Deep Learning. I do things, which work, rather than being novel, but not working.Kevin Patrick Murphy @sirbayes
42K Followers 334 Following Research Scientist at Google Brain / Deepmind. Interested in Bayesian Machine Learning.Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Michael Bronstein @mmbronstein
43K Followers 4K Following #DeepMind Professor of #AI @UniofOxford / Fellow @ExeterCollegeOx / ML Lead @ProjectCETI / https://t.co/kZpGpDzYeVHorace He @cHHillee
23K Followers 449 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemaleEric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0pDan Roy @roydanroy
45K Followers 2K Following ML / AI researcher, emphasis on theory. Research Director and Canada CIFAR AI Chair, @VectorInst Professor, @UofT (Statistics/CS)Ross Wightman @wightmanr
18K Followers 1K Following Computer Vision @ 🤗. Ex head of Software, Firmware Engineering at a Canadian 🦄. Currently building ML, AI systems or investing in startups that do it better.Ferenc Huszár @fhuszar
40K Followers 1K Following Secular Bayesian. Associate Professor in Machine Learning @Cambridge_CL. Talent aficionado at https://t.co/RbJkoLguey Alum of @Twitter, Magic Pony and @BaldertonSasha Rush @srush_nlp
52K Followers 464 Following Professor, Programmer in NYC. Cornell Tech, Hugging Face 🤗 https://t.co/cZl0wTfqGzNeurIPS Conference @NeurIPSConf
111K Followers 35 Following New Orleans, Dec 10-16, 23. https://t.co/ga8aOw615g Tweets to this account are not monitored. Please send feedback to [email protected].Justine Tunney @JustineTunney
33K Followers 272 Following I built a C library that lets you compile 12kb static binaries that run natively on Linux, Mac, Windows, FreeBSD, OpenBSD, NetBSD and BIOS using just GCC/Clang.OSINTtechnical @Osinttechnical
931K Followers 800 Following OSINT guy, PAI enjoyer, journalist @hntrbrkmedia, my views/freezing cold takes are my own. Standard spiel about not endorsing retweets, likes, and comments.AI Breakfast @AiBreakfast
167K Followers 209 Following The latest rumors and developments in the world of artificial intelligence. DM to include your AI project in the newsletter.Sharif Shameem @sharifshameem
53K Followers 3K Following founder @LexicaArt • in pursuit of good explanationsShane Legg @ShaneLegg
51K Followers 57 Following Co-founder and Chief AGI Scientist, Google DeepMindScientific Python @SciPyTip
202K Followers 18 Following Tweets about SciPy (Scientific Python) and related topics from @JohnDCook.Pawel Pachniewski @pwlot
5K Followers 1K Following Alien from the future aiming to enhance, extend & explore existence with AI.kyle @kzjh2008
164 Followers 2K Followingnev @apeoffire
584 Followers 47 FollowingSharada Mohanty @MeMohanty
1K Followers 998 Following CEO & Co-Founder @AICrowdHQ | previously @EPFL , @CERN , IIIT-Hyd | Wannabe Artist | ❤️s AI, Art and ScienceGroq Inc @GroqInc
45K Followers 468 Following Creator of the LPU™ Inference Engine, providing the fastest speed for AI applications, designed & engineered in N. America https://t.co/DsEqVAC5DpArthur Mensch @arthurmensch
40K Followers 872 Following Co-founder and CEO @MistralAI. Apply https://t.co/yHGRZAtjcxYaroslav Bulatov @yaroslavvb
6K Followers 699 Following ex-Google Brain, OpenAI, Meta Scholar: https://t.co/iVycFw5dSX New Blog: https://t.co/SLix8HqVeY Old Blog: https://t.co/Ur3GWKoOzyTrail of Bits @trailofbits
32K Followers 247 Following We help secure the world’s most targeted organizations and products. We combine security research with an attacker mentality to reduce risk and fortify code.Dimitri von Rütte @dvruette
710 Followers 171 Following Studies @ETH_en, Machine Learning @DeepJudgeAIMarc Andreessen 🇺�.. @pmarca
1.4M Followers 24K Following Techno-optimist. E/acc. Technology brother. Move Fast and Make Things. p(Doom) = 0; p(“1984”) = not 0.Aïda Elamrani @AidaElam
308 Followers 343 Following Philosophy of A.I. - Artificial Consciousness & Ethics of AI - Institut Jean Nicod, DEC, ENS-PSLHervé Jegou @hjegou
849 Followers 75 FollowingAlex Sablayrolles @alexsablay
1K Followers 879 Following Research Scientist, Mistral AI. Interested in LLMs, deep learning, fast nearest-neighbor search and privacy. ex: @Meta, @NYUniversity, @Polytechnique.Tri Dao @tri_dao
18K Followers 364 Following Incoming Asst. Prof @PrincetonCS, Chief Scientist @togethercompute. Machine learning & systems.the tiny corp @__tinygrad__
33K Followers 63 Following We make tinygrad. Our mission is to commoditize the petaflop.Abubakar Abid @abidlabs
12K Followers 1K Following Hind Rajab. 5 yrs old. She + 14,000 children killed by Israeli forces. PLEASE don't be silent. Take 5 min to call your reps and urge peace (link in bio)Danilo J. Rezende @DaniloJRezende
35K Followers 1K Following Director @ #DeepMind Building models to accelerate fundamental sciences Prev @EPFL IFT @Polytechnique @fisicaUSPAbhi Venigalla @abhi_venigalla
5K Followers 1K Following Researcher @Databricks. Former @MosaicML, @CerebrasSystems. Addicted to all things compute.Piotr Padlewski @PiotrPadlewski
1K Followers 319 Following Chief Meme Officer @ https://t.co/CtBrcKmliI, ex-Google Deepmind/Brain ZurichFrançois Charton @f_charton
2K Followers 20 Following AI for mathematics and theoretical physics FAIR, MetaMichael M. Pieler @MichaelMPieler
331 Followers 1K FollowingTorsten Hoefler 🇨�.. @thoefler
5K Followers 211 Following Professor @ETH_en, head of @spcl_eth, Chief Architect ML @cscsch researching large-scale #HPC and #AI systems and #Climate computing - youtube: https://t.co/dxrzSPIFVbAnthropic @AnthropicAI
261K Followers 26 Following We're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant Claude at https://t.co/aRbQ97uk4d.nisten @nisten
10K Followers 5K Following fullstack-dev democratizing intelligence @skunkworks_ai | 🦝.ai | prev https://t.co/68jAlAVBKR |clem 🤗 @ClementDelangue
91K Followers 5K Following Co-founder & CEO @HuggingFace 🤗, the open and collaborative platform for AI buildersHugging Face @huggingface
343K Followers 189 Following The AI community building the future. https://t.co/VkRPD0VKaZ #BlackLivesMatter #stopasianhatelooks like rasam saadam and thayir saadam 😳
I’m looking forward to the tens of thousands of PEFT’ed Llama-3 70B and 400B models with various new superpowers that will be created and released by the community.
@francoisfleuret We kindly ask the reviewer to take a closer look at the new experiments and update their score accordingly. (Pic credits: screenshot from a Google maps review of my cousin’s restaurant)
@francoisfleuret Tastes delicious, looks like a breached paddy field in minature
@francoisfleuret How would this fit into the interpretability picture that contains things like mesa-optimizers, world models, causal abstractions and sparse concept representations? To my over-enthusiastic interpretability eyes, this looks like a reductive description of all that LLMs encode.
@francoisfleuret In my head, this comes across as a simple/clunky mechanical heuristic being applied by the model. Rather than this more holistic and sparse thing that we see - maybe all I'm missing is an adjective.
François provides us all with a free learning resource! 'The Little Book of Deep Learning' 🤖 FREE PDF downloads! Thank you François 🙌
My deep learning course @unige_en is available on-line. 1000+ slides, ~20h of screen-casts. Full of examples in @PyTorch. fleuret.org/dlc/ And my "Little Book of Deep Learning" is available as a phone-formatted pdf (400k downloads!) fleuret.org/lbdl/
@francoisfleuret Looks very much like an Indian rice sambhar. Looks good 😄
@francoisfleuret Seems good/not polemical to me 🤷
Elizabeth Tsurkov is a PhD researcher at Princeton. She was kidnapped over a year ago by Kataib Hezbollah in Iraq. Yesterday, the flag of the sister organization of her kidnappers was raised at the Princeton protests.
@francoisfleuret first time i had it was at a take-out in lower manhattan. asparagus and chicken. it was superb! 😎
@francoisfleuret Unless its tomato risotto. That looks great
@francoisfleuret Even worse than huitlacoche or natto?
@JFPuget @francoisfleuret Clarification: a LLM samples outputs from a distribution of most probable continuations of its input text etc
@francoisfleuret Looks good!
@ducha_aiki @francoisfleuret put truffles on either - and I’m sold
@francoisfleuret What’s wrong with the aesthetic of risotto? (my last two, asparagus and pumpkin)