Jonathan Pilault @J_Pilault
former intern @GoogleDeepMind PhD @Mila_Quebec Montreal Joined February 2010-
Tweets97
-
Followers171
-
Following483
-
Likes5
Hyped to share JaxPruner: a concise library for sparsity research. JaxPruner includes 10+ easy-to-modify baseline algorithms and provides integration with popular libraries like t5x, scenic, dopamine and fedjax. 1/7 Code: github.com/google-researc… Paper: arxiv.org/pdf/2304.14082…
Zyphra is pleased to announce Zamba-7B: - 7B Mamba/Attention hybrid - Competitive with Mistral-7B and Gemma-7B on only 1T fully open training tokens - Outperforms Llama-2 7B and OLMo-7B - All checkpoints across training to be released (Apache 2.0) - Achieved by 7 people, on 128…
Last week, I gave a talk at @Mila_Quebec. The talk should be of interest to anyone working on predictive models, particularly in latent space. In collab. with @MahanFathi @ClementGehring @J_Pilault @davidkanaa @pierrelux. See you at @iclr_conf in 🇦🇹! drive.google.com/file/d/1mQSXFa…
Course Correcting Koopman Representations Accepted at #ICLR2024! We identify problems with unrolling in imagination and propose an unconventional, simple, yet effective solution: periodically "𝒓𝒆𝒆𝒏𝒄𝒐𝒅𝒊𝒏𝒈" the latent. 📄 arxiv.org/abs/2310.15386 @GoogleDeepMind 1/🧵
My research group @kasl_ai is looking for interns! Applications are due in 2 weeks ***January 29***. The long-awaited form: forms.gle/iLU1uQAxZ2UKEN… Please share widely!!
@notnotrishi I like the SSM/hyena/Block State Transformers arxiv.org/pdf/2306.09539… arxiv.org/pdf/2302.10866… They remind me of Q-RNNs arxiv.org/abs/1611.01576 and play around with different parallelization ideas. I don't think transformers are that special and there are many equivalent…
Why not get the best of both worlds by combining SSMs and Transformers? Excited to share our work at #NeurIPS2023: "Block-State Transformers." BST hits new highs in long-range language modeling and LRA tasks. paper: arxiv.org/abs/2306.09539 1/
Tips for non-technical entrepreneurs goo.gl/ItgdM
Its 2012, Canadian eCommerce stuck in the 90's: marketdrum.com/its-2012-canad…
#Montreal should be the #innovation and #start-up gate keeper between Europe and the US. Wouldn't entering respective markets be easier?
33% of online shoppers in Canada leave their cart before check-out due to high shipping costs (emarketer). Free shipping is must in Canada
Customer Analytics Drive Customer Loyalty, not Loyalty Programs shar.es/g9rUx
YC-Funded Bushido: An App Store For The Web That Can Kickstart Your Side Projects via @TechCrunch techcrunch.com/2011/08/29/yc-…
How Discovery Will Drive Transactions via @TechCrunch techcrunch.com/2011/08/21/how…
Video: Free-Moving Kinect Used To Map Room And Objects In Detailed 3D via @TechCrunch techcrunch.com/2011/08/10/vid…
I strongly recommend this article: 57 Things I've Learned Founding 3 Tech Companies businessinsider.com/57-things-ive-… via @SAI
10 High Tech Gadgets From Overseas That Make It Look Like Americans Are Living In The Stone Age businessinsider.com/foreign-gadget… via @sai_tools
Feds Giving Engineers and Scientists $50K to Learn to Start Companies | Epicenter | Wired.com wired.com/epicenter/2011…
Janay Stroot @JanayStroo76326
0 Followers 87 Following
Amy Elena @elena_amy70949
97 Followers 5K Following
Harlo Vandervelden @HarloVande67287
66 Followers 5K Following
Mark Finnern @finnern
8K Followers 4K Following Innovation Catalyst | Cloud Success Engineer iPaaS @ Software AG | Future Salon Founder | Empowering Success | TEDx Speaker
UlaHelina @o289Sxi665VWf
2 Followers 274 Following
Pcd Marcio A de Fraga.. @DemocraciaSy
191 Followers 3K Following Pesquisador Virtual Márcio A de Fraga sobrevivente da paraplegia e da pós poliomielite Cid 10 G14 e da Cid 10 M 21.8 Pae de 3 filhos, divorciado e solteiro.
Lorilee Karangelen @LKarangele13486
47 Followers 5K Following
Laila Lalich @LailLalic
39 Followers 5K Following
Deele @Deele22902
199 Followers 5K Following
Eva Louise Marie Gabr.. @e681554349
9 Followers 3K Following
Linz @lin72h
182 Followers 4K Following Someday I'm gonna make great machines that fly. And me and my friends are gonna go flying together, into the forever and beautiful sky.
rico @b_rich_now
49 Followers 2K Following
zirui @zirui3
39 Followers 971 Following
George @georgejrjrjr
2K Followers 853 Following The timeline vibetimes pipeline to things still more strange and enticing.
Benji Smith @benji_smith
1K Followers 2K Following
Arian Khorasani 🦅 @Arian_Khorasani
187 Followers 746 Following AI Researcher working with @irinarish at @cerc_aai @Mila_Quebec @UMontreal Interested in AGI ( Augmented General Intelligence )
catid (e/acc) @MrCatid
3K Followers 643 Following Engineer at Juice Labs. Prior: Anduril, Oculus VR, Game Closure, MSEE@GATech
Linda Filyaw @lin_fily
75 Followers 5K Following
Hiedi Levick @HiediLevic56506
40 Followers 5K Following
Venessa Deforrest @VenessaDef3606
54 Followers 5K Following
Lisa Fuentes @lisa_fuen
47 Followers 5K Following
Mila-rose Duperclay @DuperclayM76631
97 Followers 5K Following
Lyda Parton @LydaPar
29 Followers 5K Following
Taishi @Setuna7777_2
2K Followers 3K Following CS M1 at @tokyotech_jp advised by @rioyokota 未踏TG23 Research intern: @SakanaAILabs
Mohammad R. Samsami @.. @M_R_Samsami
285 Followers 363 Following AI Researcher at @Mila_Quebec & @ServiceNowRSRCH. Developing agents capable of reasoning in complex situations. Ex-intern at @EPFL_en.
Na Haluska @NaHaluska3466
110 Followers 5K Following
Eartha Lastra @LastrEart
37 Followers 5K Following
Edie Notah @EdieNotah46846
50 Followers 5K Following
Quentin Anthony @QuentinAnthon15
996 Followers 129 Following I make models more efficient. Google Scholar: https://t.co/kzVsAKPdrp
Volodymyr Kyrylov @darkproger
2K Followers 2K Following AI student at USI/ETH. Donate https://t.co/GDSkWG2tak
Teshogheysm @teshogheys49610
201 Followers 5K Following
Rose Somsy @RoseSomsy19947
22 Followers 5K Following
Renae Catanzano @ren_catanza
29 Followers 5K Following
Kathryn @kathryn5butterf
118 Followers 3K Following
Crystal Balla @BallaCryst71773
70 Followers 5K Following
Dipali Ghodake @dipali197
49 Followers 61 Following
Somer Dellosso @dellos_som
48 Followers 5K Following
Madisyn Kuhens @kuhe_madi
41 Followers 5K Following
Songlin Yang @SonglinYang4
2K Followers 2K Following PhD student @MIT_CSAIL. Prev. @ShanghaiTechUni @SUSTechSZ. Working on scalable and principled methods in #ML & #NLProc. INTP | 5w4 | sx/sp | she/her
Parshin Shojaee @ParshinShojaee
1K Followers 976 Following PhD student @VT_CS | AI for Science, Math, Code, Reasoning | Intern (incoming) @Adobe
Stephanie Gresham @StephanieG52825
80 Followers 3K Following
Arian Khorasani 🦅 @Arian_Khorasani
187 Followers 746 Following AI Researcher working with @irinarish at @cerc_aai @Mila_Quebec @UMontreal Interested in AGI ( Augmented General Intelligence )
Ross Goroshin @RGoroshin
50 Followers 11 Following
Volodymyr Kyrylov @darkproger
2K Followers 2K Following AI student at USI/ETH. Donate https://t.co/GDSkWG2tak
Parshin Shojaee @ParshinShojaee
1K Followers 976 Following PhD student @VT_CS | AI for Science, Math, Code, Reasoning | Intern (incoming) @Adobe
Hugo Laurençon @HugoLaurencon
573 Followers 186 Following ML research engineer @huggingface Les yeux rivés sur la loss
Ben Holfeld @BenHolfeld
89K Followers 32K Following SF AI Studio Lead @Accenture, partnering with @OpenAI @Google @Microsoft. Pianist. German Quantum Physicist. Creator of the Nth Floor. Views are my own. x/acc.
Gary Marcus @GaryMarcus
145K Followers 7K Following “A beacon of clarity”. Spoke at US Senate AI Oversight committee. Founder/CEO Geometric Intelligence (acq. by Uber). Rebooting AI & Taming Silicon Valley.
Pascale Fung @pascalefung
2K Followers 45 Following Chair Professor of ECE, Director of the Centre for AI Research (CAiRE), Hong Kong University of Science & Technology. Fellow of AAAI, ACL, IEEE, ISCA.
Shuran Song @SongShuran
7K Followers 427 Following Assistant Professor @Stanford University working on #Robotics #AI #ComputerVision
Anca Dragan @ancadianadragan
8K Followers 178 Following AI safety & alignment at Google DeepMind • associate professor at UC Berkeley EECS • proud mom of an amazing 2yr old
Hanna Wallach (@hanna.. @hannawallach
22K Followers 944 Following Microsoft Research NYC. Fairness, accountability & transparency in AI/ML. NeurIPS & ICML board member, WiML co-founder, sloth enthusiast. She/her.
Lourdes Agapito @LourdesAgapito
2K Followers 530 Following Professor of 3D Vision at UCL Co-Founder of Synthesia
Devi Parikh @deviparikh
23K Followers 152 Following Former Sr. Director, GenAI @Meta. Prof @GeorgiaTech. Generative artist https://t.co/z4n9IRQ3s5. Co-founded Caliper. @CarnegieMellon @RowanUniversity alum.
Kate Saenko @kate_saenko_
5K Followers 164 Following AI Researcher in dataset bias, vision & language models / FAIR / Professor at Boston University / NeurIPS 2023 co-PC / she/her/hers
Georgia Gkioxari @georgiagkioxari
9K Followers 413 Following Assistant professor in Computing + Mathematical Sciences @Caltech 🏛️ ∙ Computer vision enthusiast 🤖 ∙ Previously at @metaai 👩🏻💻∙ From 🇬🇷
Jessica Burgner-Kahrs @BurgnerKahrs
2K Followers 647 Following Professor & Director @CRLaboratory @UTM @UofT @UofTCompSci @UofTRobotics l #womeninrobotics
Dongyan Lin @dongyanl1n
514 Followers 367 Following PhD candidate @IPNmcgill @Mila_Quebec. Neuro-inspired AI + AI-accelerated Neuro. 🐘:[email protected] / 🟦:https://t.co/6Z0ZkOqAE2
Georgia Chalvatzaki @GeorgiaChal
5K Followers 2K Following Professor @CS_TUDarmstadt, @hessian_AI, AI Emmy Noether @dfg_public, co-chair TC @MobileManip & co-chair WiE @ieeeras
Julia Kaltenborn @JuliaKaltenborn
471 Followers 386 Following Machine Learning for Climate Science. Research MSc @mcgillu / @Mila_Quebec. Co-Founder of Unser Dialog. @aihelpsukraine She/Her.
Justine Gehring @GehringJustine
166 Followers 135 Following Master Student at Mila & McGill researching nlp, graph representation learning and ml4code https://t.co/knQHOfurnH
Adam Ibrahim @ai_phd
519 Followers 429 Following PhD student in Machine Learning at Mila. Currently in the process of graduating.
Yuka Kojima ☺️ Em.. @GameGeekGirl
2K Followers 511 Following @EmemeAI Founder 🏘️ えめめじゃないよ、エミームです | 👀@FOVEinc Founder | 🐣https://t.co/cPk7kRX3Lf Co-Founder | Forbes 30 Ander 30 Asia | Woman of the year Nikkei | MIT
Nichol Bradford @Nichol_Bradford
2K Followers 3K Following Inspired by human possibility, I explore the Future of Work, Society, and the Human Mind.
Claire Delaunay @lullabeee
230 Followers 29 Following
Raquel Urtasun @RaquelUrtasun
12K Followers 288 Following Founder & CEO @Waabi_ai Professor at @UofT Co-Founder @VectorInst
Sanja Fidler @FidlerSanja
14K Followers 484 Following Associate Professor @UofT, Vice President of AI Research @nvidia, founding member of @VectorInst. Computer vision, deep learning, 3D. Opinions are my own.
Angela Schoellig (hir.. @angelaschoellig
5K Followers 1K Following Professor of Robotics, TU Munich and University of Toronto. Leading @learnsyslab. Also at @MIRMI_TUM, @UofTRobotics, @VectorInst.
Joelle Pineau @jpineau1
10K Followers 352 Following AI researcher. VP AI Research (FAIR), @AIatMeta. Professor of Computer Science, @mcgillu. Core academic member, @Mila_Quebec
Daphne Koller @DaphneKoller
26K Followers 5 Following Founder and CEO of @insitro, Machine Learning pioneer, co-founder of Coursera, adjunct CS Professor at Stanford, avid traveler
Dr. Radhika Dirks @radhikadirks
515 Followers 108 Following CEO XLabs AI | CEO Ribo | Forbes Women in AI to Watch | PhD Quantum Computing
Sadie St Lawrence @sadiestlawrence
2K Followers 299 Following 🚀Currently building @hmcinstitute 💜Founder of @womenindataorg 📚AI & SQL Instructor on Coursera & LinkedIn 📆 Planner Fanatic 🎤 Keynote Speaker
Valeria Sadovykh @ValeriaSadovykh
90 Followers 185 Following Valeria Sadovykh, PhD, Emerging technology leader, speaker, and scholar, with a penchant for solving societal challenges through AI.
Tulsee Doshi @tulseedoshi
2K Followers 450 Following Head of Product, Responsible AI for @GoogleAI. Building AI-based products that are safe and equitable. @Stanford alum. @ForbesUnder30. Opinions my own.
Kate Crawford @katecrawford
84K Followers 3K Following Book: ATLAS OF AI Exhibition: CALCULATING EMPIRES Mapping politics, power & AI TIME100AI | https://t.co/qMJT6cmp4F | MSR-NYC | @USCAnnenberg |
Cynthia Rudin @CynthiaRudin
3K Followers 143 Following
Regina Barzilay @BarzilayRegina
3K Followers 30 Following
Shivon Zilis @shivon
123K Followers 2K Following Artificial intelligence, biological intelligence, and whatever exists in between and beyond. Made in Canada.
Dr. Rana el Kaliouby @kaliouby
35K Followers 6K Following AI Girl Boss! AI Entrepreneur & Investor. Founder @Affectiva. Deputy CEO @SmartEyeAB. General Partner, AI Operators Fund. Author #GirlDecoded. #EmotionAI.
Allie K. Miller @alliekmiller
49K Followers 2K Following #1 Most Followed Voice in AI Business (1.5M followers). Nat’l AAAS Ambassador. Former Amazon, IBM. Fortune 500 and startup AI advisor, public speaker.
Neil Houlsby @neilhoulsby
4K Followers 318 Following Professional AI researcher; amateur athlete. Senior Staff RS in the Google Deepmind, Zürich. Attempts triathlons.
Jascha Sohl-Dickstein @jaschasd
19K Followers 626 Following Member of the technical staff @ Anthropic. Most (in)famous for inventing diffusion models. AI + physics + neuroscience + dynamics.
utku @utkuevci
2K Followers 753 Following Researcher @GoogleDeepMind. I tweet about recent research around training of neural networks, my opinions and rand(). ...üstü kalsın
Sara Hooker @sarahookr
39K Followers 8K Following I lead @CohereForAI. Formerly Research @Google Brain @GoogleDeepmind. ML Efficiency at scale, LLMs, @trustworthy_ml. Changing spaces where breakthroughs happen.
cynthia breazeal @cynthiabreazeal
8K Followers 31 Following Robot builder, MIT Media Lab professor, MIT Dean for Digital Learning, Entrepreneur, Mother of Robots giving robots a heart, too.
Huge congratulations to the Zyphra team @PaoloGlorioso1 @yury_tokpanov @QuentinAnthon15 @jcrwhittington @ai_phd @J_Pilault for your exceptional effort, skill, and dedication in pulling this together. There will be many more exciting days ahead.
Happy to release Accelerated Scan, a kernel library for first order parallel associative scans in vanilla @PyTorch, Triton 2.2.0 and CUDA C++. pip install accelerated-scan🧵
This was joint work between @GoogleDeepMind and @Mila_Quebec. Many thanks to my supervisors @RGoroshin and @pierrelux for their constant support and guidance throughout the project. Also props to @ClementGehring, @J_Pilault and @davidkanaa. See you in Vienna! ❤️ 14/14
@MahanFathi we need code to gets our hands dirty and start building! 🙌🏼🙏🏼
@MahanFathi Would be great to see if this approach can be combined with Mamba
Trends for United States
You might like
