Norman Casagrande @nova77t
ML, history, space & sciencey stuff. @GoogleDeepMind, previously @Google, Wavii & @lastfm. @[email protected] (ML) @[email protected] (personal) @ Google DeepMind Joined January 2010-
Tweets2K
-
Followers786
-
Following282
-
Likes3K
Excited to share Penzai, a JAX research toolkit from @GoogleDeepMind for building, editing, and visualizing neural networks! Penzai makes it easy to see model internals and lets you inject custom logic anywhere. Check it out on GitHub: github.com/google-deepmin…
Microsoft just dropped VASA-1. This AI can make single image sing and talk from audio reference expressively. Similar to EMO from Alibaba 10 wild examples: 1. Mona Lisa rapping Paparazzi
Introducing Udio, an app for music creation and sharing that allows you to generate amazing music in your favorite styles with intuitive and powerful text-prompting. 1/11
AI-generated sad girl with piano performs the text of the MIT License
Human Image Personalization with High-fidelity Identity Preservation Presents FlashFace, a practical tool with which users can easily personalize their own photos on the fly by providing one or a few reference face images and a text prompt proj: jshilong.github.io/flashface-page/ abs:…
New article in @WIRED about the creation of transformers on the day we got back together at @nvidia conference – thanks, @StevenLevy. wired.com/story/eight-go…
MusicHiFi Fast High-Fidelity Stereo Vocoding Diffusion-based audio and music generation models commonly generate music by constructing an image representation of audio (e.g., a mel-spectrogram) and then converting it to audio using a phase reconstruction model or vocoder.
From everything I see day to day, deep learning for drug design has exactly the same characteristics as other DL-successful domains: - dataset design and mixture is key - scalable and stable architectures and losses trump all - end-to-end is better, just follow the gradient
New blog post! Some thoughts about diffusion distillation. Actually, quite a lot of thoughts 🤭 Please share your thoughts as well! sander.ai/2024/02/28/par…
Strange to think that Ötzi the iceman died around roughly the same time(within a few decades) as Egypt was likely being unified for the first time
Introducing Gemini 1.5: our next-generation model with dramatically enhanced performance. It also achieves a breakthrough in long-context understanding. The first release is 1.5 Pro, capable of processing up to 1 million tokens of information. 🧵 dpmd.ai/3SEbw4p
Introducing AlphaGeometry: an AI system that solves Olympiad geometry problems at a level approaching a human gold-medalist. 📐 It was trained solely on synthetic data and marks a breakthrough for AI in mathematical reasoning. 🧵 dpmd.ai/alphageometry
A breakdown of the Long Context Retrieval Embedding Models from Stanford!💥 In Short⏩: 1. They release 3 long context(2k/8k/32k) BERT-like encoder embedding models on HuggingFace 2. The models are only 80M params and outperform MUCH larger models (4-85x larger) 3. Accessible…
Introducing FunSearch in @Nature: a method using large language models to search for new solutions in mathematics & computer science. 🔍 It pairs the creativity of an LLM with an automated evaluator to guard against hallucinations and incorrect ideas. 🧵 dpmd.ai/x-funsearch
Introducing GNoME: an AI tool that helped discover 2.2 million new crystals. 💎 Crystals are found in everything from the chips powering our phones to solar cells creating clean energy. The model also better predicts the stability of new materials. 🧵 dpmd.ai/GNoME-AI
Checkout UniMat -- a unified representation of materials that enables scaling of diffusion models to millions of stable crystal structures. Website: unified-materials.github.io Paper: arxiv.org/abs/2311.09235
"Simplifying Transformer Blocks" ranks easily among my favorite research papers that I've read this year. Here, the authors look into how the standard transformer block, essential to LLMs, can be simplified without compromising convergence properties and downstream task…
I don't know whether AGI poses an existential risk, but I do know that climate change is an existential risk NOW. These plots are terrifying, far more so than any training loss curve.
I don't know whether AGI poses an existential risk, but I do know that climate change is an existential risk NOW. These plots are terrifying, far more so than any training loss curve.
I’m so happy to finally see this out. That model is insanely good, and what’s shown here only scratches the surface!
I’m so happy to finally see this out. That model is insanely good, and what’s shown here only scratches the surface!
David Attenborough is now narrating my life Here's a GPT-4-vision + @elevenlabsio python script so you can star in your own Planet Earth:
Richard Jones (RJ) @metabrew
3K Followers 1K Following Enthusiastic cook, erlanger, @lastfm (née Audioscrobbler) founder/former CTO, @irccloud founder, bit of rust gamedev & home automation nonsense.Jonty Wareing ⍼ @jonty
9K Followers 2K Following This is suddenly getting much higher-profile than I intended Escape plan: https://t.co/QCYjfQ21Aj Backup escape plan: https://t.co/bPJQufNHVuDelip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Sander Dieleman @sedielem
50K Followers 2K Following Research Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).👩💻 Paige Bai.. @DynamicWebPaige
59K Followers 2K Following ✨Keep it simple, make it scale. AI should be about empowering people, building understanding, & making dreams realities. 👩💻GenAI @GoogleDeepMind ex-@GitHubMiles Brundage @Miles_Brundage
43K Followers 10K Following Policy research at @openai. I mostly tweet about AI, animals, and sci-fi. He/him. Views my own.Heiga Zen (全 炳河.. @heiga_zen
7K Followers 196 Following Principal Scientist (Director) @GoogleDeepMind in Japan. 波瀬小⇒一志中⇒鈴鹿高専⇒名工大 (IBM TJ Watson intern for a year)⇒東芝欧州研⇒Google (Speech🇬🇧⇒Brain🇯🇵) ⇒Google DeepMindNathan Benaich @nathanbenaich
51K Followers 32K Following solo member of investment staff @airstreet, brewing ambition @airstreetcafe, next token predictor @airstreetpressDawnLouis @Z6t1DTHwVegvaVq
0 Followers 17 FollowingDestiny Symon @DestinySym82681
84 Followers 5K FollowingSeñor Designer @secureurbag
69 Followers 70 Following Thought follower, influencee, reply guy, senior designer, junior dev. Currently @mcdonalds, prev DeFiKaia Gutenson @guten_ka
83 Followers 5K FollowingKass @kasstherobot
578 Followers 3K Following Futurist. Designer. Evolved from hydrogen. Turning matter + energy into pixels. Everettian inclinations. Entropy is all you need.UnPCThreads @pc_threads
272 Followers 780 Following I'm a rambler and a gambler and I'm a long way from home. Life's too short to be too serious. A few things matter; most don't. Join me and follow along.Samira Orn @SamiraOrn40984
46 Followers 5K FollowingBMR LLC @bmrllcinthe206
60 Followers 742 FollowingFrancisco Paskert @paske_franci
35 Followers 5K FollowingNatalia Fritchley @NataliaFri54540
38 Followers 5K FollowingAndres Castillo @a_castillo_v
186 Followers 2K Following Lifelong learner. ML enthusiast. MASc @UofT, Civil Engineer @UNALoficial. I like maps and typography. My learning journey: https://t.co/GlVqUWbsJoJuan Luis Rojas León @itsrojasleon
125 Followers 1K FollowingNara Flusche @NFlusc
72 Followers 5K FollowingLouetta Leutwiler @LLeutwi
39 Followers 5K Following资源帝 @kan11jia28
39 Followers 799 FollowingHenry Ndubuaku @hmunachii
108 Followers 75 Following Your average maths and deep learning guy, creator of NanoDL Python library.Lorri Gotay @LorriGotay42093
75 Followers 5K FollowingWinter Stange @WinStange
86 Followers 5K FollowingJun Li @littlelithiumSV
29 Followers 109 Following High-tech angel investor. Fashion product developer & designer.Cordia Kolk @CordiaK51061
26 Followers 5K Following连呀 @Lianzyyyyy
5 Followers 51 FollowingShirlene Weagle @ShirleWea
47 Followers 5K FollowingValerie Eismont @EismontVal73713
70 Followers 5K FollowingEryn Hand @ErynHand353920
85 Followers 5K FollowingGeorgie Kresal @GKresal88984
64 Followers 5K FollowingFatima Henness @FatimHenn
69 Followers 5K FollowingBrittany Matlack @matl_britta
36 Followers 5K FollowingFarah Bogg @bogg_bog
81 Followers 5K FollowingAdella Edith @AdellaEdit
66 Followers 5K FollowingMD TANZIM ALAHI @AlahiTanzim
5 Followers 873 Following I live for my dream and my passion always drives me.kr4g-mountain @kr4mountain
42 Followers 252 Following I enjoy scaling mountains and trekking. Although my English is not yet perfect, I am eager to connect with people from around the globe.Nick Omeyer @NickOmeyer
199 Followers 1K Following Co-founder @StepsizeHQ • Tweets about building with LLMs 🛠️Zain Hasan @ZainHasan6
2K Followers 1K Following Learning & sharing ML | Paper Summaries | ML @weaviate_io, @UofT EngSci, Data Scientist, Lecturer, Digital Health/Biomed🇨🇦🇵🇰Melissa T @msonglewis
7 Followers 61 FollowingShaun Singh @bornshaun
2K Followers 3K Following Founder of @deathtostock. Trying to fund as many internet creators I can before I die. Pitch me ☺︎ ☺︎ ☺︎ ☺︎ ☺︎Himanshu Lawaniya @bhramanicBliss
22 Followers 232 Following «VC 🦄 ex. @sequoia, @a16z, @SoftBank | mentor @ycombinator + @Techstars 👉 LOOKING FOR FOUNDERS → pre-Seed 💥»Danny Ayers 🌳 @danja
2K Followers 3K Following Dog lover. He's called Claudio. My best friend and a Very Good Boy. https://t.co/DmnQouOiEoEmpty @lucaskyblue
180 Followers 5K FollowingPierre Nagorny @a1rb4ck
419 Followers 5K Following Machine Learning @artanim_mocap #VR #animation #mocap. Happy with real-life optimization problems. @[email protected]🌍 Benjamin Earth H.. @zeronerthano
575 Followers 5K Following Are You Worthy, Lord Sacredness; Could you take the Government to Court? https://t.co/RMrKyhrIyCAndrej Karpathy @karpathy
979K Followers 904 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥Yann LeCun @ylecun
711K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.Richard Jones (RJ) @metabrew
3K Followers 1K Following Enthusiastic cook, erlanger, @lastfm (née Audioscrobbler) founder/former CTO, @irccloud founder, bit of rust gamedev & home automation nonsense.Jonty Wareing ⍼ @jonty
9K Followers 2K Following This is suddenly getting much higher-profile than I intended Escape plan: https://t.co/QCYjfQ21Aj Backup escape plan: https://t.co/bPJQufNHVuFrançois Chollet @fchollet
469K Followers 770 Following Deep learning @google. Creator of Keras. Author of 'Deep Learning with Python'. Opinions are my own.Google DeepMind @GoogleDeepMind
943K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.Delip Rao e/σ @deliprao
46K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈Sander Dieleman @sedielem
50K Followers 2K Following Research Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).Peyman Milanfar @docmilanfar
67K Followers 263 Following Distinguished Scientist at Google Research. Computational Imaging, Machine Learning, and Vision. Tweets = personal opinions. May change or disappear over time.👩💻 Paige Bai.. @DynamicWebPaige
59K Followers 2K Following ✨Keep it simple, make it scale. AI should be about empowering people, building understanding, & making dreams realities. 👩💻GenAI @GoogleDeepMind ex-@GitHubJan Leike @janleike
44K Followers 322 Following ML Researcher, co-leading Superalignment @OpenAI. Optimizing for a post-AGI future where humanity flourishes.Miles Brundage @Miles_Brundage
43K Followers 10K Following Policy research at @openai. I mostly tweet about AI, animals, and sci-fi. He/him. Views my own.Heiga Zen (全 炳河.. @heiga_zen
7K Followers 196 Following Principal Scientist (Director) @GoogleDeepMind in Japan. 波瀬小⇒一志中⇒鈴鹿高専⇒名工大 (IBM TJ Watson intern for a year)⇒東芝欧州研⇒Google (Speech🇬🇧⇒Brain🇯🇵) ⇒Google DeepMindDouglas Eck @douglas_eck
12K Followers 905 Following Google DeepMind lead and recovering faculty member. Sometimes a musician. https://t.co/ucS5UXich2.Jack Rae @drjwrae
9K Followers 353 Following Principal Scientist @ Google DeepMind Work on Gemini 💎♊ Compression is all you need LLMs (e.g. Gopher, Chinchilla, Gemini) 💼 Past: OpenAI, QuoraAndrew Trask @iamtrask
74K Followers 190 Following @openminedorg, @GoogleDeepMind ethics team, @OxfordUni phd candidate, @UN pet lab, @GovAI_, creator of #GrokkingDeepLearning, NALU, and sense2vecAaron Defazio @aaron_defazio
6K Followers 363 Following Research Scientist at Meta working on optimization. Fundamental AI Research (FAIR) teamHenry Ndubuaku @hmunachii
108 Followers 75 Following Your average maths and deep learning guy, creator of NanoDL Python library.OverSimplified @over_simplified
112K Followers 145 Following Explaining things in an OverSimplified way on YouTube.Vlad Lialin @guitaricet
994 Followers 742 Following Teaching robots to learn at https://t.co/keOXJH7j4U 🦾Keren Gu 🌱👩🏻.. @KerenGu
2K Followers 458 FollowingMistral AI @MistralAI
90K Followers 0 Following Fast, open-source and secure language models. Join us https://t.co/INALdNGvCPGabi Surita @gssurita
254 Followers 259 Following Building the Al counterculture. Sometimes converts coffee into code. (she/her) 🏳️🌈 🇧🇷Stoke Space @stoke_space
33K Followers 76 Following We're on a mission - starting with 100% reusable rockets.xAI @xai
997K Followers 36 FollowingUnrecord @unrecordgame
60K Followers 3 Following The hyper-realistic bodycam FPS developed by @dramagamestudio Wishlist on steam now : https://t.co/zw9RuWa928… [email protected]ChrisO_wiki @ChrisO_wiki
196K Followers 339 Following Independent military history author and researcher. Also at https://t.co/T008p5JDErArthur Mensch @arthurmensch
40K Followers 872 Following Co-founder and CEO @MistralAI. Apply https://t.co/yHGRZAtjcxstuffmadehere @stuffmadehere
15K Followers 0 Following I make cool stuff and share it for your enjoymentSherjil Ozair @sherjilozair
6K Followers 3K Following prev: autopilot @tesla, deep learning @googledeepmind, phd https://t.co/dxgb6gimCf, cs @iitdelhiSebastiano Lab @SebastianoLab
170 Followers 10 FollowingJustine Tunney @JustineTunney
33K Followers 272 Following I built a C library that lets you compile 12kb static binaries that run natively on Linux, Mac, Windows, FreeBSD, OpenBSD, NetBSD and BIOS using just GCC/Clang.niki parmar @nikiparmar09
10K Followers 775 FollowingStelfie the Time Trav.. @StelfieTT
18K Followers 17 Following 🇮🇹 Hi, I'm #Stelfie, a fictional AI character. In a parody of life and history powered by an Artist and AI, I time travel and take stelfies. -John Schulman @johnschulman2
39K Followers 609 Following Cofounder @openai, lead post-training for ChatGPT and the API. Interested in reinforcement learning, alignment, birds, jazz musicPraneet Dutta @praneetdutta
167 Followers 367 Following Opinions listed here are my own. Research @Google @DeepMind. co-founder @teamonk. Formerly @unity3d @SCSatCMU, @StanfordGSB. Applied GenAI, AI for Climate.Llion Jones @YesThisIsLion
5K Followers 619 Following https://t.co/lqleZpqX5J 🐠🐟 Welsh Artificial Intelligence Researcher living in Tokyo. #AIAYN(((Tendar))) @Tendar
351K Followers 793 Following Tyrants are my enemies | Si vis pacem para bellum |🇩🇪🇪🇺| Das Böse triumphiert allein dadurch, dass gute Menschen nichts unternehmen |Military & HistoryCosmin Paduraru @CauseMean
502 Followers 578 Following Research scientist @DeepMind, here to see what's going on in the world and what @samuelpepys is up toRob Allison @roballison
1K Followers 530 Following Technical Director @ Playstack Leeds | Game Developer | Music Maker | 50% of Laserdog games | Dad | Cat dad | Unity | M8 | LSDJJason Baldridge @jasonbaldridge
10K Followers 1K Following Research scientist at Google in Austin working on grounded language understanding. [email protected]Jeff Donahue @jeffdonahue
869 Followers 348 Following Research Scientist @DeepMind Previously: PhD @berkeley_aiEmbassy of Switzerlan.. @SwissEmbassyUSA
12K Followers 613 Following Welcome to the Twitter page of the Embassy of Switzerland in the United States of America with Ambassador Jacques Pitteloud @SwissAmbUSASwissnex in San Franc.. @swissnexSF
10K Followers 4K Following Connecting Switzerland, North America, and the world in science, education, innovation, and the arts. RT's ≠ endorsements.Cătălina Cangea @catalinacangea
3K Followers 607 Following Senior RS @GoogleDeepMind, AI tools for music creatives. PhD @Cambridge_CL @Kings_College. 🎶 addict, player, wannabe maker 🎸🎫🏟️🎹🚣♀️Brendan Shillingford @BrendanShilling
1K Followers 435 Following DeepMind / Oxford. Tweets my own opinions.Tides of History @TidesHistory
4K Followers 26 Following From the fall of the Roman Empire to the rise of the modern world: history ebbs and flows over the centuries. From @wonderymedia, get new episodes on Thursdays.Edgar Duenez-Guzman @DuenezGuzman
424 Followers 487 Following Engineer and scientist working on emergence of altruism in multi-agent systems / Geek at heartJomini of the West @JominiW
198K Followers 330 Following Polemologist writer and speaker on all things related to human conflict. Discussions on waging peace, surviving war, and the fate of HumankindZachary Gleicher @GleicherZachary
1 Followers 81 FollowingМаксим @kms_d4k
143K Followers 58 Following Ukrainian Officer 🇺🇦🇺🇦🇺🇦 EOD forces💣 military engineering⚙️🛠. FIGHTING RUSSIAN INVASION RIGHT NOW⚔️ Support me visit our charity fund 👇 and comment MaxPB @pblunsom
133 Followers 80 FollowingSebastian Borgeaud @borgeaud_s
994 Followers 259 Following Research Engineer at DeepMind with a focus on Large Language Models and large scale Deep LearningIllia Ponomarenko �.. @IAPonomarenko
1.3M Followers 2K Following Live straight out of Bucha Buy Me a Coffee: https://t.co/2jsZNdSj2u Also find me on BlueSky: https://t.co/rqus6D0CZdInflection AI @inflectionAI
49K Followers 3 Following We are an AI studio creating a personal AI for everyone. Our first is @pi, a supportive and empathetic conversational AI.Phillips P. OBrien @PhillipsPOBrien
200K Followers 2K Following Professor of Strategic Studies, @univofstandrews; Author of The Strategists (Summer 2024): https://t.co/l2PkpyDtDwParameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey PEFT algorithms are useful for dealing with LLMs with high parameter counts, as even fine-tuning these models from scratch can be computationally expensive and resource-intensive. arxiv.org/abs/2403.14608
Very sad to hear of Dan Dennett's passing, I remember with great fondness the wonderful far-ranging conversation we had on AI, creativity, qualia, and of course consciousness, including Theseus's ship as regards to AI. He was a great thinker, and will be much missed.
With Dan Dennett and @demishassabis in 2019. (The only time they met, I believe.) Dan will be much missed.
RNNs are not dead yet‼️ In fact, they are coming back with a vengeance recently. Very nice paper about “The Illusion of State in State-Space Models” (arxiv.org/abs/2404.08819) and thread 👇
✨Excited to finally drop our new paper: SSMs “look like” RNNs, but we show their statefulness is an illusion🪄🐇 Current SSMs cannot express basic state tracking, but a minimal change fixes this! 👀 w/ @jowenpetty, @Ashish_S_AI arxiv.org/abs/2404.08819
udio is Google's Lyria but public. Three researchers left deepmind with 100s of researchers worth of work and effort, raised money and retrained it on their own machines in the span of 3 months.
Feel the agi from Udio, some people are able to access the site now
Introducing Udio, an app for music creation and sharing that allows you to generate amazing music in your favorite styles with intuitive and powerful text-prompting. 1/11
PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models Significantly improved finetuned perf by simply changing the initialization of LoRA's AB matrix from Gaussian/zero to principal components of W repo: github.com/GraphPKU/PiSSA abs:…
Schedule-Free Learning github.com/facebookresear… We have now open sourced the algorithm behind my series of mysterious plots. Each plot was either Schedule-free SGD or Adam, no other tricks!
A bit late, but I just read ReFT, here's a quick thread. - A PEFT method - acts on activs `h` -> small inference overhead 1/5
ReFT: Representation Finetuning for Language Models 10x-50x more parameter-efficient than prior state-of-the-art parameter-efficient fine-tuning methods repo: github.com/stanfordnlp/py… abs: arxiv.org/abs/2404.03592
ReFT: Representation Finetuning for Language Models 10x-50x more parameter-efficient than prior state-of-the-art parameter-efficient fine-tuning methods repo: github.com/stanfordnlp/py… abs: arxiv.org/abs/2404.03592
@DarioBressanini 3) Il modo più comodo è Google Colab. Hai sempre tutte le librerie disponibili, senza sbattimenti vari ed i tuoi progetti sono disponibili su qualunque computer. 4) Puoi farti scrivere semplici programmi dall'AI, molto ferrata in Python.
✨ Can we detect style in the generated images? Our recent work takes a step towards understanding this question. We train a style-focused vision feature extractor built on top of CLIP, which we call a Contrastive Style Descriptior (CSD). paper: arxiv.org/abs/2404.01292 Style…
Consistent video stylization can be achieved using off-the-shelf text-based image editing methods with the Lumiere research model → goo.gle/47WX6C2 Check out these examples ⬇️
Google presents Gecko Versatile Text Embeddings Distilled from Large Language Models Gecko with 768 emb dim competes with 7x larger models and 5x higher dimensional embeddings arxiv.org/abs/2403.20327
Test veloce: quanti di voi mi seguono realmente qui, e quanti vedono i miei tweet? Se avete letto questo tweet, mettete un like, per favore, così posso contarvi. In cambio offro foto di gatto più coscia femminile per attirare la vostra attenzione. Perché ve lo chiedo? / segue
Anti-vaxx propaganda causes people to die needlessly.
Updated fatality rates by state vaccination % @nytgraphics
This is literally my new LK-99 🙏🙏🙏
Update: more experimental results rolling in. Here it is against SGD with both the step-wise and cosine schedule (both baselines heavily tuned, no cheating) This is something special indeed!
We're sharing our learnings from a small-scale preview of Voice Engine, a model which uses text input and a single 15-second audio sample to generate natural-sounding speech that closely resembles the original speaker. openai.com/blog/navigatin…
🚀Our latest blog post unveils the power of Consistency Models and introduces Easy Consistency Tuning (ECT), a new way to fine-tune pretrained diffusion models to consistency models. SoTA fast generative models using 1/32 training cost! 🔽 Get ready to speed up your generative…
Human Image Personalization with High-fidelity Identity Preservation Presents FlashFace, a practical tool with which users can easily personalize their own photos on the fly by providing one or a few reference face images and a text prompt proj: jshilong.github.io/flashface-page/ abs:…
A candle snuffer is a clever and extremely simple mechanical device that can automatically extinguish a candle at a certain time or in case one forgets to blow it out. [📹 RescueRestore_]