Russ @rmarcilhoo
Former Analytics guy at Pimco, now thankfully investing his own money Austin, TX Joined February 2010-
Tweets9K
-
Followers232
-
Following161
-
Likes330
The most performant AI applications use specialization, but how do you know which base model to adapt? Performing an exhaustive search for the best base model is expensive, time-consuming, and error-prone. What if there was a way to bypass this process and start with the…
Slides (new deck, painful but worth it!): docs.google.com/presentation/d… What a joy to teach at ELLIS winter school, amazing students and questions Enjoy
Slides (new deck, painful but worth it!): docs.google.com/presentation/d… What a joy to teach at ELLIS winter school, amazing students and questions Enjoy
Chinchilla revisited: "...training large language models for multiple epochs by repeating data is beneficial and scaling laws continue to hold in the multi-epoch regime" Hugging Face punching above its weight class. @JeffDean @pabbeel @RichardSocher arxiv.org/abs/2305.16264
How can we reduce the deploy cost of LLMs by 100x? From GPUs to MLSys, from MoEs to Speculative Decoding, in this blog post, we give a full-stack examination of transformer inference optimization yaofu.notion.site/Towards-100x-S…
I’m very excited to share our work on Gemini today! Gemini is a family of multimodal models that demonstrate really strong capabilities across the image, audio, video, and text domains. Our most-capable model, Gemini Ultra, advances the state of the art in 30 of 32 benchmarks,…
The Gemini era is here. Thrilled to launch Gemini 1.0, our most capable & general AI model. Built to be natively multimodal, it can understand many types of info. Efficient & flexible, it comes in 3 sizes each best-in-class & optimized for different uses blog.google/technology/ai/…
Human feedback to improve LLMs is at the core of the current AI revolution. Hwvr, it's an expensive process that requires a lot of human effort. RL from AI feedback (RLAIF V2) performs on par w/ RLHF while not relying on any human data. @GoogleDeepMind arxiv.org/abs/2309.00267 1/4
in almost all tissues, cancer requires multiple acquired mutations in different genes. most require between six to 12 mutations in different genes in order to generate a tumor advanced enough to send the patient to the oncologist and the tumor be diagnosed. even benign…
Most scenic campus in the country. @AndrewYNg @AnimaAnandkumar @JeffDean @erikbryn
Most scenic campus in the country. @AndrewYNg @AnimaAnandkumar @JeffDean @erikbryn
Dear sane people of twitter: here’s your one shot to kill ACL’s hair-brained arXiv ban. Please do the needful: aclweb.org/portal/content…
When #TODO code reminders get lost with "Toto too"
Many people trying to explain away voters' perception that inflation is rising amid a historic decline by saying that people are actually talking about the level of prices, not the rate of change. But if so, that's historically new 1/
This needs the Oppenheimer/Einstein tech test. So many questions and doubts @JeffDean @AnimaAnandkumar
We have closed the @SpaceX Super Heavy mishap investigation. The final report cites multiple root causes of the April 20 mishap and 63 corrective actions SpaceX must take. This does not signal resumption of Starship launches at Boca Chica. Full statement: bit.ly/45JNMRF.
Maybe 1 day San Diego -- besides mostly Gov Grant supported Biotech -- will have a tech startup ecosystem beyond Qualcomm and upstarts comma_ai and @__tinygrad__ . San Diego and Austin have so much potential for tech entrepreneurialism starting w the local CS University grads.
Maybe 1 day San Diego -- besides mostly Gov Grant supported Biotech -- will have a tech startup ecosystem beyond Qualcomm and upstarts comma_ai and @__tinygrad__ . San Diego and Austin have so much potential for tech entrepreneurialism starting w the local CS University grads.
The anti-Suleyman grassroots OSS movement. Needs community reinforcements.
Founders: 5000 VCs are currently trapped with no food, no water, and no internet at Burning Man. They have nothing to do but listen to your pitch. Time to get in the arena
VC's putting in the hard work so founders don't have to !! Input: ARR AI Output: Next year's Hope-ium businessinsider.com/growth-warrior…
Ha Nicometo @h_nicome
90 Followers 5K FollowingDebbyBuckle @XJ17R7Yf80Cns
0 Followers 126 FollowingVitaEliot @6u5Ddu6CIDTVQ
0 Followers 118 FollowingWendyCecillia @R3m5E9W839X4S
0 Followers 123 FollowingSmotel @Smotel189933
1 Followers 246 Following Life itself is a journey, we are all worthy and should strive to travel to different lives.DeliaO'Neil @5s9cEIo7eEp1l6Y
0 Followers 190 FollowingKristy Sidley @KristSidle
87 Followers 5K FollowingAnja Goolsbee @AnjaGoolsb16927
76 Followers 5K FollowingAzzie Shamapande @AShamapand67808
44 Followers 5K FollowingMagaly Felsted @FelstedMag55575
80 Followers 5K FollowingCatherine Vauter @CatherineV27157
54 Followers 5K FollowingJade Vanmetre @JadeVanmet13533
72 Followers 5K FollowingMaryam Muhammad @MaryamMuha35864
1 Followers 180 FollowingSixta Colberg @SixtColbe
16 Followers 3K FollowingLilly-mae Kutil @LillyKuti
82 Followers 5K FollowingJeff Tatarchuk @jtatarchuk
1K Followers 2K Following Co-founder @tensorwavecloud - Pioneering the next wave of AI compute. Need GPUs? DM me.Josh @Josh32908737627
109 Followers 1K Followingsanjay rawal @FeedOpen
46 Followers 3K FollowingMLȘaman aka Andrei �.. @andreinot
377 Followers 2K Following ¦ machine learning engineer ¦ quasi polymath ¦ father ¦ ~entrepreneur ¦ preppin to surf the intelligence explosion shockwaves & help others not drown too ¦Raul Molina @rsm_ai
40 Followers 1K Following Machine Learning Engineer. Previously @NetailAI @LandingAIFranz Maikaefer @franz_maikaefer
136 Followers 2K FollowingJonas Eschmann @jonas_eschmann
119 Followers 507 Following PhD student @ NYU. Working on reinforcement learning for continuous control @rl_toolsxRaDeRx1 @xRaDeRx1
63 Followers 708 Followingaeon @AeonCoin
7K Followers 5K Following Innovative, mobile-friendly, private, highly-scalable. Aeon isn't a cryptocurrency. It's a lifestyle. Are you ready for Aeon? Retweets not endorsement.Anh Nguyen @AnhNguyenWho
74 Followers 2K Following startup stalker | current @tobikodata | prev. intern @netflix, @snap, @confluentincClaire Duncan @ClairewxDuncan
26 Followers 1K Following Gathered on the site of girls from all US states 😜 Ready for private meetings Some have naked profile photos! Watching this https://t.co/786ApNRdW7Sagar Pathrudkar @sagarpath
347 Followers 1K Following Master of My Domain #MachineLearning #OperationsResearch #MLSystemDesign Wondering about wondering... All views are my own.Dareri @Dareri293456
69 Followers 2K FollowingViktor Vlegelstijn @vlegelstijn
827 Followers 5K FollowingAlex Litzenberger @alexlitzenberge
137 Followers 1K FollowingAkihiro Nitta @aki_bayes
492 Followers 810 Following I work on ML at @kumo_ai_team @pyg_team ☁️🕷️ Past: PyTorch Lightning at @lightningai ⚡️jaho @jaho5
108 Followers 855 Following sw & hw designer, high and low level programer, linux kernel developer, retro computer.Ryan Hill @zndx
516 Followers 3K FollowingAlitaGuanche @AlitaGuanc88011
86 Followers 2K FollowingViviana Marsh @VivianaMar65766
90 Followers 3K FollowingLucretia Andrews @AndrewsLuc11396
74 Followers 3K FollowingDirk Van den Poel @dirkvandenpoel
6K Followers 6K Following Professor of Data Analytics / Big Data / predictive analytics at Ghent University. Data scientist using Spark/ensemble classification. #avgeek #opensourceThease @Thease133041
0 Followers 551 Following With you, I don’t lack anything. No matter how wild my heart is, I know how to say no.Annette Thompson 🐶 @annetteleethomp
2K Followers 2K Following Rescuing dogs & exploring AI as my second act. 🐶Freedom Fighter Forev.. @Freedom54789
81 Followers 1K Following Frodo : What are we holding on to, Sam? Sam : That there’s some good in this world, Mr. Frodo. And it’s worth fighting for.Adrian Scott 🌱 adr.. @adrianscottcom
4K Followers 5K Following Question assumptions - Opportunity. Freedom, Crypto, Risk. I code. 🌱 LLMs,Chia; #Ordinals made #10,001; @Anarkoic; @AnarkoicAI; @FrodoWallet; PhD; Ryze,NapsterChip Huyen @chipro
92K Followers 442 Following Data processing on GPUs @VoltronData Designing ML Systems: https://t.co/G81hL2dWmr @designmlsys #AI x #GPUJim Cramer @jimcramer
2.1M Followers 698 Following Host of @madmoneyoncnbc and I run the CNBC Investing Club. Follow along and join my mailing list at https://t.co/MiPnDUwQ8r…Chan Kha Vu 🇺🇦�.. @chankhavu
319 Followers 359 Following ML engineer @Microsoft @Bing, working on image search ranking models. Ex ML engineer @Samsung Research Ukraine. Aspiring to shitpost bangers!Zhiding Yu @ZhidingYu
1K Followers 384 Following Working to make machines understand the world like human beings. Words are my own.Mark Cuban @mcuban
8.8M Followers 2K Following Dunking on the pharma industry with @costplusdrugs.com, the lowest prices on meds anywhere. check it out !Sharon Zhou @realSharonZhou
23K Followers 1 Following Building the future of LLMs | Cofounder & CEO, @LaminiAI | Prev: CS Faculty & PhD @Stanford. Product @Google. @Harvard | @MIT 35 under 35. Angel investor.NeurIPS Conference @NeurIPSConf
112K Followers 35 Following New Orleans, Dec 10-16, 23. https://t.co/ga8aOw615g Tweets to this account are not monitored. Please send feedback to [email protected].Joe Tegtmeyer 🚀 �.. @JoeTegtmeyer
47K Followers 480 Following CFI pilot. I provide drone videos & info about Giga Texas & Starbase. Interested in all things space related, SpaceX, Tesla, Rocketlab, flying & more!Pete Warden @petewarden
21K Followers 3K Following CEO of Useful Sensors, founder of Jetpac, bought by Google, Xoogler who helped build TensorFlow, Stanford PhD student. Email: [email protected]The All-In Podcast @theallinpod
348K Followers 6 Following @chamath, @jason, @davidsacks, and @friedberg cover all things economic, tech, political, social, and poker.Eva Fo𝕏 🦊 Claud.. @EvaFoxU
232K Followers 1K Following Blogger covering Elon Musk, 𝕏, SpaceX & Tesla. My blog @onlyVerumNewsThomas Wolf @Thom_Wolf
68K Followers 4K Following Co-founder and CSO @HuggingFace - open-source and open-scienceZak Kukoff @zck
36K Followers 688 Following One man party round. Investing early. Previously @generalcatalyst. Good tweets here: https://t.co/dWFJDvIaUWJoshua Baer ⚙️ @JoshuaBaer
43K Followers 3K Following I help people quit their jobs and become entrepreneurs @CapitalFactory @UTAustin @LonghornStartup @WPEngine @EF_Fellows @AspenInstitute [email protected]Sebastian Raschka @rasbt
267K Followers 906 Following Machine learning & AI researcher writing at https://t.co/A0tXWzG1p5. LLM research engineer @LightningAI. Previously stats professor at UW-Madison.Built In Austin @BuiltInAustin
7K Followers 2K Following Working in tech is a way of life. Find your professional purpose on https://t.co/i35x6RqYQW. View the 2022 Best Places to Work in Austin list! #2022BuiltInBestPiero Molino @w4nderlus7
2K Followers 429 FollowingSakana AI @SakanaAILabs
19K Followers 0 Following We are a Tokyo-based R&D company on a quest to create a new kind of foundational AI model based on nature-inspired intelligence. https://t.co/LonvHEtlJRBindu Reddy @bindureddy
125K Followers 339 Following CEO of @abacusai, using Gen AI to build Applied AI and LLM agents and systems at scale, ex-AWS / Google, passionate about human behavior and open-source AGIEpsilla, Inc @epsilla_inc
83 Followers 26 Following Ship Production-Ready RAG on Day 1 Discord: https://t.co/x9hLYR23P8 LinkedIn: https://t.co/fdP1xNvDAQNomadic Man Purse @JDeanThomas
273 Followers 1K Following Recovering producer and media strategist, accidental data scientist, Economics nerd. Produced bands for half the internet in a former life. Brooklyn/RVASusan Zhang @suchenzang
20K Followers 505 Following @ Google Deepmind. Past: @MetaAI, @OpenAI, @unitygames, @losalamosnatlab, @Princeton etc. Always hungry for compute.Steward @GoSteward
884 Followers 1K Following Bringing together the capital needed to grow regenerative agriculture and rebuild local food systems. Seek funding or lend your support to a project. #bcorpEffy Zhang @effyyzhang
2K Followers 2K Following Building https://t.co/UpRp2egtEJ. previously design lead @Cruise, @Square, @svaixd alumni.Ben (e/sqlite) @andersonbcdefg
3K Followers 3K Following 🤖 Computer scientist, next-word-prediction enjoyer 📊 Prev. research fellow @ Stanford RegLab 🛠️ bUiLdiNg sOmeThiNg nEw (https://t.co/mdYPZmjSzN - YC S23) 🏳️🌈👩💻 Paige Bai.. @DynamicWebPaige
59K Followers 2K Following ✨Keep it simple, make it scale. AI should be about empowering people, building understanding, & making dreams realities. 👩💻GenAI @GoogleDeepMind ex-@GitHubthe tiny corp @__tinygrad__
33K Followers 61 Following We make tinygrad. Our mission is to commoditize the petaflop.Coinbase 🛡️ @coinbase
6.0M Followers 30 Following The most trusted crypto exchange. For support ➡️ @CoinbaseSupportSteve LeVine @stevelevine
22K Followers 2K Following I run The Electric; adjunct prof, Georgetown; author The Powerhouse. https://t.co/LQmwaf3WRy…Jon Evans @jdevans4005
2K Followers 764 Following Pragmatist, Veteran, Engineer: You are neither right nor wrong because the crowd disagrees with you. You are right because your data and reasoning are right.AIX Ventures @aixventureshq
2K Followers 130 Following AI-focused venture firm investing in early-stage companies. https://t.co/kxnv03Rtlz. @pabbeel @antgoldbloom @chrmanning @richardsocher @shaunbjohnsonOliver Cameron @olivercameron
41K Followers 502 Following Building something new! Built self-driving cars at @cruise and @voyage. Board member at @skyways. @ycombinator alum. Angel investor in 60+ DeepTech startups.Bill Clerico @billclerico
9K Followers 2K Following Backing founders solving our wildfire crisis @convectivecap. Early investor in 50+ companies. Husband & new dad! Former CEO @wepay (acq @jpmorgan)Catherine Olsson @catherineols
15K Followers 1K Following Hanging out with Claude, improving its behavior, and building tools to support that @AnthropicAI 😁 prev: @open_phil @googlebrain @openai (@microcovid)TechRanch @TechRanch
9K Followers 2K Following Venture accelerator comprised of a global ecosystem of entrepreneurs, businesses, investors and community leaders.Kevin Koym @kkoym
6K Followers 4K Following Founder of @techranch Entrepreneur. Helping early stage tech entrepreneurs accelerate their ventures to success. Changing the world through #impactinnovationClimate TRACE @ClimateTRACE
7K Followers 81 Following Climate TRACE is a worldwide coalition bringing radical transparency to global emissions. #climateaction #decarbonization #ghg #emissions #ai #datascienceGeorge Hotz 🌑 @realGeorgeHotz
248K Followers 174 Following President @comma_ai. Founder @__tinygrad__@jason @Jason
823K Followers 3K Following Host of the world's most important conversations: @twistartups @theallinpod & @liquiditypod; I also invest in 150 startups a year @launch & @founderuniEva Karene Bartlett @EvaKBartlett
220K Followers 2K Following I go to the places I write about https://t.co/cP0Q16zLyB…Nathan Benaich @nathanbenaich
51K Followers 32K Following solo member of investment staff @airstreet, brewing ambition @airstreetcafe, next token predictor @airstreetpressBri Kimmel @briannekimmel
82K Followers 4K Following Building the future of work at @worklifevc: Replit, Webflow, Deel, Hex & 50+ AI, data, dev tools. Bookworm, decent cook, AI optimistJB Straubel @jbstraubel
5K Followers 0 FollowingRedwood Materials @RedwoodMat
25K Followers 98 Following Building a circular supply chain to power a sustainable world.NumFOCUS @NumFOCUS
28K Followers 1K Following Our open source scientific software projects are changing the world. We support projects like Pandas, Julia, Jupyter, & NumPy + organize @PyData!Prof. Anima Anandkuma.. @AnimaAnandkumar
25K Followers 2K Following Bren Professor @caltech, Fmr Sr Director of #AI research @nvidia, Fmr Principal Scientist @awscloud, AI+Science, PDE, Neural operators. Views my own.@Laz4rz @rmarcilhoo @giffmana @karpathy @GregoryDiamos softmax is one of the most brutal calls. Try running with DEBUG=2 or GRAPH=1 if you want to see what it's doing. It's super important to us that this stay simple and not be muddled in indirection.
@elonmusk @sobieski902 Was happily out testing tonight with more mind blowing moves🫡🤘 but when pot hot avoidance @elonmusk 💁
@SimonBe51608947 A bit of satire yes - I based it off of this I like it because it says the quiet parts out loud - startups are hard
Congratulations to our CEO and co-founder @demishassabis who has been awarded a Knighthood by His Majesty for services to Artificial Intelligence.
Delighted and honoured to receive a Knighthood for services to AI. It’s been an incredible journey so far building @GoogleDeepMind over the past 15 years, helping accelerate the field and grow the UK & global AI ecosystems. Thanks to everyone who helped make this dream possible!
@MrGoldBro @elonmusk Dw, no one is winning with that mindset.
I'm excited to be a part of this incredible community and fund.
Today, AIX is excited to announce our second fund of $202M! With this fund, we’re particularly interested in AI applications & infra that will transform the future of work. We’re also excited to be able to lead more rounds and grow the team. aixventures.com/fund-news
URGENT Temporary Closure: Cameron County Judge Eddie Trevino, Jr., orders Boca Chica Beach & Hwy 4 closure on 10/22/2023, 8 AM - 8 PM due to SpaceX testing activities. Plan your travel accordingly.
@ClassifiedCoach Bros took the beige pill, powered thru the well trodden path
It's a beautiful day to welcome new and returning Tritons to @UCSanDiego and Scripps Oceanography! Cheers to a new academic year, a successful first quarter and discoveries that better our planet and its inhabitants. 🌎 📸: Members of the incoming Scripps graduate student class
Great to see our FourCastNet model performing very well on hurricanes! "so far, the performance of AI models has been comparable to conventional models, sometimes better on tropical storm tracking. And the AI models do it fast, spitting out predictions on laptops within minutes"
So far the performance of AI models has been comparable to conventional models, sometimes better on tropical storm tracking. And the AI models do it fast, spitting out predictions on laptops within minutes. wired.trib.al/Pud1q9h
Introducing V3 of the @sequoia Generative AI market map! Generative AI's “Act 1” came from the technology-out. We discovered a new “hammer”—foundation models—and unleashed a wave of novelty apps that were lightweight demonstrations of cool new technology. The market is…
@envedabio @viswacolluru @endpts 3/ Lux family co @AeraTx led by @AkinAkinc + founded by CRISPR pioneer @zhangf
Dear sane people of twitter: here’s your one shot to kill ACL’s hair-brained arXiv ban. Please do the needful: aclweb.org/portal/content…
Can confirm 😅
If you've run LLM benchmarks such as HELM or Eval Harness, you know that benchmarking LLMs can be very expensive and take many hours. There's an interesting new Flash-HELM variant that produces similar rankings as HELM but comes at a much-reduced cost: arxiv.org/abs/2308.11696
Yes! One of the ideas in Measuring Data is that natural lang data can be measured wrt fit to a Zipfian distribution, following @suchenzang's great point. Check out the tool to see that live (huggingface.co/blog/data-meas…) or the paper to read the reasoning (arxiv.org/abs/2212.05129).
Yes! I like this. :) So based on arxiv.org/abs/2306.01116, this corpus seems to be mostly English, all from CC. Zipfian distribution should hold. Naively, with a 128k vocab and BPE, we've seen something like ~60% fewer tokens vs a 32k vocab (depending on dataset). So... I…
Sunday small guessing puzzle Let's say I have 3 tokenizers: - llama2: 32k vocab - falcon: 65k vocab - GPT4: 100k vocab I take ~2M random documents from the web (let’s say 10 random parquet files from RefinedWeb from huggingface.co/datasets/tiiua… roughly 1B tokens). I tokenize them…