Dwarkesh Patel @dwarkesh_sp
Being pretrained Host of Dwarkesh Podcast https://t.co/3SXlu7fy6N https://t.co/rEhnfYywXY https://t.co/hQfIWdM1Un dwarkeshpatel.com San Francisco Joined December 2019-
Tweets4K
-
Followers49K
-
Following692
-
Likes38K
This was fun! Thanks for having me :)
Looking for a CPA. Is there one you recommend?
Meta is going to have 350,000 H100s by the end of the year. Given lead times, they probably had to start ordering them in 2022. How did Zuck know he'd need all these GPUs?
"More of what we call training for these big models is actually going to be inference generating synthetic data to then go feed into the model We trained Llama 3 on around 15 trillion tokens. Our prediction was that it was going to asymptote more, but even by the end, it was…
Last 28 days 🤯 While the Zuck & Trenton/Sholto episodes are doing extremely well on YouTube, what I'm proudest of is that most of these views are actually from Sarah Paine content! She is one of the greatest living historians, but her work wasn't really publicly well known…
Pretty remarkable that the only press Zuck shared from the Llama 3 launch was @dwarkesh_sp and @rpnickson Meta did give embargoed comments to mainstream publishers, but only the independent interviewers got posted to his story. GOING DIRECT! @lulumeservey
Every time I fail a spaced repetition review for a card which I remember thinking was almost too trivial to write down, I become more convinced that everything I read without making cards for is a waste of time.
Will Zuck open source the $10 billion model?
Mark Zuckerberg doesn't want AI to end up like mobile apps, where gatekeepers like Apple and Google tell you what you're allowed to build
Wildest part of Zuck's interview with @dwarkesh_sp when asked how much energy necessary to train frontier models Zuck: we need nuclear power plants
"1 GW - that's the size of a meaningful nuclear power plant, only going towards training a model. Over the last few years, there was this issue of GPU production. Now I think that's getting less. But I actually think before we hit that, you're gonna run into energy constraints.…
The main thing is to keep the main thing the main thing
The main thing is to keep the main thing the main thing
>is it MoE or dense? >haha, it's a good model sir >it's dense
The meteoric rise of Dwarkesh is a reminder that no matter how crowded the space, there’s always room for people who do great work. There’s a trillion podcasts out there but his is going gangbusters because it’s so darn good.
The meteoric rise of Dwarkesh is a reminder that no matter how crowded the space, there’s always room for people who do great work. There’s a trillion podcasts out there but his is going gangbusters because it’s so darn good.
this is a really good podcast. like a really really good podcast. Zuck is talking about gigawatts and you're still talking about flops. You're trying to raise money, zuck is trying to convince governments to take the money he already has.
this is a really good podcast. like a really really good podcast. Zuck is talking about gigawatts and you're still talking about flops. You're trying to raise money, zuck is trying to convince governments to take the money he already has.
Zuck saw @TrentonBricken on the pod and stole his whole look
Zuck saw @TrentonBricken on the pod and stole his whole look https://t.co/Rm4Hz1KEgn
Yup that was definitely a good idea
Nick @nickcammarata
60K Followers 735 Following interested in neural network interpretability and meditation
Michael Nielsen @michael_nielsen
96K Followers 6K Following Searching for the numinous 🇦🇺 🇨🇦, home in 🇺🇸 Research @AsteraInstitute https://t.co/maezekzRUb
Samo Burja @SamoBurja
60K Followers 233 Following There's never been an immortal society. Figuring out why. Founder of @bismarckanlys. @longnow fellow.
Alex Tabarrok 🛡️ @ATabarrok
76K Followers 673 Following Prof of economics at George Mason, co-founder of the online education platform https://t.co/yocRRymFPV. Advisor to firms, incl MultiversX, TEAL, Bluechip, 0L Network +
Pradyumna @PradyuPrasad
8K Followers 774 Following Unpaid intern for @PradyuPrasad NUS CS '27 alt: @altdyumna
Richard Ngo @RichardMCNgo
35K Followers 1K Following What would we need to understand in order to design an amazing future? Figuring that out @openai
Gabriel @gbrl_dick
29K Followers 1K Following cottagecore tech-adjacent young robert moses | https://t.co/9R961uPVTV
Stefan Schubert @StefanFSchubert
28K Followers 2K Following Philosophy, psychology, and effective altruism.
typedfemale @typedfemale
23K Followers 479 Following a really exciting new account "have you ever though you might be like scott alexander? very smart, but can't do math" - anon
@goth @goth600
50K Followers 7K Following VP, Witchcraft and Propaganda @ 𝕏 | Magic @ 21e8 | “tweets from the void” -redacted
Lana del Raytheon @ad0rnai
17K Followers 944 Following you exist in the context of all in which you live and what came before you
rohit @krishnanrohit
19K Followers 2K Following Building God at https://t.co/frWeoc7IVB - buy the book, it makes me happy! | essays weekly at https://t.co/TbCaC6VaaM
Jason Crawford @jasoncrawford
33K Followers 3K Following Founder, @rootsofprogress. I write about the history of technology and the philosophy of progress. Working to build the progress community and movement
kache (dingboard.com) @yacineMTB
53K Followers 3K Following i'm a swe. go to https://t.co/pWRBfY8kn2 - AI image editing IN YOUR BROWSER! follow to watch a self funded founder beat VC backed AI startups with @dingboard_
ChillFX @Kotokami1x
43 Followers 40 Following Content / VFX Editor Comissions Open 3+ Years Of Experience
Thomas Carlyle ✝️ @EagleCross1776
124 Followers 554 Following All content posted and shared are opinions of my own and do not necessarily represent truth or fact, nor legal or medical advice. [email protected]
Adithya Niranjan @_Adithya_N
298 Followers 2K Following Applied Scientist at @MicrosoftAI | Prev @AmazonScience
aksonai @aks0nai
4 Followers 35 Following
User @1337dr3am
128 Followers 153 Following
Soup @Soup313
436 Followers 942 Following Fantasy Sports. STL Sports. Politics. We'll do Lacrosse on Saturdays if there's enough effort from Molloy.
Oli Baseley @OliBaseley
243 Followers 81 Following 🇬🇧 in 🇺🇸 | product at $AUR | tech, endurance sports & football | @sf_kpi
derekbeard.eth 🦇�.. @darrylkbeard
94 Followers 1K Following
Roger Rodriguez @rrod_15
119 Followers 2K Following 💻 Director, Client Solutions Development @MovableInk ⚡ Bootstrapping @ https://t.co/pHC9zNRemt ✉️ DM's open!
kairos @kairos223
1 Followers 97 Following
Faisal Farooq @ffarooq00
411 Followers 5K Following startups 🚀 AWS | prev cyber defense consulting | adjunct lecturer CS CUNY Hunter | https://t.co/3ptbfPoaSD
Jese Camilo @jesecamilo
155 Followers 288 Following Software @lockheedmartin // Professional tinkerer // Bibliophile // @LehighU Electrical Engineer
Neer @nxdn77
31 Followers 213 Following 23, Software Engineer - PhD applicant for fall '24, INTP-T, I laugh at bad memes, I like movies/filmmaking
Arpit Mohapatra @marpit19
31 Followers 146 Following Software Engineer @Ecolab | @Github Extern'22 @Ockam
Prashanth @theprashanths
304 Followers 3K Following
June Street @June_Street
5K Followers 2K Following Global Equity Investor - Widening Moats, Structural Growth, 10 Year+ Horizon.
Andrew Stepin @anstepin
34 Followers 282 Following technical product manager and writer @ yomly. 🖋️ writing contributor @ tensorflow
Christopher Davis @cld2b
73 Followers 526 Following
Nick Johnson @gnjohnson
1K Followers 1K Following Thoughts not my own. Worried about where they come from.
Sam Andaluri @samrao
17 Followers 298 Following
Mark Graham @marksgraham_
315 Followers 144 Following Researcher at @KingsCollegeLon, machine learning and health data.
david roeske 🇺🇸.. @roeske
484 Followers 2K Following alpinist, pilot, runner | Everest, K2 no-oz summits | spent over a decade on the buyside, now VP of Finance @contra
Roger Grosse @RogerGrosse
10K Followers 750 Following
Deval Shah @deval_shah___
1 Followers 22 Following
Mike Allton @mike_allton
51K Followers 3K Following Strategic Marketing Leader in AI and Data-Driven Solutions 🤝 Head of Strategic Partnerships at @Agorapulse 🎙️ Podcast Host | Fluent in Star Wars & 🖖
chris @szabokb
12 Followers 51 Following putting intelligence into AI #𝐅𝐨𝐫𝐛𝐞𝐬 𝟑𝟎/𝟑𝟎 #AIAgents #ArtificialIntelligence
Aman Khan @_amankhan
189 Followers 303 Following AI PM @arizeai + solo GP @vector_ventures. ex @spotify @cruise @apple @ucberkeley MechE. mostly organic
Linda Carson @LindaCa64814194
59 Followers 1K Following
Yannet Interian @interian
182 Followers 107 Following Data Science Professor at the University of San Francisco
Grit @gritfollow
187 Followers 4K Following
Sanky @sankyy1302
48 Followers 236 Following
Robin Hanson @robinhanson
90K Followers 656 Following Let’s skip witty repartee & discuss fundamental questions. Views are mine, not GMU’s or Virginia’s. Books: https://t.co/hpZgEm5DBI, https://t.co/iFs9C3J2Ek
Nick @nickcammarata
60K Followers 735 Following interested in neural network interpretability and meditation
David Deutsch @DavidDeutschOxf
119K Followers 63 Following Physicist. Author of The Fabric of Reality and The Beginning of Infinity
Michael Nielsen @michael_nielsen
96K Followers 6K Following Searching for the numinous 🇦🇺 🇨🇦, home in 🇺🇸 Research @AsteraInstitute https://t.co/maezekzRUb
Samo Burja @SamoBurja
60K Followers 233 Following There's never been an immortal society. Figuring out why. Founder of @bismarckanlys. @longnow fellow.
Alex Tabarrok 🛡️ @ATabarrok
76K Followers 673 Following Prof of economics at George Mason, co-founder of the online education platform https://t.co/yocRRymFPV. Advisor to firms, incl MultiversX, TEAL, Bluechip, 0L Network +
Bryan Caplan @bryan_caplan
68K Followers 3 Following GMU econ prof, NYT bestseller, father of 4, author of Myth of the Rational Voter, Selfish Reasons to Have More Kids, Case Against Education, and Open Borders.
Pradyumna @PradyuPrasad
8K Followers 774 Following Unpaid intern for @PradyuPrasad NUS CS '27 alt: @altdyumna
tylercowen @tylercowen
231K Followers 525 Following new book *Talent: How to Identify Energizers, Winners, and Creatives Around the World*, https://t.co/7bU5cUdOBc, Conversations with Tyler, Bloomberg Opinion.
Richard Ngo @RichardMCNgo
35K Followers 1K Following What would we need to understand in order to design an amazing future? Figuring that out @openai
Gabriel @gbrl_dick
29K Followers 1K Following cottagecore tech-adjacent young robert moses | https://t.co/9R961uPVTV
Stefan Schubert @StefanFSchubert
28K Followers 2K Following Philosophy, psychology, and effective altruism.
typedfemale @typedfemale
23K Followers 479 Following a really exciting new account "have you ever though you might be like scott alexander? very smart, but can't do math" - anon
@goth @goth600
50K Followers 7K Following VP, Witchcraft and Propaganda @ 𝕏 | Magic @ 21e8 | “tweets from the void” -redacted
Lana del Raytheon @ad0rnai
17K Followers 944 Following you exist in the context of all in which you live and what came before you
Davis Blalock @davisblalock
12K Followers 165 Following Research scientist + first hire @MosaicML. @MIT PhD. I write + retweet threads about machine learning papers. Paper summaries newsletter: https://t.co/xX7NIpsIVZ
Nate Meyvis @NateMeyvis
3K Followers 1K Following Independent writer / programmer / Guy Who Makes Things Happen With Software. Xoogler. I tweet about software engineering, books, sports, games, and gambling.
Lyman Stone 石來民.. @lymanstoneky
30K Followers 2K Following Lutheran Husband Dad Kentuckian Demographer I tweet from the hip. @DemographicNTEL. Buy my book: https://t.co/86OkMZgI0p lymanrstone at gmail dot com
dan @dnschlz
1K Followers 283 Following podcast: https://t.co/JW9tDfSTz5 youtube: https://t.co/8AiyUuVTKM
Alex Tomala @a__tomala
1K Followers 114 Following Research Engineer @GoogleDeepMind It’s time to ship🫡
adammaj @MajmudarAdam
8K Followers 206 Following founding engineer @thirdweb // cs + neuro (on gap) @Penn
Bharath Ramsundar @rbhar90
12K Followers 11K Following Founder and CEO @deepforestsci. Creator of @deep_chem. Author @OReillyMedia. @stanford CS PhD. https://t.co/7LDcegrCsc
Hannu Rajaniemi @hannu
6K Followers 1K Following Co-founder and CEO of @HelixNano. Author of The Quantum Thief, The Fractal Prince, The Causal Angel, Invisible Planets and Summerland https://t.co/o6RsVIiYj3
Andrei Lankov @andreilankov
9K Followers 42 Following Director of @nknewsorg and Professor at Kookmin University in Seoul
MatX @MatXComputing
856 Followers 30 Following MatX designs hardware tailored for the world’s best AI models: We dedicate every transistor to maximizing performance for large models. Join us: https://t.co/E3XexKHUSM
Mike Gunter @MikeGunter_
646 Followers 850 Following CTO and founder, @MatXComputing, designing hardware to make LLMs an order of magnitude smarter.
John Konicki @J_Konicki
273 Followers 211 Following UC Berkeley Political Science PhD student. Former @AEI Econ Policy RA. 'Fastest editor in the West.'
Hugging Face @huggingface
343K Followers 189 Following The AI community building the future. https://t.co/VkRPD0VKaZ #BlackLivesMatter #stopasianhate
Steven Strogatz @stevenstrogatz
157K Followers 3K Following Mathematician, writer, Cornell professor. All cards on the table, face up, all the time.
Jeff Dean (@🏡) @JeffDean
296K Followers 6K Following Chief Scientist, Google DeepMind and Google Research. Co-designer/implementor of things like @TensorFlow, MapReduce, Bigtable, Spanner, Gemini .. (he/him)
AK @_akhaliq
310K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80Gx
Daniel Han @danielhanchen
7K Followers 935 Following Building @UnslothAI. Finetune LLMs 30x faster https://t.co/aRyAAgKOR7. Prev ML at NVIDIA. Hyperlearn used by NASA. I like maths, making code go fast
Lennart Heim @ohlennart
3K Followers 823 Following huh? | AI (Compute) Governance @GovAI_ | Also @EpochAIResearch |
Arthur Mensch @arthurmensch
40K Followers 872 Following Co-founder and CEO @MistralAI. Apply https://t.co/yHGRZAtjcx
Wil Moushey @WMoushey
264 Followers 393 Following Helping build the Andromeda Cluster and @gpulist. https://t.co/sysPifNaXT https://t.co/kDXKWkGgf2
Eric Steinberger @EricSteinb
7K Followers 478 Following Writing code that writes code on a mission to build safe superintelligence | CEO/cofounder @magicailabs
Doug Campbell @TradeandMoney
24K Followers 21K Following Academic economist, AP New Economic School; UC Davis PhD. Replication. Founder of Insight Prediction.
Daniel Yergin @DanielYergin
40K Followers 174 Following Author: The New Map: Energy, Climate & Clash of Nations - https://t.co/tabM3AxibC; The Quest; The Prize; Pulitzer Prize winner; Vice Chairman S&P Global
James Lin @jlinbio
3K Followers 553 Following Slaying dragons. "Those who lack the courage will always find a philosophy to justify it." — Camus.
Karma @0xkarmatic
1K Followers 1K Following AI Engineer @ Redacted Tech Company | RAG technique connoisseur
James Betker @neonbjb
2K Followers 6 Following
Joe Weisenthal @TheStalwart
356K Followers 6K Following One half of Bloomberg's Odd Lots Podcast. One quarter of Light Sweet Crude.
Brian Hie @BrianHie
5K Followers 402 Following Assistant professor @StanfordEng ChemE and @StanfordData, Innovation Investigator @arcinstitute | Machine learning for biology
Jesse Michael Han @jessemhan
2K Followers 418 Following working on something new @morph_labs // prev. research @OpenAI / math PhD at the University of Pittsburgh
muhtasham @Muhtasham9
1K Followers 907 Following In my pre-training years "Dude! You should move to SF!" - @dylan522p
Devon Eriksen @Devon_Eriksen_
37K Followers 284 Following Author, Engineer, Sharpshooter, part-time Daemon Prince of Tzeentch. Not a cat. If you see hell everywhere you look, then perhaps hell is inside your eyes.
Fabricated Knowledge @_fabknowledge_
16K Followers 465 Following Simplifying the world of semiconductor investing in the age of AI. Join over 39,000 free readers. It's secular (but cyclical) stupid Read more V
Austin Huang @austinvhuang
3K Followers 1K Following General intelligence as personal computing. Past: @GoogleDeepMind, MIT, Harvard, Berkeley.
Rahul Satija @satijalab
28K Followers 380 Following Core Member, New York Genome Center; Associate Professor, Biology, NYU
Jason Furman @jasonfurman
157K Followers 2K Following Professor of Practice at Harvard. Teaches Ec 10, some tweets might be educational. Also Senior Fellow @PIIE. Was Chair of President Obama's CEA.
masha gessen @mashagessen
149K Followers 1K Following Staff Writer, The New Yorker Author: Surviving Autocracy; The Future Is History; The Man Without a Face speaking inquiries: https://t.co/0aqzTFAbaf they/them
David Kanter @TheKanter
4K Followers 199 Following Executive Director @MLCommons making machine learning better for everyone. @MLPerf CPUs, computer architecture, semiconductors, graphics, economics, writes @RWT
Andrew McAfee 🇺�.. @amcafee
66K Followers 836 Following Author of "The Geek Way" and More from Less;" coauthor of "The Second Machine Age;" proponent of human and planetary flourishing.
I just finished watching a 2.5-hour video podcast on history and strategy between @dwarkesh_sp & Professor Sarah C. M. Paine. This WIDE-ranging talk is fascinating! If you have time and are interested in history & strategy, this is worth your while. youtu.be/YcVSgYz5SJ8?si…
the only reason i deacc’d was to take a twitter detox break and reduce complexity for a while (not to create more drama!) but accidentally made all my friends concerned. im okay, everyone’s okay, and the singularity’s not yet here. i’ll just log off the normal way instead!
Jessica pointed out that the people saying I was hot are mostly guys. I pointed out that this shows she checked.
He painted himself into a corner when he announced that reading list and now this is his only way out
@0interestrates @dwarkesh_sp How much did u guys lift
@0interestrates @dwarkesh_sp Nice bro. I love the lex Friedman podcast
|@robertwiblin also retro-dicted that he would have advised @dwarkesh_sp to be a podcaster. Apply for 80k advising. Be a star.
Paul Graham (co-founder of Y Combinator)
current state of people talking about llms
current state of stochastic parrot LLMs
TikTok’s 3 strategic comms mistakes with this video: 1) LITERALLY DOING THIS 👀 The TikTok team was so concerned with getting the words exactly right that they had the CEO read from a script. But trust is won or lost through body language — not words — and the script messed up…
Our CEO Shou Chew's response to the TikTok ban:
The unpaidness is the easiest, most high-signal thing to change. 1. You're already spending 20k+ finding the right person. What's another $100/hr/past-1st-round-candidate? 2. Look at the signal you're sending them! You value their time! No brainer but almost no one does it.
The basic problem here is that resumes/traditional job interviews have ~0 positive signal relative to a practical test (coding, modeling, research, &c.) for "how well will you do the actual job". But the equilibrium where 1. tests are now expected, and 2. they're unpaid, is bad.
Broke: Easy-applying on LinkedIn Woke: Reaching out to the hiring manger Bespoke: Working on side projects to prove your competency. h/t @dwarkesh_sp
🎙️ @patrickc with @dwarkesh_sp on craft, beauty, and increasing the GDP of the internet. Highly recommended! Many resonances with my most recent post on "fluid competence," e.g. panoramic view at all scales from global economy to API error messages. dwarkeshpatel.com/p/patrick-coll…
@natfriedman Hmmmm. Zuck says he originally bought H100s for Reels, ie. Tok-Tok so I imagine you are ready to go.
Meta is going to have 350,000 H100s by the end of the year. Given lead times, they probably had to start ordering them in 2022. How did Zuck know he'd need all these GPUs?
Trends for United States
You might like
