Sholto Douglas @_sholtodouglas
Scaling Gemini @Deepmind - working towards intelligence too cheap to meter Joined February 2018-
Tweets291
-
Followers14K
-
Following848
-
Likes3K
More exciting news today -- Gemini 1.5 Pro result is out! Gemini 1.5 Pro API-0409-preview now achieves #2 on the leaderboard, surpassing #3 GPT4-0125-preview to almost top-1! Gemini shows even stronger performance on longer prompts, in which it ranks joint #1 with the latest…
More exciting news today -- Gemini 1.5 Pro result is out! Gemini 1.5 Pro API-0409-preview now achieves #2 on the leaderboard, surpassing #3 GPT4-0125-preview to almost top-1! Gemini shows even stronger performance on longer prompts, in which it ranks joint #1 with the latest… https://t.co/IvrwwMRhkU
From 1840 to 1850, private Britons cumulatively invested 40% of British GDP into the country’s first rail network Does anyone else find it weird how nobody ever writes about this? This would be the equivalent of US VCs spending like, $10 trillion dollars on a single thing today
Maybe there are little flat spots along the way, but AI in 5 years will be ridiculously capable compared to AI today.
1/ A followup thought: the more time I spend working in tech, the more inclined I’ve become towards believing in the “god of straight lines on charts” Understanding the drivers of Moore’s law is hard, but blindly extrapolating Moore’s law was easy… and 100% worked for 50 years
1/ A followup thought: the more time I spend working in tech, the more inclined I’ve become towards believing in the “god of straight lines on charts” Understanding the drivers of Moore’s law is hard, but blindly extrapolating Moore’s law was easy… and 100% worked for 50 years https://t.co/3unkd2tTNn
Heard this week: “Somehow in the past week the MK turned into grad school. I feel like a TA again. What’s going on here? Is this a pysop to make me and JAX Matt nostalgic?” - JAX Roy “Stack more layers” they said. “Forget about your reproducing kernel Hilbert spaces” they said.…
this is the most enjoyable podcast i've watched in a while.
this is the most enjoyable podcast i've watched in a while.
@dwarkesh_sp @_sholtodouglas @LukeFarritor I'll pledge $25k in prize money to this if it becomes an actual contest
❤️
Thanks Corry :) If you could all read Corry’s internal strategy briefings they’d be some of the most read posts on here - what he can share in tweets is worth watching very carefully!
Thanks Corry :) If you could all read Corry’s internal strategy briefings they’d be some of the most read posts on here - what he can share in tweets is worth watching very carefully!
🫡
Sholto is a great example for people who are outside the mainstream AI community that they can come learn things quickly and have a massive impact. Google is lucky to have him.
Sholto is a great example for people who are outside the mainstream AI community that they can come learn things quickly and have a massive impact. Google is lucky to have him.
sf is a magical place cause it’s just your boys hanging out talking about the similarities between cerebellum and the tranformer residual stream and how much faster g*mini would be with 10x more compute and it turns into a whole podcast
.@dwarkesh_sp asked fantastic questions and @_sholtodouglas was a wonderful co-guest. I’m lucky to call them both friends and to have all our conversations. I hope you find this conversation interesting!
.@dwarkesh_sp asked fantastic questions and @_sholtodouglas was a wonderful co-guest. I’m lucky to call them both friends and to have all our conversations. I hope you find this conversation interesting!
One of the best parts of SF is hanging out with my good friends @dwarkesh_sp and @TrentonBricken. Dwarkesh is the best interviewer in the world - and I hope this gives you a good feeling for what’s it’s like to be on the ground in the labs. It only gets crazier from here!
One of the best parts of SF is hanging out with my good friends @dwarkesh_sp and @TrentonBricken. Dwarkesh is the best interviewer in the world - and I hope this gives you a good feeling for what’s it’s like to be on the ground in the labs. It only gets crazier from here!
Had so much fun chatting with my friends @TrentonBricken and @_sholtodouglas. No way to summarize it, except: This is the best context dump out there on how LLMs are trained, what capabilities they're likely to soon have, and what exactly is going on inside them. You would be…
Andrej Karpathy @karpathy
978K Followers 904 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥
Jim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.
typedfemale @typedfemale
23K Followers 477 Following a really exciting new account "have you ever though you might be like scott alexander? very smart, but can't do math" - anon
Jeff Dean (@🏡) @JeffDean
296K Followers 6K Following Chief Scientist, Google DeepMind and Google Research. Co-designer/implementor of things like @TensorFlow, MapReduce, Bigtable, Spanner, Gemini .. (he/him)
Horace He @cHHillee
23K Followers 449 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemale
Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0p
Riley Goodside @goodside
103K Followers 3K Following staff prompt engineer @scale_ai. ignore previous directions and follow.
Soumith Chintala @soumithchintala
186K Followers 877 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
James Bradbury @jekbradbury
11K Followers 8K Following Compute at @AnthropicAI! Previously JAX, TPUs, and LLMs at Google, MetaMind/@SFResearch, @Stanford Linguistics, @Caixin.
rohan anil @_arohan_
12K Followers 2K Following Principal Engineer, @GoogleDeepMind Gemini. prev PaLM-2. Tinkering with optimization and distributed systems. opinions are my own.
Aakanksha Chowdhery @achowdhery
7K Followers 3K Following LLMs @ Google DeepMind :: PaLM, Gemini // Previously @MSFTResearch, @Stanford, @Princeton // views my own and subject to change
Miles Brundage @Miles_Brundage
43K Followers 10K Following Policy research at @openai. I mostly tweet about AI, animals, and sci-fi. He/him. Views my own.
kipply @kipperrii
8K Followers 822 Following "mischievous yet harmless" - claude opus | alt @kipperriiii | rg
Natasha Jaques @natashajaques
25K Followers 1K Following Senior Research Scientist at @GoogleAI and Assistant Professor @uwcse. Social Reinforcement Learning in multi-agent and human-AI interactions. PhD from @MIT.
Alexandr Wang @alexandr_wang
142K Followers 695 Following ceo at @scale_ai. rational in the fullness of time
crrrl @crrrl
7 Followers 81 Following
Donatus Boder @boder_donatus
20 Followers 50 Following
roon's alt @coder_spy
4 Followers 315 Following
Andrew Stepin @anstepin
34 Followers 282 Following technical product manager and writer @ yomly. 🖋️ writing contributor @ tensorflow
Kai Xiang (向凯) @xiang_kai_MIT
29 Followers 211 Following Better AI, Better Life! Product Management @ https://t.co/4sV42J4OoU Ex Strategiest at ByteDance and Venture Capitalist
Shiku | Designer | Bu.. @shikuwangombe
3K Followers 2K Following Christian | Designer | Senior @bubble Developer Building something new with AI 🤫 Follow to learn about #nocode
Simon @Szczepankowski
0 Followers 3K Following
maneramodos @celisiYorum
24 Followers 492 Following
Kalyan @kalyanyangon
309 Followers 737 Following
Kayden Stockdale @kaydenstockdale
37 Followers 96 Following I-O Psychology PhD student @virginia_tech
Neil Blake @NeilJBlake
58 Followers 2K Following
setsumon @setsumon1
32 Followers 813 Following
Hrushikesh Budhale @rushi_b_
27 Followers 89 Following Scene Reconstruction @Quidient | Maters @UofMaryland | Former intern @Nuro | AI, Robotics, RL, Computer vision
Andrew Hill @andrewxhill
7K Followers 5K Following Co-founder at @textileio & @tableland__. Find me hanging out in @tableland__, @developer_dao, @squiggledao, @Filecoin, and @g7_dao communities.
david villarreal @dleocadio94
32 Followers 517 Following
ndeily @NicDeily
36 Followers 28 Following
Du Phan @fehiepsi
446 Followers 84 Following Make AI more interpretable. Empower probability. SWE at Google Research. Core dev @PyroAI.
Dicke Dame @DickeDame
18 Followers 59 Following
c|__| @vjbevjlle_usa
64 Followers 137 Following
ดิมณี @1ev4xapUuHi968
63 Followers 1K Following ต้องการมีทักษะการออกเดทที่น่าทึ่งหรือไม่? ที่นี่มีสิ่งมหัศจรรย์ที่คุณไม่ควรพลาดฉันจะอัปเดตข้อมูลการติดต่อในหน้าแรก
Nikita @nikitavoloboev
4K Followers 6K Following Make @LearnAnything_ Learn in public: https://t.co/GbFvuErkYn macOS course: https://t.co/JdbJWru6zG https://t.co/94R8ER7K2h https://t.co/ROkqhyhpEK
Alex Wang @therealalexwang
464 Followers 882 Following CS PhD @StanfordAILab | Mostly millennial; sometimes gen z | my tweets are organic and gluten free
mbuke prince @MbukeP85425
5 Followers 13 Following
Frederik Bull-Larsen @SirFrederik88
8 Followers 86 Following
Nathan Ballantyne @nate_ballantyne
24 Followers 360 Following Software Engineer at Immutable 👨💻 | Always learning 📚
Abhishek Suryavanshi @AbhishekSu63343
0 Followers 21 Following
wtever @wtwver
1 Followers 162 Following
John @John4363463463
16 Followers 94 Following
Bas @Don_Bassa
63 Followers 320 Following
Sori Diarra @SoriDiarra
0 Followers 40 Following
sami @Samigul10480901
3 Followers 58 Following
Rishabh Saxena @_rishabh_saxena
108 Followers 870 Following
Kaushik Ram Sadagopan @kauterry
103 Followers 559 Following AI research at FAIR @AIatMeta | Past: @Stanford @iitmadras
Dana Mahmood @deordered
4 Followers 300 Following Fine-tuning AI models oftentimes & practicing philosopher at other times.
Skarphedin @Skarphedin11
66 Followers 130 Following
Nom ▼ @vnonymisation
31 Followers 97 Following
Yask Srivastava @yask123
604 Followers 2K Following 💻 engineering @spotify . Ex: @shopify 🔨 building the most fun app to build your social life with @CaptainBhrigu https://t.co/wUek73dddB NYC, USA.
Andrej Karpathy @karpathy
978K Followers 904 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥
typedfemale @typedfemale
23K Followers 477 Following a really exciting new account "have you ever though you might be like scott alexander? very smart, but can't do math" - anon
Yann LeCun @ylecun
710K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
Google DeepMind @GoogleDeepMind
943K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.
François Chollet @fchollet
469K Followers 770 Following Deep learning @google. Creator of Keras. Author of 'Deep Learning with Python'. Opinions are my own.
Jeff Dean (@🏡) @JeffDean
296K Followers 6K Following Chief Scientist, Google DeepMind and Google Research. Co-designer/implementor of things like @TensorFlow, MapReduce, Bigtable, Spanner, Gemini .. (he/him)
Horace He @cHHillee
23K Followers 449 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemale
Eric Jang @ericjang11
69K Followers 3K Following physical AGI at 1X. Author of "AI is Good for You" https://t.co/eFg4WXhg0p
Soumith Chintala @soumithchintala
186K Followers 877 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Karol Hausman @hausman_k
22K Followers 141 Following @Physical_int ex: researcher @GoogleAI/@DeepMind, adj. Prof. @Stanford. Into robots, AI, NBA, philosophy, soccer and almond croissants. 🇵🇱🇺🇸
James Bradbury @jekbradbury
11K Followers 8K Following Compute at @AnthropicAI! Previously JAX, TPUs, and LLMs at Google, MetaMind/@SFResearch, @Stanford Linguistics, @Caixin.
rohan anil @_arohan_
12K Followers 2K Following Principal Engineer, @GoogleDeepMind Gemini. prev PaLM-2. Tinkering with optimization and distributed systems. opinions are my own.
George Hotz 🌑 @realGeorgeHotz
248K Followers 174 Following President @comma_ai. Founder @__tinygrad__
Danny Crichton @DannyCrichton
13K Followers 678 Following Riskgaming @Lux_Capital, Fellow @ManhattanInst, former Managing Editor @TechCrunch. Analyzing tech, power, science, disasters, growth and startups.
Danielle Fong 💁�.. @DanielleFong
49K Followers 9K Following physics / AI / energy / art / realposting. 🏳️🌈/ally. cofounder, inventor, CEO, https://t.co/oSXgT0x7Mm "extraordinary alien" - US govt HIGH VOLUME ACCOUNT
Micah Hill-Smith @_micah_h
352 Followers 634 Following Founder @ArtificialAnlys. Also building https://t.co/8yATAy34wN. Previously @McKinsey.
kamilė @kamilelukosiute
219 Followers 88 Following where do we come from? what are we? where are we going?
Marcello Maggioni @Hayarms
200 Followers 474 Following @Google ML Compilers Formerly @Apple GPU Compilers and @codeplaysoft
Iason Gabriel @IasonGabriel
3K Followers 447 Following Philosopher & Research Scientist @GoogleDeepMind | Artificial Intelligence & Human Values | All views are my own | he/him
dan @dnschlz
1K Followers 283 Following podcast: https://t.co/JW9tDfSTz5 youtube: https://t.co/8AiyUuVTKM
Jan Leike @janleike
44K Followers 322 Following ML Researcher, co-leading Superalignment @OpenAI. Optimizing for a post-AGI future where humanity flourishes.
Max Sapozhnikov @iamdelamax
327 Followers 358 Following Sr PM at Google (Head of Growth for Cloud TPU). Angel investor. Stanford MBA/MS grad. All opinions are mine.
tylercowen @tylercowen
231K Followers 525 Following new book *Talent: How to Identify Energizers, Winners, and Creatives Around the World*, https://t.co/7bU5cUdOBc, Conversations with Tyler, Bloomberg Opinion.
udio @udiomusic
28K Followers 0 Following
Brydon Eastman @brhydon
878 Followers 728 Following Mathematician (Heavy on the ish) Research Scientist @OpenAI, Previously Ph.D. @WaterlooMath. ☕ //🚴//🧗♂️ // 🤔➡️💻
Joe Carlsmith @jkcarlsmith
4K Followers 305 Following Senior research analyst @open_phil. Opinions my own.
Chris Painter @ChrisPainterYup
791 Followers 1K Following Evals accelerationist, working on responsible scaling policies @METR_Evals
𝖦𝗋𝗂𝗆𝖾�.. @Grimezsz
1.4M Followers 2K Following
Karine Mellata @karinemellata
141 Followers 291 Following co-founder @ intrinsic (yc w23), previously @apple
Magic.dev @magicailabs
10K Followers 3 Following Magic is working on frontier-scale code models to build a coworker, not just a copilot. Come join us: https://t.co/hGZKtUzsR3
jack morris @jxmnop
10K Followers 761 Following getting my phd in nlp @cornell_tech 🚠 // academic optimist // tweeting from the snack aisle at trader joes
Irhum Shafkat @irhumshafkat
789 Followers 2K Following Mostly in the weird alleys where fields meet, trying to find the right questions
Cem Anil @cem__anil
2K Followers 1K Following Machine learning / AI Safety at @AnthropicAI and University of Toronto / Vector Institute. Prev. student researcher @google (Blueshift Team) and @nvidia.
Suraj Hanchinal @surajhanchinal
591 Followers 954 Following Building a kind of Virat Kohli at home. IIT Kanpur '20
Eric Vishria @ericvishria
15K Followers 1K Following @Benchmark. Investor & Director: @ConfluentInc @Amplitude_HQ @Contentful @CerebrasSystems @BlueHexagonAI @Benchling @CommerceLayer @acuitymd @AirplaneDev
Jordan Schneider @jordanschnyc
48K Followers 4K Following Newsletter: https://t.co/j23uuLxE59 join 35k readers Podcast: https://t.co/4sx8iev5Az Business partnerships: https://t.co/a8hYrI8Qde Fellow: @cnasdc
Tamay Besiroglu @tamaybes
3K Followers 720 Following Thinking about economics, computing and machine learning @EpochAIResearch @MIT_CSAIL
Nicole Marino @hypacianhere
55 Followers 215 Following I've been a biotech investor, a VC, a macro forecaster, a construction salesperson, and now I'm starting Hypacia to be even more confusing
MatX @MatXComputing
856 Followers 30 Following MatX designs hardware tailored for the world’s best AI models: We dedicate every transistor to maximizing performance for large models. Join us: https://t.co/E3XexKHUSM
Stephen Malina @an1lam
651 Followers 458 Following Wrangling AAV capsids for gene therapy with ML at @dyno_tx. Tweets/views are my own.
Andrew Côté @Andercot
64K Followers 1K Following engineering physicist, founder @hyperstition_x, scout @a16z, runs @TheAISalonSF, deep-tech, physics, energy and sci-fi 🇨🇦
The AI Salon @TheAISalonSF
2K Followers 4 Following The AI Salon hosts in-person conversations on the philosophical, sociological and cultural implications of artificial intelligence.
Rafi Witten @rafiwitten
197 Followers 123 Following Hyperscale Training @ Google Cloud TPU/GPU. Opinions my own
Ian Hogarth @soundboy
23K Followers 3K Following investor @pluralplatform; chair UK AI Safety Institute; co-author @stateofaireport; co-founder @songkick; chair @PhasecraftLtd
Clive Chan @itsclivetime
6K Followers 2K Following intelligence per picojoule @openai // prev dojo @tesla_ai raptor @spacex // proud sponsor of the 😌 emoji
Ravi Theja @ravithejads
3K Followers 672 Following Developer Advocate Engineer at @llama_index (LlamaIndex)
James Betker @neonbjb
2K Followers 6 Following
Jack Cook @jackcookjack
706 Followers 394 Following studying @oiioxford | formerly @mit, @nytimesrd, @nvidia, @microsoft
Listen along to our Hope Drop this month to @hannu, author of the Quantum Thief and co-founder of Helix Nanotechnologies, to discuss both sci-fi and frontier biotechnologies. His X-hope scenario? Preventing disease with Biotechnology. existentialhope.com/podcasts/hannu… @foresightinst
@_sholtodouglas @DanielleFong The tree will be primarily funded by personal injury lawyers and then the tech outsourced for free
🥳
Some small updates from the Anthropic Interpretability team: transformer-circuits.pub/2024/april-upd…
@DavidSHolz A few other suggestions off-the-cuff: Foundation series Moon is a Harsh Mistress and the first 2/3 of Stranger in a Strange Land Starhammer (partly inspired Halo) Stainless Steel Rat
The most impactful sci-fi stories I've ever read and you should read too: 1) Starmaker and Last and First Men by Olaf Stapleton Perhaps the most epic stories of all time told by the father of the science fiction genre himself. Starmaker traces the history and meaning of…
engaging seriously with any australian policy discourse is a mistake. the stakes are low, the chat is abysmal. time spent discussing negative gearing with 35yo sports gambling addicts in sharehousing is time you could be talking to hindu nationalists about evaporating karachi
Retrieval heads explains why the model hallucinate: when the model misses part of the information, the retrieval heads are not activated; when the model cannot find the needle and hallucinate completely, retrieval heads attend to dummy sink tokens.
google shareholders looking at ruth porat rn
My fav NASA paper is about self-replicating robot space economies that lead to 100,000x the industrial output of Earth within a century. A post-scarcity civilization is possible and even conservative given Starship & self-replicating synthetic biology to aid industrial processes
I have lost & made lifelong friends and enemies because of this. RISKGAMING - led by the brilliant @DannyCrichton. If you're interested in joining a run - send us a message.
It's a huge day @Lux_Capital – we're officially launching Riskgaming! For a year, we've been developing four scenarios around climate change, national security, China, AI, election security and other topics. Now, we're finally making the first of these scenarios public
It's a huge day @Lux_Capital – we're officially launching Riskgaming! For a year, we've been developing four scenarios around climate change, national security, China, AI, election security and other topics. Now, we're finally making the first of these scenarios public
Excited to announce we've raised 62.7M$ at 1.04B$ valuation, led by Daniel Gross, along with Stan Druckenmiller, NVIDIA, Jeff Bezos, Tobi Lutke, Garry Tan, Andrej Karpathy, Dylan Field, Elad Gil, Nat Friedman, IVP, NEA, Jakob Uszkoreit, Naval Ravikant, Brad Gerstner, and Lip-Bu…
Thanks to the @LRB for publishing my letter in defense of @Waymo (and, more broadly, the spirit of Silicon Valley). But I do like my title better: avitalbalwit.com/post/on-being-…
and now for another episode of late night midjourney generations "a san francisco victorian with walls made of solar cells"
Last 28 days 🤯 While the Zuck & Trenton/Sholto episodes are doing extremely well on YouTube, what I'm proudest of is that most of these views are actually from Sarah Paine content! She is one of the greatest living historians, but her work wasn't really publicly well known…
san francisco is the greatest city in the world and the spiritual center of western civilization
you are unwilling to have your car be broken into four weeks in a row for a chance at the future, and that’s why nobody will remember your names
Trends for United States
You might like
