Tim Zaman @tim_zaman
AI at Google DeepMind. callsign PD4TA. Previously Tesla, X/Twitter (head of AI Infra), NVIDIA. timzaman.com San Francisco, CA Joined June 2010-
Tweets537
-
Followers20K
-
Following103
-
Likes2K
Grok 1.5 announcement includes the examples that made me feel like self-driving can eventually be done (better) as a subset of a more generic AI, eg a multimodal LLM as shown here. When I was at Autopilot, this made me feel a bit worried. Such models can do examples like the…
Grok 1.5 announcement includes the examples that made me feel like self-driving can eventually be done (better) as a subset of a more generic AI, eg a multimodal LLM as shown here. When I was at Autopilot, this made me feel a bit worried. Such models can do examples like the… https://t.co/IJivRUMo0z
Google's coding ecosystem is truly fantastic. The way its components dovetail into each-other is quite remarkable, and oddly intuitive for a complex system. Makes GitHub feel like a git-wrapper, even though i love that too. Lots of opportunity for innovation here. Things like…
Zombie apocalypse. No internet; off-grid with just your laptop. Would you rather have installed:
Congrats to SpaceX team, what a fantastic and inspirational achievement.
Congrats to SpaceX team, what a fantastic and inspirational achievement.
There is probably more to it. I pulled two 2x4s (dont get me started - modern "2x4s" measure 1.5x3.5 inches) from my 1880s barn in south bay. I think it's just survivorship bias that we think old wood is so good. And yes, I am planning to become a wood restorer post-singularity.
There is probably more to it. I pulled two 2x4s (dont get me started - modern "2x4s" measure 1.5x3.5 inches) from my 1880s barn in south bay. I think it's just survivorship bias that we think old wood is so good. And yes, I am planning to become a wood restorer post-singularity. https://t.co/SmEvwZknvv
We are releasing a first set of new models for the open community of developers and researchers.
RIP TOP500. No one submits anymore, eg this 4.6k gpu (small) cluster is #9.. Kind of sad bc it is such an awesome hw/sw systems challenge.
RIP TOP500. No one submits anymore, eg this 4.6k gpu (small) cluster is #9.. Kind of sad bc it is such an awesome hw/sw systems challenge.
Bard (the product) is now Gemini. Gemini Advanced is powered by the Gemini Ultra 1.0 model, our most advanced multimodal model. Congrats to everyone who worked on this effort, including the Bard and Gemini teams! Lots more updates in the blog post! blog.google/products/gemin…
Bard, powered by the Gemini Pro-scale model, debuts at the #2 position on the independent lmsys leaderboard. 🔥 Give it a try at bard.google.com. Bard is much better & has many more capabilities since its debut in March, thanks to everyone on the Bard/Gemini teams!
Bard, powered by the Gemini Pro-scale model, debuts at the #2 position on the independent lmsys leaderboard. 🔥 Give it a try at bard.google.com. Bard is much better & has many more capabilities since its debut in March, thanks to everyone on the Bard/Gemini teams!
If you look closely, the last few characters are #pylint: disable=line-too-long
PyTorch's design origins, its connection to Lua, its intertwined deep connection to JAX, its symbiotic connection to Chainer The groundwork for PyTorch originally started in early 2016, online, among a band of Torch7's contributors. Torch7 (~2010-2017) These days, we also…
Personal news - Joined NVIDIA in 2016, and Tesla in 2019. Like family, I never thought I'd leave. My intuition pulls me to my next venture, that has the ingredients to change the world - again. I'm joining Google DeepMind this Monday. Excited to be a kid among legends!
Mathias Føns @FonsDK
32K Followers 334 Following Strategy @Shift4. Passionate about Space, EVs & Integrated Commerce. Opinions are my own, NFAChuck Cook @chazman
47K Followers 1K Following USNavy CDR S3 Viking, A321 Captain, OG FSDβ, @NavalAcademy Aero Engr, Developer, Arborist, Beekeeper, Aquaponics, Keto Coach, see my https://t.co/G841drcL9GALEX @ajtourville
58K Followers 347 Following Physics engineer here for the progress of disruptive innovations and ventures Elon Musk picked my 𝕏 logo design for 𝕏 All-in $TSLA since 08/2019Dirty Tesla @DirtyTesLa
98K Followers 1K Following YouTube and Merch: https://t.co/xDxdMQtRrJ MS, Biology; Anti-sleep AiBradford Ferguson @bradsferguson
28K Followers 219 Following Rebellionaire | World-first, unique, balanced Tesla research | AI & Technology | Lightning in a bottle catcher x4 $TSLA NVIDIA, Aehr, Lilly ⚡️⚡️⚡️⚡️ | 🔋🕵🏻♂️Mayur मयूर Th.. @freshjiva
27K Followers 698 Following Chartered Financial Analyst. Cycling. Eastern spirituality. Drumming. Veganism. ROIC investing. Indian classical music.Tesla Facts @truth_tesla
49K Followers 398 Following Spreading Tesla facts, countering disinformation. Tesla fan account.Drive Tesla 🇨🇦 @DriveTeslaca
55K Followers 2K Following Canada’s #1 source for Tesla, EV, and Elon Musk news (not affiliated with Tesla)THE ACCOUNTANT @CPAinNYC
13K Followers 486 Following Providing Tesla Financial Data & Analysis. $TSLA ShareholderTasha Keeney @TashaARK
206K Followers 535 Following Director of Investment Analysis & Institutional Strategies @ARKInvest. Also cover things that fly, roll, and manufacture. Disclosure https://t.co/CfmviBEuqwThe Kilowatts 🚗⚡.. @klwtts
60K Followers 3K Following The best cars are electric. We make videos about EVs and share our EVs on @Turo and soon @DispatchEV 👀Doctor Jack @DoctorJack16
34K Followers 2K Following Tesla, SpaceX, emerging tech, health, positivity/mindset, & sharing of useful knowledge. 😊 All tweets are not medical nor financial advice.Larry Goldberg @TeslaLarry
21K Followers 444 Following Serial entrepreneur, angel investor, co-inventor/co-author of the book “The Decision Model”, a normalized, business-friendly model of logic.DrKnowItAll @DrKnowItAll16
52K Followers 1K Following YouTube channel on Tesla, AI, etc. UGA professor. CEO of https://t.co/Kq9SjojMIz. Biological AI Bootloader. Call me John.Chris Zheng @ChrisZheng001
11K Followers 609 Following Creative content creator I Team player I Love and kindness I CTO :)Jay in Shanghai 电�.. @JayinShanghai
24K Followers 2K Following Tesla Model S Owner - Founder of Tesla Expat Owners Club in China. Influencer and Video Content Creator. Manager at Asia’s Insurance Brokerage!Jeff Lutz 🔋 @thejefflutz
25K Followers 2K Following CEO,Launch i/o,Inc. Scale & Cost @ escape velocity partnering w/megacap tech. Ex CVP Supply Chain & CQO @Motorola, @Google, @Lenovo. @Tesla #MSPlaid #MXPlaidRoy Giladi @roy93879
0 Followers 54 FollowingMark Miller @mark_miller02
114 Followers 323 FollowingMishel Kadovitz @MishelKadovitz
9 Followers 81 FollowingShoval Inv @InvShoval21458
12 Followers 118 Followinghuansong @huansong514
7 Followers 137 FollowingJustin Cayce 𝕏™ .. @justincayce
21 Followers 148 Following Zen master Π (Grade: Aware I'm Unaware) / Poet philosopher ⏃ (Grade: unaware I'm unaware) / Comedian ( Grade: I'm only joking... 𓂀 ¿⸮؟? ⦿ ◦ ⦾ ‣ ⦿ ◦ ■ 𝕏🔴ⵁøRoy Zhao @RoyZhao23524401
5 Followers 93 FollowingDana Mahmood @deordered
9 Followers 650 Following Fine-tuning AI models oftentimes & practicing philosopher at other times.Sun H. Park @sunhueng
63 Followers 384 Following Ph.D. in gifted education/teacher/guzheng/tesla MYRCourtenay @courtenay100
148 Followers 1K FollowingNicholas J. Nicastro @donniccolo
5K Followers 3K Following Devoted dad | Aspiring stoic | Early Tesla investor & #FSDBeta tester | Insights on Real Estate investment for wealth & freedom 🏡 #ButFreedom | #100Yearskelemensandormark @kelemensandorm1
8 Followers 142 FollowingJV Clark @JVClark2
2K Followers 4K Following Keto/carnivore intermittent faster. SpaceX and Tesla fan w/FSDV12 in my Tesla Y. Independent, retired veteran, small business owner.Marco Xiong @marcoxiong
0 Followers 28 FollowingLaura Liu @lauraqq
21 Followers 379 FollowingCyberG @Cyber1_0
13 Followers 125 Following€ryptofever ⚡️ @Cryptofevah
21 Followers 271 Following Proud survivor of the weak hands massacre of Q1 2018pik naknik @PNaknik
73 Followers 62 FollowingElonX Project @ElonXproject5
101 Followers 3K Following This is not a Duplicate nor Parody Page❕ Management account with EVERYTHING ELON MUSK(project and Progress)Nuno da Silva @NunodaS87444323
21 Followers 138 Followingmrtnzrws @ZwsMn
49 Followers 339 FollowingDevin Fraze @DevinFraze
158 Followers 243 Following I am a student of the world studying mathematics, love, and life. I aspire to help others on their personal educational journey as a teacher and a learner.Nag Murty @MurtyNag
801 Followers 712 Following Founder/CEO at @sheeprobotics - robot caretakers for our planet. Was co-founder/CTO @EmbraceInnov where i built tech that has saved 500,000 lives till date.Lorenz Pichler @AUTLP1
5 Followers 34 FollowingJose Lois Malkun @malkun_lois
673 Followers 2K Following Ex Ministro de Hacienda y Ex Gobernador del Banco Central 65 años de experiencia profesional en el sector publico y privado y 11 años en el BID en centroamericagarysun @olderhammer
11 Followers 891 Followingzero-zero @_zero___zero_
40 Followers 377 FollowingXerophinity @xerophinity
84 Followers 250 FollowingGabriel Grant @gbgrant
565 Followers 802 Following Dad, Husband, Culture Consultant, Coach, & Author. Check out my new book - Breaking Through Gridlock #BreakingGridlockHansheng Wang @HappySugarWang
2 Followers 32 FollowingJackson @Jackson35883938
317 Followers 1K Following A value-growth Investor for Tesla, BYD, Google & others! Buy if undervalue & aim 3-10X return in long run. (All tweets is just my view not financial advice)James Brewer @JamesMi71990716
243 Followers 423 Followingmay @xun012
2 Followers 232 FollowingÖÖ @GrandNagus_
23 Followers 116 FollowingJeff Yu @jeffyuchang
177 Followers 488 FollowingJohn Hutchinson @aphutch3
220 Followers 3K FollowingVladi Lutay @LutayVladi0307
37 Followers 56 Followingmike017 @crypto_mike017
751 Followers 5K Following Me all in Crypto $KISHU 🐶 $ETH 🪙 Stock $TSLA 🚘 $MSFT 💻 NFT #ApeKidsClub 🐵 #KittyCryptoGang 😼Clive Chan @itsclivetime
6K Followers 2K Following intelligence per picojoule @openai // prev dojo @tesla_ai raptor @spacex // proud sponsor of the 😌 emojiSholto Douglas @_sholtodouglas
15K Followers 857 Following Scaling Gemini @Deepmind - working towards intelligence too cheap to meterRoy Frostig @froystig
1K Followers 501 Following research scientist at @googledeepmind. co-author of JAX (https://t.co/TaE9kvzZMa)Matthew Johnson @SingularMattrix
12K Followers 3K Following Researcher at Google Brain. I work on JAX (https://t.co/UGa5tGfinF).Joost van Amersfoort @joost_v_amersf
1K Followers 338 Following Research Scientist @GoogleDeepMind -- PhD from @UniofOxford Large language model pre-training in the Gemini team.Yann LeCun @ylecun
711K Followers 718 Following Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.Jessica Livingston @jesslivingston
92K Followers 83 Following Cofounder, Y Combinator; Author, Founders at Work; Host, The Social Radars podcast.AGI House @agihouse_org
13K Followers 412 Following Accelerating humanity's transition to AGI & honoring the greatest AI founders and researchers of our time @ https://t.co/1lJUc58gZJSebastian Borgeaud @borgeaud_s
994 Followers 259 Following Research Engineer at DeepMind with a focus on Large Language Models and large scale Deep LearningPaul Graham @paulg
1.9M Followers 772 FollowingVesuvius Challenge @scrollprize
3K Followers 0 Following The Vesuvius Challenge is a machine learning and computer vision competition to read the Herculaneum Papyri.Sander Dieleman @sedielem
50K Followers 2K Following Research Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).Lucas Beyer (bl16) @giffmana
56K Followers 445 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected]koray kavukcuoglu @koraykv
8K Followers 84 Following VP of Research and Technology at Google DeepMindOriol Vinyals @OriolVinyalsML
166K Followers 82 Following VP of Research & Deep Learning Lead, Google DeepMind. Gemini co-lead. Past: AlphaStar, AlphaFold, AlphaCode, WaveNet, seq2seq, distillation, TF.Scott Gray @scottgray76
7K Followers 481 Following GPU Geek at @OpenAI. I have a long standing interest in neuroscience and its application to machine learning. He/Him.Shane Legg @ShaneLegg
51K Followers 57 Following Co-founder and Chief AGI Scientist, Google DeepMindGuido van Rossum @gvanrossum
290K Followers 494 Following Python's BDFL-emeritus, Distinguished Engineer at Microsoft, Computer History Fellow, fully vaccinated. Opinions are my own. He/him.Google DeepMind @GoogleDeepMind
943K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.Peilin Yang @PeilinYang
2K Followers 557 FollowingShivon Zilis @shivon
123K Followers 2K Following Artificial intelligence, biological intelligence, and whatever exists in between and beyond. Made in Canada.Jim Keller @jimkxa
34K Followers 134 Following CEO @tenstorrent, Cofounder @atomic_semi @BayaSystems and FlexAI board member. Fan of 2x2 matrixes, books, refactoring and creative tensionxAI @xai
997K Followers 36 FollowingAdam Raudonis @adamraudonis
760 Followers 823 Following Software @ Tesla Autopilot & Optimus. Interested in clean tech, space and AILars @larsmoravy
21K Followers 12 Followingthe tiny corp @__tinygrad__
33K Followers 63 Following We make tinygrad. Our mission is to commoditize the petaflop.Tesla AI @Tesla_AI
149K Followers 14 Following Developing & deploying autonomy at scale in vehicles, robots & moreCeb @Ceb
242K Followers 616 Following 🇱🇧/🇫🇷 Kich 'Ceb'. Back to back winner of The International (2018/2019) also few majors, Founder @OGesports business inquiries : [email protected]George Hotz 🌑 @realGeorgeHotz
248K Followers 174 Following President @comma_ai. Founder @__tinygrad__Stephen Wolfram @stephen_wolfram
149K Followers 4 Following Creating ideas, technology, science, companies, books, ... #WolfLang #WolframPhysics #WolframAlpha #Mathematica @WolframResearchDemis Hassabis @demishassabis
356K Followers 125 Following Co-founder & CEO @GoogleDeepMind - working on AGI. Trying to understand the fundamental nature of reality. Also revolutionising drug discovery @IsomorphicLabsAndree Jacobson @nmswede
1K Followers 751 Following Leading efforts @X to make HPC and AI compute the best they can be. (Ex-Supermicro, Tesla, New Mexico Consortium, University of New Mexico). Views are my own.Baby Smurf @babysmurf9000
14K Followers 69 FollowingThomas D. @ThomasAlxDmy
1K Followers 270 Following Free Speech Advocate - Sustainability warrior - Passionate engineer. Crisis births leaders: be the changing factor; follow your heart and trust your beliefs.Cody @CodysLab
43K Followers 106 FollowingIncredible Starlink ad
Incredible tornado intercept just now north of Lincoln Nebraska!! @ryanhallyall @SevereStudios
And that's a wrap.
our winter engineering interns have entered the chat
@zen__kino Personally I never use black and I think it looks super ugly and it takes away creative freedom of the programmer to make their code nice and readable and understandable semantically to other humans. Many people disagree that's fine.
@__tinygrad__ @ElonBaldMusk [gif] me trying to read tinygrad code earlier :D I think the LOC requirements (which are only a proxy for simplicity) led to too great compression. You wouldn't brag about your .min.js code being 1 LOC. Imo it would be a lot more simple if the code was given room to breathe and…
First @nvidia DGX H200 in the world, hand-delivered to OpenAI and dedicated by Jensen "to advance AI, computing, and humanity":
@paulg @markessien so many past experiences make sense now
Gemini 1.5 Pro has entered the (LMSys) Arena! Some highlights: -The only "mid" tier model at the highest level alongside "top" tier models from OpenAI and Anthropic ♊️ -The model excels at multimodal, and long context (not measured here) 🐍 -This model is also state-of-the-art…
More exciting news today -- Gemini 1.5 Pro result is out! Gemini 1.5 Pro API-0409-preview now achieves #2 on the leaderboard, surpassing #3 GPT4-0125-preview to almost top-1! Gemini shows even stronger performance on longer prompts, in which it ranks joint #1 with the latest…
Llama3-70B has settled at #5. With 405B still to come next... I remember when GPT-4 released in March 2023, it looked like it was nearly-impossible to get to the same performance. Since then, I've seen @Ahmad_Al_Dahle and the rest of the GenAI org in a chaotic rise to focus,…
Exciting update -- Llama-3 full result is out, now reaching top-5 on the Arena leaderboard🔥 We've got stable enough CIs with over 12K votes. No question now Llama-3 70B is the new king of open model. Its powerful 8B variant has also surpassed many larger-size models. What an…
This hits home pretty hard... linkedin.com/posts/matthew-…
@scottgray76 @karpathy I don’t think this is necessary for the sizes he’s looking at - the rows are small enough that you can just persist the entire row in registers.
@cHHillee @scottgray76 We want to do a full GPT-2 repro, at channel size 1600 this is 2.1X higher C. And we'll want to ~max out batch dim to fit in memory too. So the "easy times" will be over soon.
@karpathy @scottgray76 Even at 1600 you can persist the entire row in SRAM at once. I think it typically needs to be around 8k+ elements in a single row before you’re unable to persist the row in SRAM. The batch dim doesn’t affect this as you can launch one block per “batch element”
@scottgray76 @karpathy Ah I misunderstood. I thought you were recommending "Use mean(x^2) - mean(x)^2 so that you can compute it in a single pass". On a side note, my understanding was that this is fairly numerically unstable, no?
@jeremyphoward @soumithchintala Absolutely! I remember this call! One of the things I learned quickly as an exec is that "getting the true story" was always very challenging as everyone wanted to manage me! One of the many reasons I love open source is it doesn't give a damn about org charts!