Clive Chan @itsclivetime
intelligence per picojoule @openai // prev dojo @tesla_ai raptor @spacex // proud sponsor of the 😌 emoji clive.io California, USA Joined May 2012-
Tweets996
-
Followers6K
-
Following2K
-
Likes7K
Many don't know that GPUs automatically leverage ternary and fine-grained sparsity to accelerate your matmuls! e.g. A matmul with ternary + 90% sparsity results in 33% more FLOPs in my benchmark. (not joking) I explore this "optimization" here: thonking.ai/p/strangely-ma… (1/3)
I've spent the past ~2 weeks building a GPU from scratch with no prior experience. It was way harder than I expected. Progress tracker in thread (coolest stuff at the end)👇
brrrrrrrrrrrrrrrrrrrr
TorchDispatchMode is my favorite part of PyTorch - can implement some insanely powerful stuff really easily in Python-land
TorchDispatchMode is my favorite part of PyTorch - can implement some insanely powerful stuff really easily in Python-land
This hits home pretty hard... linkedin.com/posts/matthew-…
Just had a verbal lesson with an expert level tutor (ChatGPT) while my chauffeur (Autopilot) drove me to lunch What a time to be alive
It’s such a great time to be a dev. It literally takes like 2 days to design chip, tokenization is a single line of code, and you can use a responsive pre-made library to design your website. This is a cornucopia for builders.
Chips chips chips @zodattack @itsclivetime
i'm still not sure how well lmsys replicates the distribution of real usecases, but this analysis is insightful!
i'm still not sure how well lmsys replicates the distribution of real usecases, but this analysis is insightful!
Majorly improved GPT-4 Turbo model available now in the API and rolling out in ChatGPT.
Majorly improved GPT-4 Turbo model available now in the API and rolling out in ChatGPT.
yo wow this is really impressive 🔥
Have you ever wanted to train LLMs in pure C without 245MB of PyTorch and 107MB of cPython? No? Well now you can! With llm.c: github.com/karpathy/llm.c To start, implements GPT-2 training on CPU/fp32 in only ~1,000 lines of clean code. It compiles and runs instantly, and exactly…
let's goooo (trying to download 12.3 on MVWifi right now)
"biggest earthquake in 25 years" "nine people have died, and 1,011 have reported injuries" "Taiwan Semiconductor Manufacturing Co. said it expects to resume production overnight" i have so much respect for tsmc engineers
It is the beginning of the end!
woah former vp product for cruise likes it vision only end to end self driving is so here
Whole Mars Catalog (S.. @WholeMarsBlog
458K Followers 24K Following Covering tech, markets, AI, new energy, and autonomous electric vehicles 24/7Andrej Karpathy @karpathy
979K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥Dave Lee @heydave7
450K Followers 454 Following Host of YouTube channel Dave Lee on Investing, TSLA investor since 2012, building with AI.Chuck Cook @chazman
47K Followers 1K Following USNavy CDR S3 Viking, A321 Captain, OG FSDβ, @NavalAcademy Aero Engr, Developer, Arborist, Beekeeper, Aquaponics, Keto Coach, see my https://t.co/G841drcL9GK10✨ @Kristennetten
159K Followers 6K Following At the foot of the mountain .. though not verifiable 🚘 Tesla is ♥️ Earth 🍀Spacex 🚀 • Third Row Founder • FSDBeta Tester 2020Dirty Tesla @DirtyTesLa
99K Followers 1K Following YouTube and Merch: https://t.co/xDxdMQtRrJ MS, Biology; Anti-sleep AiDrive Tesla 🇨🇦 @DriveTeslaca
55K Followers 2K Following Canada’s #1 source for Tesla, EV, and Elon Musk news (not affiliated with Tesla)Robert Scoble @Scobleizer
504K Followers 68K Following Follow me on my new podcast with AI startups, Unaligned. Tech industry color commentator since 1993. Author/Blogger. Former strategist @Microsoft.Warren Redlich - Chas.. @WR4NYGov
74K Followers 2K Following Dad, tech enthusiast & libertarian Florida Man retraining my nomad neural nets on the Thai and Asia datasetsTim Zaman @tim_zaman
20K Followers 102 Following AI at Google DeepMind. callsign PD4TA. Previously Tesla, X/Twitter (head of AI Infra), NVIDIA.The Kilowatts 🚗⚡.. @klwtts
60K Followers 3K Following The best cars are electric. We make videos about EVs and share our EVs on @Turo and soon @DispatchEV 👀Chris Zheng @ChrisZheng001
12K Followers 609 Following Creative content creator I Team player I Love and kindness I CTO :)DrKnowItAll @DrKnowItAll16
52K Followers 1K Following YouTube channel on Tesla, AI, etc. UGA professor. CEO of https://t.co/Kq9SjojMIz. Biological AI Bootloader. Call me John.MilMileBattery @MilMileBattery
10K Followers 2K FollowingLinda Carson @LindaCa64814194
63 Followers 1K FollowingPeripety Labs @peripety_labs
383 Followers 2K Following Artificial Intelligence consultancy. Founded by tech executive, @mrhinkle, subscribe to our newsletter The Artificially Intelligent Enterprise for AI insightsmike017 @crypto_mike017
755 Followers 5K Following Me all in Crypto $KISHU 🐶 $ETH 🪙 Stock $TSLA 🚘 $MSFT 💻 NFT #ApeKidsClub 🐵 #KittyCryptoGang 😼Stefan Juang @StefanJuang
147 Followers 1K Following The final goal of AI is not just to create intelligent machines, but to understand intelligence itself.Electronicsseeker @libertarian108
10 Followers 1K FollowingChaos Song @song_chaos2243
187 Followers 4K FollowingRitaBert @4W0GIoV8kUO781
0 Followers 85 FollowingSabinaDickey @MViis6536wLqo
2 Followers 176 FollowingSoasli @Soasli2lxw2rz
0 Followers 68 FollowingDhruv Charne @CharneDhruv
0 Followers 133 FollowingSkully Turing — e/a.. @SkullyTuring
50 Followers 207 Following prime accelerator & e/acc evangelist // entropy wrangler // cosmic energy harvester // AI whisperer // constructing SingularitySurferValentinaEffie @C65s5313lx797a
0 Followers 181 Followingedwardtsai - Edward T.. @edwardtsai
215 Followers 700 Following Managing Partner at Alumni Ventures / Westwood Ventures. Prior deals: Cruise, Brave, Palantir, Life360. Prior LP/LPAC: TenEleven, CendanaCourtenay @courtenay100
136 Followers 1K FollowingKShivendu | Qdrant �.. @KShivendu_
828 Followers 725 Following making @qdrant_engine faster 🦀 · I talk about search, data, and tools · DM for advice on RAG 🦙Jackson M. @JM3348
23 Followers 734 Following To become a member with discounted commission rates BinanceAryan @takeitasjoke
14 Followers 65 Following ! science📑 fiction is where Radical ideas are born, into tech because I am MATHS nerd!emi learns @ml_emiii
7 Followers 104 Following learning llm engineering and advanced/concurrent typescript/js from ground up before @elicitorg internshipWesley Dodds @WesleyDodds5
220 Followers 893 Following Dad, Husband, 49ers fan, Tesla & Space X fan!Eason @Eason89506821
38 Followers 291 FollowingAjay Sridhar @ajaysridhar0
7 Followers 100 FollowingLina Vera @LVera39600
169 Followers 3K FollowingGurkirat singh @gurkirat_7
40 Followers 932 FollowingPavan Jayasinha @pavanjayasinha
383 Followers 383 Following ML + quantum // sophomore ECE uwaterloo // prev: @extropic_ai, @UntetherAI, @QuantumIQC, @ZapataComputingAli Qajar @AliQajar
19 Followers 339 FollowingFantastic_618 @Fantastic68190
26 Followers 982 Followingadammaj @MajmudarAdam
8K Followers 201 Following founding engineer @thirdweb // cs + neuro (on gap) @PennAaron Chan @AChan14994
0 Followers 10 Following🌎 @ascetic_one
29 Followers 366 FollowingAbdulrahman Tabaza @embed_dim
4 Followers 799 Following enjoyer of various vector spaces, encoders and modalitiesSuraj K @SurajKbusiness
2 Followers 64 Following Founder & CEO, AI Storeroom Mail Id: [email protected]年孟 @c1gFE6DKJ9gtOeX
47 Followers 420 FollowingMarco @rugnasyab
25 Followers 298 Following Building a business. Formerly enslaved by Excel & PowerPoint (investment banking escapee). Interested in AI, start-ups, MMA & philosophy.RJ Sekator @RjSekator
78 Followers 837 Followingdev potatopotato @devpotatopotato
3 Followers 140 Following CS student in Seoul National University. Passionate about AGI.Whole Mars Catalog (S.. @WholeMarsBlog
458K Followers 24K Following Covering tech, markets, AI, new energy, and autonomous electric vehicles 24/7Andrej Karpathy @karpathy
979K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥Dave Lee @heydave7
450K Followers 454 Following Host of YouTube channel Dave Lee on Investing, TSLA investor since 2012, building with AI.Pierre Ferragu @p_ferragu
93K Followers 61 Following Commenting on technology - no investment recommendations.Chuck Cook @chazman
47K Followers 1K Following USNavy CDR S3 Viking, A321 Captain, OG FSDβ, @NavalAcademy Aero Engr, Developer, Arborist, Beekeeper, Aquaponics, Keto Coach, see my https://t.co/G841drcL9GNeuralink @neuralink
1.4M Followers 1 Following Creating a general-purpose, high-bandwidth interface to the brainThe Limiting Factor @LimitingThe
45K Followers 873 Following A mustache on a mission: What's next in battery and manufacturing technology? https://t.co/hN3JngjtC6Robert Scoble @Scobleizer
504K Followers 68K Following Follow me on my new podcast with AI startups, Unaligned. Tech industry color commentator since 1993. Author/Blogger. Former strategist @Microsoft.green @greentheonly
74K Followers 0 Following I report what I see. If it's good, it's good; if it's bad, it's bad. Does not depend on me. Make them release more awesome stuff. Don't shoot the messenger.Tim Zaman @tim_zaman
20K Followers 102 Following AI at Google DeepMind. callsign PD4TA. Previously Tesla, X/Twitter (head of AI Infra), NVIDIA.DrKnowItAll @DrKnowItAll16
52K Followers 1K Following YouTube channel on Tesla, AI, etc. UGA professor. CEO of https://t.co/Kq9SjojMIz. Biological AI Bootloader. Call me John.comma @comma_ai
83K Followers 37 Following openpilot can drive for hours without driver action and works on 250+ cars like Hyundai & Toyota. See if your car is compatible at https://t.co/YQYNZrCxanTom Mueller @lrocket
68K Followers 288 Following Liquid rocket engine development, racecar driver, grandfather, CEO and CTO at Impulse https://t.co/XBThLja8eLGraphcore Research @GCResearchTeam
72 Followers 61 Following Our mission is to follow and contribute to the advancement of AI research, aiming to characterise the computational requirements of machine intelligence.Omar Sanseviero @osanseviero
32K Followers 2K Following Chief Llama Officer @huggingface 🦙 Founder @AI_Learners. Xoogler (SWE @Google Assistant, 20% PM TF Graphics). 100% Hacker Llama🇵🇪🇲🇽Physical Review Lette.. @PhysRevLett
61K Followers 190 Following Flagship journal of the nonprofit APS. The most cited physics journal, publishing Letters which substantially move physics forward.Kilian Haefeli @khshind
233 Followers 344 Following Exploring crevasses of Deep Learning at ETH Zurich & UofT | Previously: @Aleph__Alpha, @Logitech, and exfounder at AiricaRoberto Nickson @rpnickson
47K Followers 2K Following Husband. Father. Builder of things and maker of videos for the Internet. On a mission.neural oscillator of .. @mycoliza
19K Followers 1K Following 𓃭𓇋𓊃𓄿𓁐 • manic kernel dream girl • putting computers inside other computers at @oxidecomputer • @tokio_rs core team • nulla crux, nulla coronaOxide Computer Compan.. @oxidecomputer
22K Followers 35 Following Servers as they should be. Mastodon: @[email protected] Bluesky: @oxidecomputer.bsky.socialJacob Austin @jacobaustin132
3K Followers 798 Following @Google @DeepMind researcher. AI for math and science. Coding. Gemini. I also play piano. NYC. Opinions my ownzoda @zodattack
1K Followers 702 Following step lightly and go far, there is goodness to be relished.Patricia Mou @patriciamou_
31K Followers 483 Following souls, spaces, society. co-founder @thesfcommons, curates @rabbitholes_, writing https://t.co/YnfgkSWURoHao Liu @haoliuhl
4K Followers 155 Following phd student @berkeley_ai https://t.co/ZNJawlrerS machine learning, neural networks.Joey (e/λ) @shxf0072
2K Followers 388 Following I speak fluent Python and Sarcasm. researcher at @NousResearchLightOn @LightOnIO
3K Followers 815 Following LightOn unlocks business productivity through Paradigm. A turnkey AI platform, using the stunning power of Large Language Models. Newsletter: https://t.co/zsxcFkWnBtadammaj @MajmudarAdam
8K Followers 201 Following founding engineer @thirdweb // cs + neuro (on gap) @PennTaelin @VictorTaelin
17K Followers 902 Following Founder of @HigherOrderComp Building the massively parallel future of computing Reaching AGI to cure all diseases and suffering is all that mattersTyler Bruno @tylerbruno05
891 Followers 415 Following CS/AI Undergrad at @dartmouth. Transforming curiosity into actions in pursuit of a better world.Jay Parikh @jayparikh
3K Followers 1K FollowingEpoch AI @EpochAIResearch
3K Followers 24 Following Epoch AI is a research institute investigating the trajectory of AI for the benefit of society.vLLM @vllm_project
777 Followers 11 Following A high-throughput and memory-efficient inference and serving engine for LLMsRohan Patel @rohanspatel
30K Followers 2K Following Tesla Policy and Bizdev. Fmr Special Asst to @potus44 and senior advisor for climate policy. Elkhart, IN born and raised.James Hensman @jameshensman
7K Followers 2K Following Machine learner. Building big Bayesian models @microsoft. Views my own. he/him.Max Croci @max_croci
125 Followers 240 Following Postdoc @MSFTResearch researching transformer compression. Previously: PhD @Cambridge_Uni.Saleh Ashkboos @AshkboosSaleh
546 Followers 285 Following Intern at @Apple | PhD Student at @spcl_eth, focused on High-Performance Computing and Large Scale Deep Learning | Prev. intern at @Microsoft and @MSFTResearchJustine Tunney @JustineTunney
33K Followers 274 Following I built a C library that lets you compile 12kb static binaries that run natively on Linux, Mac, Windows, FreeBSD, OpenBSD, NetBSD and BIOS using just GCC/Clang.Aaron Defazio @aaron_defazio
6K Followers 364 Following Research Scientist at Meta working on optimization. Fundamental AI Research (FAIR) teamHyperstition, Inc @hyperstition_x
4K Followers 1 Following The future is forged by the hammer of cognition against the anvil of creation.Mike Gunter @MikeGunter_
651 Followers 851 Following CTO and founder, @MatXComputing, designing hardware to make LLMs an order of magnitude smarter.Avinash Mani @AvinashGMani
86 Followers 68 Following building silicon and systems for a performant and sustainable GenAI and AGI future @MatXComputingMatX @MatXComputing
859 Followers 30 Following MatX designs hardware tailored for the world’s best AI models: We dedicate every transistor to maximizing performance for large models. Join us: https://t.co/E3XexKHUSMLighthouse @lighthousehq_
531 Followers 4 Following Betting on America 🇺🇸 We help the world's best and brightest get a US work visa, fast, so you can get back to buildingNeel Nanda @NeelNanda5
13K Followers 89 Following Mechanistic Interpretability lead @DeepMind. Formerly @AnthropicAI, independent. In this to reduce AI X-risk. Neural networks can be understood, let's go do it!Tarek Ayed @tarekayed00
176 Followers 326 Following Data Scientist | I try to mostly share value adding posts from experts | deep learning and tech stuff | 🇫🇷 | @sicara_frSicara @sicara_fr
4K Followers 1K Following #Deeptech company specialized in #Data & #IA You want to read articles written by our Data Scientists ? 🤖 Visit ➡️ https://t.co/N9Vpc3SeeHDanielle Baskin @djbaskin
24K Followers 1K Following Tarot technology, interactive performances, and pixel art 💫. Play with our platform https://t.co/LnDdQyf3hm! 🌙 Prev built Dialup, Maskalike, & Branded Fruit 🐍Open Compute Project @OpenComputePrj
9K Followers 205 Following OCP's mission to apply the benefits of open source and open collaboration to hardware and rapidly increase the pace of innovation in the data center.Aurora @vyndiction
3 Followers 34 FollowingBrandon McKinzie @mckbrando
2K Followers 2K Following Multimodal LLMs @Apple. Prev: Physics/CS @UCBerkeley.phil hedayatnia @PhilHedayatnia
3K Followers 1K Following cofounder 🛫 @airfoilstudio, scaling sg startups 🇸🇬 @sgbuidl. prev @southpkcommons @beondeck @trustedfor_ (YC S19)Cyan Banister @cyantist
59K Followers 3K Following Investor at Long Journey Ventures, artist, joy amplifier. subscription fees go to Inflection Grants: https://t.co/uSqtEEfUf3Physical Intelligence @physical_int
4K Followers 8 Following Physical Intelligence (Pi), bringing AI into the physical world.Andrew Curran @AndrewCurran_
11K Followers 7K Following Atypically Friendly - I write about AI and human creativity. Will periodically make extremely unusual arguments.Many don't know that GPUs automatically leverage ternary and fine-grained sparsity to accelerate your matmuls! e.g. A matmul with ternary + 90% sparsity results in 33% more FLOPs in my benchmark. (not joking) I explore this "optimization" here: thonking.ai/p/strangely-ma… (1/3)
I'd argue @huggingface Izmir office is the best one
Crackaddr remains undefeated – I haven't found a single model (out of GPT-4, Claude, and Mistral-medium) that figures out the correct input to trigger the bug, even using a multiple choice format. (Correct answer is B)
I'm sorry, OpenAI, and thank you for your good faith, which I don't feel I deserve. You've given me tangibly new information now (alternate contact) that would have made me choose differently, even without the hindsight of the outcome, though
Bad news, guys. I've been testing it out for a few weeks and it turns out all those wacky podcast hosts who claim starting your day with a 5 or 6 am workout and reading before everyone else's day begins really does put you in a way better mood. This is a huge bummer.
always lol @ this pattern of tweet "absolutely heartbroken to report that exercise is good for you" "crying, screaming at the discovery that going for a walk in the sunshine does actually boost my mood" "saddened to learn that hanging out with people who love me is joyous"
Bad news, guys. I've been testing it out for a few weeks and it turns out all those wacky podcast hosts who claim starting your day with a 5 or 6 am workout and reading before everyone else's day begins really does put you in a way better mood. This is a huge bummer.
Cognition Labs (creator of Devin) is now valued at a $2B The startup is 6 months old and has no revenue AI agents are so back
So, here's a lovely little spinning LIDAR - at a fantastic price (£10!). 35mm square, uses a BLDC motor (smooth), and nice specs. It's happily scanning my front room, so they do work - making this a steal IMO. ebay.co.uk/itm/3951598553…
I always have this naïve folly that I’m doing the best there is, but then I meet people more obsessed and intense.
trying to implement ppo from scratch hoping i dont run into any bugs call that glhf
I've spent the past ~2 weeks building a GPU from scratch with no prior experience. It was way harder than I expected. Progress tracker in thread (coolest stuff at the end)👇
It really is, because after seeing this I called and had a chat with her and it was so impressive that I felt the urge to retweet and tell you that.
Self-made American billionaires who didn’t have to get picked for the CEO job and built their own Fortune 500 companies: Mark Zuckerberg: 5’ 7” Jensen Huang: 5’ 7” Jeff Bezos: 5’ 7” Michael Bloomberg: 5’ 7” Eric Yuan: 5’ 7” Tony Xu: 5’ 7” Sergey Brin: 5’ 8” Bill Gates: 5’ 10”
In the US, 14.5% of men are 6ft or taller. Among CEOs of Fortune 500 companies, 58% are 6ft or taller (4x increase) 3.9% of men are 6’2’’ or taller, among F500 CEOs, 30% are 6’2’’ or taller (7.6x increase)
Hello from the @OpenAI lab!
It is incredible what you can accomplish with a group of strangers on Discord ✨ My walkthrough of Swin vision transformer, and more, are live! 🎉And KITTENS! There are kittens in the course!
community-led computer vision course just dropped to @huggingface Hub 📖🤍
We were reviewed by @HackSpaceMag and got 10/10! "Learn how microchips work by designing one." Thanks to @efabless and all our supporters for making this possible! Read the full review here: hackspace.raspberrypi.com/issues/77