TheDavidTai @TheDavidTai
Founder, hacker, stochastic tool. @microsoft escapee. Currently @eigenlabs Checkout my github actions emulator: https://t.co/TPIOeqGz4z davidt.ai United States Joined September 2018-
Tweets3K
-
Followers843
-
Following591
-
Likes2K
@Whos_Ur_Doggy Its both the ngram translation after drafting and the ngram translation before verification. I thought I had fixed it with the 85tps one but that had a big drift bug that has led me down this rabbit hole.
Found the source of most of the gpu microstarvations on Qwen 3.8 27b and its much like what I expected, bottlenecked on the n grams. You have to get all MTP drafted tokens, and do all the lookups before going to the next step, however everything is in CPU land at that point because a metal kernel can't do that sort of look up :| That's how you get consistent 100+ vanity tps.
@ddalcu I did a marketing campaign one time on Fiverr and $30 got use like 30k stars and on the front page of github lol. So 1k stars is a huge legit milestone. Congrats.
How much compute does OpenAI have?
OpenAI's advertising biz has hit a $1 billion annualized revenue run rate after being up and running for 200 days. They rolled out ads for the free and $4 plan in India three days ago.
No community note.
this is insane! just got access to GTA 6 and one of the missions is to transport illegal GPUs with Jensen.
The hill cilmbing doesn't stop in mlx.fast. Lots of small consistent gains topped off by a huge rewrite from IBroth today!
They don't even give you banked resets, is there a reason to not cancel and re sub every month manually?
Canceling Claude is all the rage. You should do it, too, anon.
@Hikari_07_jp We practice so we are ready when it does.
Sadly I think they are onto the new V4 architecture :(
you forgot to release Qwen3.8-35B. it's still not too late.
@Sentdex Is it still under warranty? 🤞
@GedHughes71 @ivanfioravanti @ddalcu @TheDavidTai Glad to se it ! MTPLX had better original release prefill work than oMLX initial release . I wanted to get qsa right so got that released after the original native qwen4 architecture . That's where the high % increases come from for omlx.
@ivanfioravanti @Spangler3000 @ddalcu @TheDavidTai Measured prefill throughput: - 32,834 tokens: 940 → 1,102 tok/s — +17.27% - 131,129 tokens: 708 → 1,057 tok/s — +49.38% - 245,819 tokens: 602 → 981 tok/s — +62.93% At the largest tier, end-to-end time fell from 410.5s to 252.9s, a 38.40% reduction against my MTPLX LC daily
@ddalcu makes great tooling for doing optimziations.
llmprobe is becoming one of my best friends in evaluating engines and quantization correctness. I'll keep testing it more and more and why not adding some features to it.
107% improvement at 256K context on Apple Silicon is a dream! @Spangler3000 did it for oMLX, @ddalcu confirmed it on mlx-serve and @TheDavidTai is happy like me! I hope other will implement this!
@Spangler3000 @ddalcu @ivanfioravanti That’s pretty nice because massive slow down on context is annoying 👍
@Spangler3000 @ddalcu @ivanfioravanti Pretty wild, this is going to be transferrable right? I'm assuming it involves some sort of chunking?
So basically, all this time we’ve been misled by Anthropic. The $100 plan only gives you around 3.5x the weekly usage of the $20 plan, and the $200 plan only gives you around 6x, The whole x5 and x20 thing only applies to the 5 hour window, the same kind of window OpenAI already removed, Honestly, I expect nothing from Anthropic anymore and somehow they still manage to disappoint me. Tibo already clarified that ChatGPT plans actually respect the x10 and x20 exactly as advertised, without any 5 hour window
X4 @X4AES
8K Followers 2K Following ☆ 𝙸 ♥ 𝚃𝚎𝚌𝚑 ▁▂▃▅▇ ☆ ← (𝙰𝙸, 𝙲𝙼𝙿𝚁𝚂𝚂𝙽, 𝙲𝚛𝚢𝚙𝚝𝚘) ᗒ@SomeCapitalX (ex @projectpxn) Founder/Visionaire. ■■■■■■■■□ ʟᴏᴀᴅɪɴɢ
Aidan Llewellyn @AidanLlewellyn
336 Followers 849 Following
eoeduo @eoeduo
11 Followers 1K Following
Stuart Rowlands @stuart_rowlands
136 Followers 232 Following QuantCDN founder, Salsa Digital CTO, Madcore co-founder, Firecannon founder.
Philipp Gassmann @iamForfor
299 Followers 1K Following OpenXYZ Enthusiast, Father, System engineer, Music and Nature loving human
Mats @mats_cgo
241 Followers 3K Following
GedHughes @GedHughes71
8 Followers 47 Following
Laniakea Lab @thelaniakealab
3 Followers 43 Following Research lab exploring AI, software and knowledge systems.
Mikolaj Mikolajczyk @mikolaj92
31 Followers 670 Following
Andy @AndyComeOn
17 Followers 702 Following
Dumonetized @dumonetized
67 Followers 888 Following Yet another tech anon trying to cope with the current state of things
Smart Crypto @0xSmartCrypto
451 Followers 743 Following I run my own algo bot factory. 22 in. 1 lived. Now I teach traders to build theirs. AI-first. Free discovery call ↓
Razvan ☀🏝️❤�... @razvandan
485 Followers 2K Following Life is like a box of chocolates: you never know what you're gonna get.
Klaus Schmid @1KlausSchmid
642 Followers 619 Following Professor Software Engineering, University Hildesheim
Bo Zhang @bozhanghaha
11 Followers 113 Following
felipegenef @felipegenef_
1 Followers 75 Following
Midas 👑 @TheMoonMidas
68K Followers 881 Following ex cmo @LeonardoAi (0→1M subscribers in 5 months) ex growth @delphi_labs grew fb pages to millions of followers now i just chill, advise, and build fun stuff
D @dmitweb
1 Followers 31 Following
Prowler @Prowler08494845
191 Followers 3K Following
xM_My @NullBurn
9 Followers 400 Following
Trey Tucker @PowerHouseATX
689 Followers 6K Following PowerHouseATX provides opportunities for individuals to reach their fitness potential. We empower others to become the best version of themselves.
DrewX @DegenX_arb
1K Followers 3K Following
Chris @Concerned_Cit25
130 Followers 222 Following
William @Will_U_Are
39 Followers 124 Following
Glauco Porzio @glapowiz
0 Followers 303 Following
Big Pappa @qyrpie
155 Followers 855 Following Lifelong nerd, Building the future, Curious by default, Always learning.
Jonni Paloposki @JonniPaloposki
0 Followers 5K Following
wwl @wwlong1988
17 Followers 313 Following
Nicwix @Nicwix
337 Followers 3K Following
NutsandBolts @u0106793
148 Followers 3K Following
Density Duck @DensityDuck
4 Followers 411 Following Tribute to the best alliterative waterfowl meme of all times.
unbug @unbug
1K Followers 734 Following Local LLM & Omarchy enjoyer on V100; Tday https://t.co/P6K9F7LvIO ; CODELF (Github star 14k); MIHTool (Mentioned in Google I/O'13)
sparkarena @spark_arena
1K Followers 548 Following Open-source community for Local AI. Benchmarks, deployment guides, tools, and real-world insights from builders.
DipotanLee @DipotanLee
1 Followers 139 Following
Nikhilesh Jasuja @thisislobo
348 Followers 750 Following Gooseberry lover. Probabilistic thinker. Creator of @Diffen, @Hreflang and https://t.co/SoaMgluflp.
JKT70 @JKT70
70 Followers 519 Following
Vay🎗️ @VaibhavSpark
2K Followers 925 Following Code • Linux • AI • Open source | AI Engineer Tech || Thoughts || 20 Building →breaking →repeating imagination {Code} = Magic ✨
2damoon @scouzi
169 Followers 714 Following Building practical local AI for Apple Silicon. Creator of Vesta AI Explorer and maclocal-api. Leveraging MLX, llama.cpp, Apple Intelligence & AI infrastructure
unbug @unbug
1K Followers 734 Following Local LLM & Omarchy enjoyer on V100; Tday https://t.co/P6K9F7LvIO ; CODELF (Github star 14k); MIHTool (Mentioned in Google I/O'13)
Dev Shah @0xDevShah
11K Followers 666 Following audodidact | head of devrel @resembleai | sim @ newton, mujoco | transhumanist | e/acc | building optimus @iaconhq
Rehan Haider @rehanhaider
1K Followers 1K Following Tinkerer. Engineer. Struggling serial Founder. Author. Highly opinionated, artistically challenged. #AWSCommunityBuilder
Igor Kotenkov @stalkermustang
4K Followers 800 Following
litquidity @litcapital
1.6M Followers 1K Following founder @litquidityvc // newsletters @exec_sum & @cryptosum_ // @baincapvc scout // trade on polymarket: https://t.co/kXGzvIdxOS
Delia Lazarescu @tech__unicorn
13K Followers 733 Following Ex-Googler gone rogue automating with AI📍[email protected]
Zain @zainhas
7K Followers 2K Following I build and teach AI • AI/ML @togethercompute • EngSci ℕΨ/PhD @UofT • Previously: vector DBs, data scientist, lecturer & health tech founder • 🇺🇸🇨🇦🇵🇰
Rami McCarthy @ramimacisabird
5K Followers 941 Following security, for the internet, at @wiz_io! opinionated about security. 🇺🇸 in 🇸🇪 (he/him)
Péter Szilágyi @peter_szilagyi
72K Followers 391 Following Founder @dark_dot_bio | Former Go Ethereum Lead (2015-2025)
azurebridge @azurebridge
279 Followers 287 Following 20 he/they | running on emergency dynamos, ehehe. i like tech & agriculture...
Eyal Toledano @EyalToledano
18K Followers 2K Following invented plan mode • leading @usehamster, the ai native workspace for product teams • creator @taskmasterai
Rajesh Thallam @rajesh_thallam
11K Followers 847 Following building @ensurecareai prev: senior staff swe @Google @awscloud interests: ai infra, inference, agents, llms, data science, ML opinions: my own
Pedro Cuenca @pcuenq
8K Followers 1K Following ML Engineer at 🤗 Hugging Face | Co-founder at LateNiteSoft (Camera+). I love AI and photography.
Leo Linsky @leo_linsky
572 Followers 139 Following Autoscaling RL @ https://t.co/smlFAfyiE3 Computational chemistry Quant trading BS/MS EE. Generally curious https://t.co/56I40QBEqT
Ahmed Morsi @eramax
63 Followers 3K Following
Jesse @Jesse_Sng
127 Followers 4K Following
Juan Colilla @JuanColilla
828 Followers 4K Following iOS Engineer / ✨ Space Enthusiast / 🎓 Technocrat /👨🏼💻Tech Lover / 👨🏼🍳Love to cook.
mzba @LiMzba
1K Followers 244 Following
Jarred Sumner @jarredsumner
189K Followers 644 Following building @bunjavascript at @anthropicai. formerly: @stripe (twice) @thielfellowship. high school dropout. npm i -g bun
Sebastien Guillemot @SebastienGllmt
44K Followers 4K Following CTO @midnightfdn. Current focus: ZK (lattice,folding,Starstream), consumer apps and chain abstraction. drep1kyppjlhz4lawh4g0ewx2d8a5l20t4yclfnppnuvdkmt7vccg836
EuropeMac @EuropeMacApps
109 Followers 28 Following Peak engineering • Pushing the limits of computing • Keep thinking.
Max Weinbach @mweinbach
304K Followers 8K Following Analyst @creativestrat | Analyst and Market Research Firm | Typo ignorer Email: [email protected]
Merill Fernando @merill
21K Followers 4K Following Ex-Microsoft PM | Tweets my own Built → https://t.co/QbUp63ffXf • https://t.co/8W7yvQi3jb • https://t.co/NFLDqDIY8h • https://t.co/tSWrIw8Ajh 📰 Newsletter→ https://t.co/tPzAEl0Zuq & https://t.co/894nfObWuU 🎙️ Podcast→ https://t.co/TBlNKTzn8t
spencer @techspence
18K Followers 3K Following 🛠️ Former Sysadmin, now Pentester | Microsoft MVP | Helping IT teams make their environment harder to attack | @SecurIT360 & @CyberThreatPOV
Dimasya @satanworker
568 Followers 2K Following Previously @aave and @bgdlabs @safe_space_app - encrypted iOS media folder Currently @ValantisLabs opinions are my own
Adam Mainz @MainzOnX
6K Followers 331 Following PyTorch TPU @google | ex @meta | Obsessed with AI & ML Performance | Building what’s next 🔥 | Views are my own
Shashank Goyal @shashankgoyal95
2K Followers 456 Following Head of AI Ecosystem @OpenRouter, prev @OpenSea @Google!
Todd Saunders @toddsaunders
18K Followers 1K Following CEO of @DaltonMillsAI. The platform the trades build on. Previously CEO of @Broadlume (acquired by @Cynclyco), @google. Long @townofwestfield.
maderix @originalmaderix
2K Followers 82 Following Part time model optimize, full time model tuner 🤖 maderix/ANE - first ever model training on Apple NPU/ANE 🧑💻compiler author https://t.co/uyii0ijkTu
James T @JamesTervit
691 Followers 555 Following BBS/FidoNet | Blockchain & Secure Networking innovator | Founder https://t.co/9JBJTTlxGL & https://t.co/xzoxRJOL4U & https://t.co/XMk3MqTfVe | Forensic Blockchain Arch | Retro Hi-Fi.
Gail Weiner @gailcweiner
4K Followers 3K Following Companies are automating processes nobody has written down accurately. I map the real one. AI, power, and the systems underneath. Founder, Simpatico Studios.
Rhys @RhysSullivan
60K Followers 2K Following building https://t.co/gIFOwRUrLU to connect any agent to every tool, API, and service your team uses | yc 26
Henry Zhang @henryzhangumich
701 Followers 508 Following inference @cohere | prev @amazon | cs + biochem @umich | views are my own
Evan Otero @EvanOtero
8K Followers 750 Following member of the technical staff @GoogleDeepMind, @GoogleAIStudio & Gemini API // @Jaguars mjwd // my views
Daniel Lougen @DJLougen
3K Followers 1K Following PhD @ UofT | Visual Neuroscience | Gestalt Labs @GestaltAILab | Neutrality Project | Qwen Dev Ambassador
Yugant 💻 @YugantM
303 Followers 203 Following Observations about AI, technology, war, and human behavior. Trying to understand the world. Lately, unhinged.
Aymen Labidi @labidiaymen
2K Followers 804 Following Architect & Engineering Manager at Inetum · Creator of https://t.co/RcLhU3pUah
Rob Coreano @RobCoreano
578 Followers 4K Following AI Tech Opinionated - Autistic - Neurodivergent advocate - Tech Trends News Update Podcast: @TechAIPodcast & https://t.co/4fZHDQWkua
catid @MrCatid
4K Followers 893 Following Training the models. Prior: Saronic, Anduril, Oculus VR, Game Closure, MSEE@GATech
FHILY👑 @Oluwaphilemon1
9K Followers 2K Following Defi + Content Creator + Entertainment + Claude News + AI
Trends for United States
You might like
