Scott Wolchok @ScottWolchok
Software engineer on performance and efficiency. I blog to level up non-experts on these topics. The opinions stated here are my own, not those of my company. wolchok.org California, USA Joined June 2014-
Tweets482
-
Followers341
-
Following180
-
Likes2K
I just made llamafile 1.3x - 5x faster than llama.cpp on CPU for many prompt / image evaluation use cases and hardware. justine.lol/matmul/
I can’t stand readability-implicit-bool-conversion
Did everyone else already know atomic increment/decrement etc. come with a full memory barrier on x86? I’m surprised but I guess that helps explain why atomic reference counting is so bad. stackoverflow.com/questions/5032…
Hey #plottertwitter, I got a HP 7475a recently, but the carousel is missing. What's the best way to get one?
Excited to share that Better Transformers got integrated in @huggingface Optimum library to bring major speedups for many of encoder models on different modalities (text, image, audio). better_model = BetterTransformer.transform(model) One line to run your model much faster!
Catching up: fastmod is up to v0.4.3 as of last month. Since 0.4.0, changes include several crash fixes, better color scheme compatibility, —hidden for searching hidden files, and picking up security fixes in dependencies. github.com/facebookincuba…
With PyTorch 1.12, we're releasing Better Transformer. With no code changes and fully compatible with existing trained models in Torchtext, we observe 40%-2x+ inference speedups on BERT on A100. Read more: bit.ly/3aAKQj8
32 muted words in, “more words to mute” is still the highest signal thing coming out of my timeline.
How do I get Twitter to show me only the tech stuff? I have an interest-specific second Twitter account and it’s pretty high signal-to-random-stuff ratio; main account here is mostly random stuff so I don’t read it much.
Today in time-consuming typographical errors: ++begin, +ii
Yesterday I wrote array[1] instead of array[i]. Bad time finding that one.
Last time DC tried Internet voting, in 2010, it took my team 48 hours to hack in and change all the votes. There haven't been any breakthroughs that make online voting fundamentally more secure today, and threats elections face are even more dangerous. youtube.com/watch?v=LaR7n5…
Horace He @cHHillee
24K Followers 450 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemalePete Hunt 🚁 @floydophone
35K Followers 846 Following Dad CEO @dagster Built https://t.co/PgAYdNs1ZE Prev: Twitter, Excalidraw, Smyte, Instagram, Facebook, React.jsDavid Goldblatt @davidtgoldblatt
1K Followers 421 Following Low-level perf stuff mostly. Working on llvm at Meta these days with a sprinkling of wg14/wg21/sg1, jemalloc, thrift, folly. @[email protected]Adam Bell @b3ll
17K Followers 1K Following I make synths, interactions, animations, and hack things 🏎 🇨🇦 #no #u iOS UI @ Netflix @[email protected] https://t.co/wgUIu45tHaSoumith Chintala @soumithchintala
187K Followers 884 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.Edward Z. Yang @ezyang
10K Followers 972 Following I work on PyTorch at Meta. Chatty alt at @difficultyang. Mastodon @[email protected]Nadav Rotem @nadavrot
4K Followers 427 Following Engineering director at Facebook. Interested in systems, compilers, ML, performance, and other stuff. 🇮🇱Nick Schrock @schrockn
13K Followers 2K Following Founder of Dagster Labs. Creator of Dagster. GraphQL co-creator.Bert Maher @tensorbert
493 Followers 291 Following I’m a software engineer building high-performance machine learning compilers at Meta/Facebook.Christian Legnitto @LegNeato
2K Followers 327 Following Ex-@robinhoodapp, ex-@facebook, ex-@mozilla, ex-@apple. Engineering leader who pretends he can still code and does it as much as possible.Justine Tunney @JustineTunney
33K Followers 276 Following I built a C library that lets you compile 12kb static binaries that run natively on Linux, Mac, Windows, FreeBSD, OpenBSD, NetBSD and BIOS using just GCC/Clang.Indragie Karunaratne @indragie
3K Followers 1K Following Director of Engineering, Performance @getsentry. Prev. co-founder of Specto (acquired by Sentry), engineering @Meta, indie macOS & iOS developer.James Reed @jamesr66a
730 Followers 2K Following I hope you like 🦊🐈🐕 photos. Formerly PyTorch Team @meta. Tweets my ownCaraBell @2PjSb3OnO27J0S
0 Followers 141 FollowingMeadowTwirl @MTwirl34206
18 Followers 2K FollowingEudoraPrice @0RnrJr3k9pT6O
0 Followers 172 FollowingKB @katiebowles_
640 Followers 5K Following Advancing AI for Healthcare at Scale at @AbridgeHQ | $150M Series C 🚀 | We're Hiring!Pu_lasan7 @Lasan7Pu4338
96 Followers 2K FollowingTasour @TasourR
43 Followers 355 Following Error code: 0xF2024 (Lost in the virtual world). Backup failed. All data lost.Soulana @DreamPC380705
510 Followers 3K Following saga monke with heart and sol and a samoyed || Labor market expert 🇪🇺 || Translator 🇵🇱🇩🇪 || AI & Blockchain enthusiast || Solana ecosystem adventurerToosmi @toosmi68320
42 Followers 2K Followingajax @ajaksalad
6 Followers 126 FollowingAbdurrahman Guner @abdrrhmnguner
34 Followers 128 FollowingAjay Gupta @ajay978
62 Followers 794 Following_WhisperRae @whisperrae46244
27 Followers 2K FollowingMecayt @mecayt12494
80 Followers 2K FollowingSheaton @Sheaton495192
33 Followers 2K FollowingVictoria_US_ @VictoriaUS84361
35 Followers 2K FollowingShereaso @Shereaso145469
206 Followers 3K FollowingMahad @_mmahad
28 Followers 313 Following FOSS Developer ❤️ low level compilers (dragons) && high-level tensors.ranjith @ranjithrayapati
8 Followers 260 FollowingFeteigh @feteigh13401
56 Followers 1K Following I live alone now and enjoy business, traveling, shopping, food and music. I have a calm personality and I hope we can be friends.John Arundel @bitfield
99K Followers 100K Following Go/Rust mentor and author, 'Explore Go: Cryptography' and other stories. Programming is fun, and you should have fun. 🦀Soateash @soateash42388
146 Followers 4K Followingkarthik suresh @karthikisk2
18 Followers 3K FollowingAliyar @Vxrtmq
0 Followers 168 FollowingAleś @mind_austerity
47 Followers 252 FollowingIbrahim V K @ibrhmvk
275 Followers 3K FollowingDaya @dskhudia
176 Followers 113 FollowingYaron Keren @YaronKeren
57 Followers 144 Following Perfection is achieved, not when there is nothing more to add, but when there is nothing left to take away.shibushiyinggaihuan @shibushiyingga1
77 Followers 805 FollowingVoontent- Summarize y.. @voontent
1 Followers 43 FollowingSpencer @ricattierger
40 Followers 137 FollowingJiakai Liu @liujiakai
519 Followers 277 FollowingLiu Qing @gmbetl
382 Followers 3K FollowingMary Sandra @MarySandra72297
5 Followers 65 FollowingShajerati @Shajerati1
7 Followers 572 FollowingKrishna Padmasola @placidex
86 Followers 2K FollowingArmin Nehzat @anehzat
346 Followers 2K Following Technologist passionate about Open Source. Head of Growth @thanks_dev #OpenSource.Mario Moleri @MarioMoleri
266 Followers 4K Following Musician, composer, improviser, psycho and abstract music lover, father of three ... and many more. Suono ergo sum.N @hobbnick
17 Followers 135 FollowingMichał Wiatrowski @magicznymichal
10 Followers 98 FollowingJayne Shaw @JayneS009
661 Followers 3K Following We Build Digital Products With Powerful Technologies That Help Companies Stand Out From Their Competitors. #Squarespace #Wordpress #Shopify #wix #Mobile_appHorace He @cHHillee
24K Followers 450 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemaleDavid Goldblatt @davidtgoldblatt
1K Followers 421 Following Low-level perf stuff mostly. Working on llvm at Meta these days with a sprinkling of wg14/wg21/sg1, jemalloc, thrift, folly. @[email protected]John Carmack @ID_AA_Carmack
1.1M Followers 241 Following AGI at Keen Technologies, former CTO Oculus VR, Founder Id Software and Armadillo AerospaceEdward Z. Yang @ezyang
10K Followers 972 Following I work on PyTorch at Meta. Chatty alt at @difficultyang. Mastodon @[email protected]Eric Niebler 🇺🇦.. @ericniebler
12K Followers 146 Following C++ core compute libraries tech lead at @nvidia, husband, father, @isocpp member, former nomad, and sometimes artist wannabe. @[email protected] he/himNadav Rotem @nadavrot
4K Followers 427 Following Engineering director at Facebook. Interested in systems, compilers, ML, performance, and other stuff. 🇮🇱Patrick McKenzie @patio11
164K Followers 797 Following I work for the Internet and am an advisor to @stripe. These are my personal opinions unless otherwise noted.Nick Schrock @schrockn
13K Followers 2K Following Founder of Dagster Labs. Creator of Dagster. GraphQL co-creator.Bert Maher @tensorbert
493 Followers 291 Following I’m a software engineer building high-performance machine learning compilers at Meta/Facebook.Christian Legnitto @LegNeato
2K Followers 327 Following Ex-@robinhoodapp, ex-@facebook, ex-@mozilla, ex-@apple. Engineering leader who pretends he can still code and does it as much as possible.Justine Tunney @JustineTunney
33K Followers 276 Following I built a C library that lets you compile 12kb static binaries that run natively on Linux, Mac, Windows, FreeBSD, OpenBSD, NetBSD and BIOS using just GCC/Clang.Denis Bakhvalov @dendibakh
4K Followers 445 Following Performance 🥷 @Intel. Book author📖. Blogger✍️. Speaker📢. Chess fan♟️. My newsletter: https://t.co/k0RKkc64zE. All opinions are my own. he/himEliezer Yudkowsky ⏹.. @ESYudkowsky
175K Followers 89 Following The original AI alignment person. Missing punctuation at the end of a sentence means it's humor. If you're not sure, it's also very likely humor.@mattgodbolt@hachyder.. @mattgodbolt
15K Followers 2K Following Husband, father, coder, sometime verb, real person. Fond of old hardware. Co-host @twoscp. #BlackLivesMatter. DMs open. @mattgodbolt.bsky.social too He/himIndragie Karunaratne @indragie
3K Followers 1K Following Director of Engineering, Performance @getsentry. Prev. co-founder of Specto (acquired by Sentry), engineering @Meta, indie macOS & iOS developer.Yacob (Kobi) Cohen-Ar.. @kobi_ca
2K Followers 502 Following Running San Diego C++ Meetup @sdcppmu, YT chan, Tech reviewer of OOP book (Packt) with Dorothy K. (Deciphering OOP w/ C++), My opinions and jokes @qualcomm-erGeorgi Gerganov @ggerganov
38K Followers 243 Following Not AI | 0x0e59 0x2550 24th at the Electrica puzzle challengeDan Luu @altluu
5K Followers 1 Following Chatty alt of @danluu. Mainly on https://t.co/V3Q53o3vC3 and https://t.co/00xlxH8ipr.Emmett Neyman @EmmettNeyman
404 Followers 1K Following Magic the Gathering nerd | SWE @Meta working on static analysis for security | interested in PL, Compilers, and Security | @CIS_Penn alum | Seattle | he/himJonathan Ballerano @jballer
376 Followers 696 Following software engineer | recovering lawyer | probably have a bad song stuck in my headJason Gauci @NeuralNets4Life
1K Followers 64 Following Machine Learning @ Latitude AI, Facebook AI, Google AI. Programming Throwdown host, MAMEHub creatorJaime McFaden @jaimemcfaden1
422 Followers 154 Following Aaptiv Master Trainer // Certified Fitness Trainer // Mama Bear // IG: jaimemcfadenDmytro Dzhulgakov @dzhulgakov
3K Followers 574 Following Co-founder and CTO @FireworksAI_HQ. PyTorch core maintainer. Previously FB Ads. Ex-Pro Competitive ProgrammerTucker: SW: Jedi Surv.. @T_B_Morgan
210 Followers 1K Following Senior Gameplay Engineer at Riot R&D 나는 큰 꿈이있다 reading:jane eyre personal project blog: https://t.co/WVv5jgysTT…Saleem Abdulrasool @compnerd
2K Followers 64 Following PL/Compiler Engineer, xplat Swift, & Swift Core Team Member @ @browsercompany (ex @GoogleAI, @facebook, @Microsoft)Nolan O'Brien @NolanOBrien
3K Followers 227 Following 🇨🇦🇺🇸 | code wrangler 👨💻 | in Vegas 🌆 | husband of 1 👱🏻♀️ | dad of 7 👧🏼👧🏼👧🏼👦🏼👧🏼👧🏼👧🏼 | ❤️ 80s movies 🎞 & whisky 🥃one of the good ones .. @super_triangle
328 Followers 757 Following if you can't handle me @ my worst, you dont deserve the unreasonable expectations i've placed on our friendship. she/herlauren 나은 @potetotes
21K Followers 2K Following ▼・ᴥ・▼ working on React Compiler (aka Forget). personal tweets on https://t.co/sGoNZxPk6jJeff Atwood @codinghorror
281K Followers 273 Following Indoor enthusiast. Co-founder https://t.co/e62S5uByfO / https://t.co/Tuh5wHPHTI. Let’s be kind to each other. I am no longer on twitter. Find me @[email protected]Nicolai Josuttis 🇺.. @NicoJosuttis
8K Followers 60 Following Author and trainer for C++ (https://t.co/hZlKwDYgBD, https://t.co/Wi2xdmcPOl, https://t.co/sjxsPRUKKy, https://t.co/1qClNsJ8pF, https://t.co/8qPAOGmZaz)Jordan Rose @UINT_MIN
9K Followers 586 Following He/him or they/them. Mac apps as @belkadan. Formerly Swift at Apple, now at Signal.Jiakai Liu @liujiakai
519 Followers 277 FollowingConnie Chan 🍒 @conniechan
55K Followers 722 Following ♬ whistle while you work ♫ General Partner @a16z, YGL of @WEF. I like sharing cross-border trends and learnings from China.Xuan Huang · 黄玄 @Huxpro
12K Followers 1K Following ⚛️ Formerly @Reactjs core (Forget✨), @ReactNative, @HermesEngine, @ReasonML · 🔨 UI Fwk/PLR/Xplat/Web/+AI @Bytedance ·👨🔬 λ.TaPL/FP/Compiler/VM/@TC39 · e/accWez Furlong @wezfurlong
3K Followers 542 Following Creator of WezTerm. 💓🦀 Ex-Meta (Creator of Watchman and EdenFS). Ex-Message Systems. PHP internals alum. https://t.co/jJAG8xrVaYCompiler Explorer @co.. @CompileExplore
7K Followers 91 Following I'm a website that lets you type in C, C++, D, Rust, Haskell, Ispc, Java and other compiled languages, and then I compile it and show you the assembly output.Frédéric Sagnes @ndfred
676 Followers 407 Following Knight who says Ni. Mobile Perf & Compilers @ Facebook @[email protected]Scott Alexander @slatestarcodex
138K Followers 30 Following I have a place where I say complicated things about philosophy and science. That place is my blog. This is where I make terrible puns.Shane O'Sullivan @chofter
2K Followers 180 Following Hacker, web/mobile/robotics enthusiast. Former Head of Engineering at Promise (https://t.co/izhcC60rlG). Ex Stripe & Facebook. I also cook.Ryan Nystrom @_ryannystrom
11K Followers 735 Following co-founder @trycampsite 🏕️ prev @github, @Instagram. creator @IGListKit + @githawk, pilot. he/him🔌 Peter Griess �.. @pgriess
773 Followers 940 Following Engineering at @CamusEnergy @[email protected]Lee Howes @LeeWHowes
215 Followers 104 FollowingWendy Gu @GuLabStanford
2K Followers 382 Following Professor of Mechanical Engineering at Stanford. Nanomaterials, materials in extreme environments, in-situ testing, high-pressure, colloidal self-assembly.PINE64 @thepine64
41K Followers 286 Following A community driven project offering Arm and RISC-V devices to FOSS enthusiasts worldwide. News Blog: https://t.co/GRYJQy7O0S Telegram News Channel: https://t.co/IjGU9PY2hjGary Bernhardt @garybernhardt
47K Followers 120 Following Execute Program (learn programming tools quickly); Destroy All Software (dense programming screencasts); formerly Deconstruct conference.Azeria @Fox0x01
125K Followers 571 Following Sneaky bit flipper | CEO of @azeria_labs | Arm Assembly Princess | Trainer | Author of @BlueFoxBook |Seb Lester @SebLester
28K Followers 101 Following Calligraphy, Lettering, Type, Heraldic Art. Prints at https://t.co/MHdRUpXWIy - Take my online calligraphy class at https://t.co/TqOgnsLs9UAl Urim @almostalbert
202 Followers 1K FollowingEzra Klein @ezraklein
2.6M Followers 1K Following Columnist, @NYTOpinion Author, "Why We're Polarized" Host of "The Ezra Klein Show" podcastJulia Galef @juliagalef
117K Followers 501 Following Author of THE SCOUT MINDSET and host of the Rationally Speaking podcastAndrew Plotkin @zarfeblong
3K Followers 260 Following I have suspended this account because I don't work for Elon Musk. Not reading DMs, mentions, or notifications. Feel free to email.Supergiant Games @SupergiantGames
429K Followers 43 Following Creators of Hades, Pyre, Transistor, and Bastion. Now developing Hades II. · Merchandise: https://t.co/irXk5Af05t · Discord: https://t.co/wA3owJqNiaUS Consumer Product S.. @USCPSC
171K Followers 4K Following Standing for safety since 1972. Recalls, safety alerts and data. RTs, follows are not endorsements. Official account of U.S. Consumer Product Safety Commission.Matt Galloway @mattjgalloway
11K Followers 827 Following mattEngineer = std::move(mattManager). Spark AR at Facebook London. ex-iOS developer & author of Effective Objective-C 2.0. All opinions are my own, etc.Introducing ExecuTorch Alpha ⚡ ExecuTorch Alpha is focused on deploying large language models and large ML models to the edge, stabilizing the API surface, and improving installation processes. Learn more in our latest blog: hubs.la/Q02vzrrW0
Update: Keno Fischer @ Julia says that this was coordinated with Apple. Opens up a lot of possibilities...
I just published General Guidelines for Software Performance Engineering in C++ link.medium.com/SZQvpvhVNIb These are some general guidelines for C++ but actually they are pretty generic practices/approaches. They might end up in the C++ core guidelines in some form. We'll see.
I just made llamafile 1.3x - 5x faster than llama.cpp on CPU for many prompt / image evaluation use cases and hardware. justine.lol/matmul/
Quoted for endorsement. (Read “routine” as “You do not have to bitten by a radioactive spider to generate this outcome. Most people who achieve it will not be nationally known within their industry or to people on the street.”)
if you are a late career software engineer it is somewhat routine for you to be in the seven figures of compensation with most of that being stock in your company.
@schrockn do you have recording of your talk "Evolutionary Means for Revolutionary Ends: The Art of Changing Large Software Systems in Place" by any chance? I found the slides, but not a recording.
Current and former Google engineers discuss how Google has changed:
@ESYudkowsky It's disappointingly short on answers. What do you think the culprit is?
Today I succeeded in convincing my team to stop using mocks 🛑 Doing my small part in improving software around the world ✨
We've been working quietly on the Anniversary Edition of Braid for a **while**, but we can now announce that the release date is April 30, 2024. Here are some fun details: [1/n]
@lefticus Sure, that can work. However, the real problem here is the wishful thinking that we’ll be able to meaningfully carry on a GUI desktop for the user while the system is unable to accommodate a 3-byte malloc.
I'm trying to figure out what I'm even supposed to add, and this seems like a possible start. Maybe what people need to hear is not that nanotechnology is possible, but that bacteria are possible.
@mmt_lvt @ESYudkowsky all bacteria include factories that can produce arbitrary proteins, not just more bacteria
Absolutely fascinating: x.com/vergaralautaro… It's as though it's afraid to recite the litany
I'm just extremely confused. Like the INTERNET COMPANY Google. The CLOUD SERVICES PROVIDER Google. The company who's success partially rests on us trusting them to DO THE WORLD WIDE WEB GOOD. Is like... domain names? Not for us. We're gonna let this WYSIWYG CMS handle that.
I now understand why SO MUCH CHILDREN'S LITERATURE is about going to sleep hahahahaha
@AngeloDalli Rice's theorem says you can't have general non-trivial-property checkers; it doesn't say that you can never prove non-trivial properties given some specific programs
@tavianator In my first BigCo perf team we spent a half inserting lots of result caches to reduce CPU consumption. We spent the next half removing lots of result caches to reduce memory consumption. This was an educational introduction to industry.