hate this, hate it so much. just broke a training script & now I have to push an API key to all my training images.
@MistralAI why would you do this, what are you even going to use this information for, why add this extra friction?
the question imo is “why is Meta so investing so much in building these models”
not “why release them”
They have every incentive to release the models once they’re built
the question imo is “why is Meta so investing so much in building these models”
not “why release them”
They have every incentive to release the models once they’re built
Zuck made a comment in the Dwarkesh interview that makes me think they’re doing multiple epochs to get 15T tokens
he was talking about the 7B model and said something like “yeah the line was still improving, so maybe we show them the same tokens again and it keeps improving”
on the one hand, this is absolutely right (about Zuck making am aggressive investment in AI)
on the other hand, it's the classic tech power law- if he hits on any one of these, it has a 100x payoff and covers all the other bets with money to spare, the main tradeoff is he looks…
on the one hand, this is absolutely right (about Zuck making am aggressive investment in AI)
on the other hand, it's the classic tech power law- if he hits on any one of these, it has a 100x payoff and covers all the other bets with money to spare, the main tradeoff is he looks…
my takeaway from listening to the Dwarkesh interview with Zuck is that he really believes that the AI assistant is the next platform and he’s going to do everything he can to make the Meta assistant the winner
My bear case for Nvidia is simple: giant matmul machines are not that hard to make: Google + Amazon already have. Given the flops/instruction ratio of modern transformers, software doesn't matter either: if their stack sucks, just write everything in microcode!
was talking with a Canadian entrepreneur yesterday and the first thing they said was "never talk to Canadian VCs"
the culture among Bay Area VCs remains undefeated
8K Followers 2K FollowingThe story so far: In the beginning Bill Clinton gave him a green card. This has made a lot of people very angry and been widely regarded as a bad move
593 Followers 5K FollowingPassionate purveyor of exquisite teas! 🍵 Explore the finest selection of teas on https://t.co/XURCLkBTuA. From classic blends to unique flavors, we've got your pe
307 Followers 1K Following🩻 MS3 Mcgill📱Apple⚡️Tesla 📈 Equity Research | “You’re only given a little spark of madness. You mustn’t lose it.” — Robin Williams
760 Followers 2K FollowingWe are Purple Passion Prints! We're here to celebrate our love of the color purple! We create beautiful purple media with various AI Tools.
751 Followers 468 FollowingVC @TwoSigmaVC investing in AI, Infra, SaaS, and dev tools. Prev: NLP PhD @Stanford, some startups, Research @Google, @Apple, @Amazon
320 Followers 3K FollowingLiterature, Computer Science, Law, Film.
Materializing the vision before death.
Account designed to expel random thoughts. (burner)
268 Followers 1K FollowingDMs Open! AI & Robotics MSc at @Mila_Quebec/@UMontreal. Prev: nlp at @amazonscience, compsci at @UofT. Slowly figuring out how to make robots learn.
21K Followers 3K Followingfounder of something new/old | x M&A guy at Google | investor in 50+ via @launchhouse | writing https://t.co/iX1dpZ3MZY | follow for startup advice & subpar memes
104K Followers 278 FollowingPartner @Gigascale, Sr Fellow (Formerly CTO) @Meta, founder @AdditionalVent, . Investing in tech and science to fight climate change. AI
82K Followers 3K FollowingCult member of The Free Press (@TheFP) where I write the very important TGIF column. Author of a new book, Morning After The Revolution. Trad wife, mother.
20K Followers 2K FollowingFounded @MentavaInc to support high achieving kids. Seeker of truth, critic of tribalism, lover of ice cream. Tweets about startups, education, and my four kids
7K Followers 140 FollowingCEO & founder of https://t.co/1ahebDcdYS, 🇨🇦 personal finance encyclopedia. Former banker. PhD in Physics.
Discussing economy, finance, real estate, entrepreneurship, etc.
20K Followers 224 FollowingHelping Canadians make better financial decisions. Portfolio Manager, Head of Research @PWLCapital; co-host @RationalRemind.
Meet with PWL ⬇️
339K Followers 2K Following@Shopify CEO by day, Dad in evening, hacker at night. Aspiring comprehensivist. (tweets auto delete) retweet/like=noteworthy share, not endorsement
337K Followers 744 FollowingSenior Space Editor at Ars Technica. Likes rockets. Author of the forthcoming book on the Falcon 9 rocket and Dragon spacecraft, REENTRY. https://t.co/vMzqdyaC21
17K Followers 2K FollowingFormer Chief Business Officer @Uber. Former COO @Klout. Former Special Assistant to the Secretary of Defense. Former SVP of Field Operations @Tellme
10K Followers 895 FollowingFounder @valaratomics. Kardashev scale climber, Malthus disrespector, Age of Man enjoyer. Ask me why consuming energy is good and you should have more babies.
97K Followers 658 FollowingI research intelligence to understand it and to harness it wisely. Part of AlphaGo tuning, AlphaCode, learning to learn, Lyria, Imagen2, Gato, rGemma
632K Followers 575 Followingentrepreneurship zealot, grounded technology possibilist, believer in the power of ideas, passionate about sustainability & impact
13K Followers 3 FollowingThe Official Twitter Account of Whistler Blackcomb Operations. Follow us for up to date operation announcements & everything awesome in Whistler, CANADA #WBOps
7K Followers 934 FollowingBuilding @UnslothAI. Finetune LLMs 30x faster https://t.co/aRyAAgKOR7. Prev ML at NVIDIA. Hyperlearn used by NASA. I like maths, making code go fast
17K Followers 903 FollowingFounder of @HigherOrderComp
Building the massively parallel future of computing
Reaching AGI to cure all diseases and suffering is all that matters