Joey @him_joey
Chillin it out! Joined March 2013-
Tweets162
-
Followers93
-
Following786
-
Likes655
Multi-agent collaboration has emerged as a key AI agentic design pattern. Given a complex task like writing software, a multi-agent approach would break down the task into subtasks to be executed by different roles -- such as a software engineer, product manager, designer, QA…
🥁 Llama3 is out 🥁 8B and 70B models available today. 8k context length. Trained with 15 trillion tokens on a custom-built 24k GPU cluster. Great performance on various benchmarks, with Llam3-8B doing better than Llama2-70B in some cases. More versions are coming over the next…
The hottest new programming language is English
Returning from an experimental ~2 week detox from the internet. Main takeaway is that I didn't realize how unsettled the mind can get when over-stimulating on problems/information (like a stirred liquid), and ~2 weeks is enough to settle into a lot more zen state. I'm struck by…
Last week, I described four design patterns for AI agentic workflows that I believe will drive significant progress this year: Reflection, Tool use, Planning and Multi-agent collaboration. Instead of having an LLM generate its final output directly, an agentic workflow prompts…
Neuralink just revealed the first human using a brain-chip implant to play chess using mind control alone. Plus, more developments from Elon Musk, Hydra, GPT-5 leaks, Open Interpreter, Sakana AI, Stanford, and Character AI. Here's everything going on in AI right now:
For starters, transformers are equivariant to permutations. Like ConvNets are equivariant to translations. Equivariance to permutations is good when what you care about are relationships between input items at any distance.
For starters, transformers are equivariant to permutations. Like ConvNets are equivariant to translations. Equivariance to permutations is good when what you care about are relationships between input items at any distance.
Fifth formulation of the same problem, this time with a picture. Stand at the North Pole, walk 1km in any direction. Call your location point P. Turn towards the East and keep walking East until you come back to P. How long was the walk East from P back to P? 1. More than 2xPi km…
Fifth formulation of the same problem, this time with a picture. Stand at the North Pole, walk 1km in any direction. Call your location point P. Turn towards the East and keep walking East until you come back to P. How long was the walk East from P back to P? 1. More than 2xPi km… https://t.co/bFZiFvP6EN
Important point: an LLM is a bit like an encyclopedia that can talk back.
Important point: an LLM is a bit like an encyclopedia that can talk back.
To people who claim that "thinking and reasoning require language", here is a problem: Imagine standing at the North Pole of the Earth. Walk in any direction, in a straight line, for 1 km. Now turn 90 degrees to the left. Walk for as long as it takes to pass your starting point.…
# automating software engineering In my mind, automating software engineering will look similar to automating driving. E.g. in self-driving the progression of increasing autonomy and higher abstraction looks something like: 1. first the human performs all driving actions…
# automating software engineering In my mind, automating software engineering will look similar to automating driving. E.g. in self-driving the progression of increasing autonomy and higher abstraction looks something like: 1. first the human performs all driving actions…
The Diffusion Transformer paper, by my former-FAIR-and-current-NYU colleague @sainingxie and former-Berkeley-student-and-current-OpenAI engineer William Peebles, was rejected from CVR2023 for "lack of novelty", accepted at ICCV2023, and apparently forms the basis for Sora.…
The Diffusion Transformer paper, by my former-FAIR-and-current-NYU colleague @sainingxie and former-Berkeley-student-and-current-OpenAI engineer William Peebles, was rejected from CVR2023 for "lack of novelty", accepted at ICCV2023, and apparently forms the basis for Sora.…
Here's my take on the Sora technical report, with a good dose of speculation that could be totally off. First of all, really appreciate the team for sharing helpful insights and design decisions – Sora is incredible and is set to transform the video generation community. What we…
Last week we signed off on #Remarkable 2024 with immense gratitude. The 3-day journey through AI’s potential wouldn’t have been possible without our dedicated speakers, sponsors, funders, & volunteers. Here’s to the remarkable progress we’ll achieve together
The LVM (large vision model) revolution is coming a little after the LLM (large language model) one, and will transform how we process images. But there’s an important difference between LVMs and LLMs: - Internet text is similar enough to proprietary text documents that an LLM…
Interested to hear more, or attend the events? Register here: docs.google.com/forms/d/e/1FAI…
Joint Family is an intergenerational initiative that seeks to connect and empower younger and older adults from diverse backgrounds through science, arts and technology. jointfamily.us
Excited to share news of the launch of Joint Family's program in Jan 2024 with the kickoff event: Discovering AI Together! #intergenerational #ai4good #digitalequity #socialinnovation
Tesla Full Self-Driving capability demo in Austin FSD capability features use vision neural networks to perceive & understand the world, just like humans do. Via our unique fleet learning approach, we are able to collect anonymized data from our vehicles—meaning the neural…
The timeless struggle between the people building new things and the people trying to stop them…
Larue Schonberg @LarSchonber
75 Followers 5K FollowingCordelia Clery @cle_cordel
75 Followers 5K Followingpurple clouds @purplevclouds
599 Followers 1K FollowingTeauteet @teauteet39728
0 Followers 256 FollowingHoosour @hoosour26842
1 Followers 212 FollowingVernell Philo @philo5697
94 Followers 5K FollowingMartha Trucco @TruccoMart35970
77 Followers 5K FollowingSherryRhys @f86x05zMt9Cmh
0 Followers 232 FollowingHiba Gradford @HiGradfo
77 Followers 5K FollowingSharleen Marcinka @MarcinkSharle
65 Followers 5K FollowingEmilie-rose Alwang @AlwangRose74184
69 Followers 5K FollowingArletta Drader @ArlettDrade
38 Followers 5K FollowingMaili Culbreath @CulbreathM25409
76 Followers 5K FollowingJohnny Spoto @JohnnySpot59503
79 Followers 5K FollowingAnette Knocke @AnetteKnoc7896
128 Followers 5K FollowingLyla Akbar @AkbaLyl
75 Followers 5K FollowingJazmin Puccini @JazminP79262
16 Followers 3K FollowingNeve Francy @NeveFrancy84223
86 Followers 5K FollowingMartyna Austerberry @MartynaAus96588
27 Followers 5K FollowingAubree Petrelli @petrel_aubre
43 Followers 5K FollowingVi Guittennez @VGuittenne58988
78 Followers 5K FollowingJodie Cowan @jod_cowa
33 Followers 5K FollowingDaryl Anastasia @AnastasiaD57571
75 Followers 5K FollowingSousa Brothers @sousa_brothers
300 Followers 887 Following Founders at Scalit™ | B2B & SaaS Growth Strategists | The AI Break - AI & Automation Weekly NewsletterHarlow Alty @HarloAlty
36 Followers 5K FollowingSophia-rose Malabanan @ro_malaba
37 Followers 5K FollowingYung Echavez @EchavezYun63603
58 Followers 5K FollowingBillye Fregia @BillyeFreg71859
36 Followers 5K FollowingZelda Burgey @BurgeyZeld63897
96 Followers 5K FollowingAnya Fendt @fend_an
51 Followers 5K FollowingNora Alegi @NoraAlegi16274
63 Followers 5K FollowingFearless_Femme @FearlessFe57704
29 Followers 1K FollowingToby Colding @ColdingTob7343
85 Followers 5K FollowingJennie Parcells @JennParcel
35 Followers 5K FollowingPearle Baltimore @PearBaltimo
38 Followers 5K FollowingPhil from The Run @philsrun
833 Followers 725 Following 4x Half-Marathon / 2x Marathon 🏃♂️Avid runner and writer! Free running tips in your ✉️👇Layla-grace Pastor @past_grac
44 Followers 5K FollowingZachary SawyerJanae @sawyerjana38439
117 Followers 3K FollowingAriel Bockrath @bockra_ar
38 Followers 5K FollowingNadia Mcdeavitt @McdeavittN50129
46 Followers 5K FollowingNa Cedeno @ceden_n
32 Followers 5K FollowingEve Raugust @RaugustEve54039
57 Followers 5K FollowingDinorah Benzel @benz_dinor
41 Followers 5K FollowingAndriy Burkov @burkov
20K Followers 142 Following Author of 📖 The Hundred-Page Machine Learning Book and the 📖 Machine Learning Engineering bookRian Darius Pandole @RDPandole
526 Followers 312 Following Columbia University x 2 | Growth Equity Investor | Previously Investment Banker at BofA | Ex Tennis Player | NYCGroq Inc @GroqInc
46K Followers 472 Following Creator of the LPU™ Inference Engine, providing the fastest speed for AI applications, designed & engineered in N. America https://t.co/DsEqVAC5DpShayan Sen @DrShayanSen
3K Followers 392 Following Just a nice pharmacist dispensing some knowledge | The recommended daily dose for becoming fitter, smarter, and more successful.Indian ( Modi Ka Pari.. @hind4hindus47
651 Followers 332 Following Geopolitical Analyst | Reclaim Our Heritage | Un Apologetic Hindu | Honoured to be Blocked By Mahua Moitra and Mamta Banerjee 😂NEXTA @nexta_tv
1.2M Followers 110 Following The largest Eastern European media. To let the world know. Our website: https://t.co/4voPija7tJ Become our patron: https://t.co/fOGkarNq2ccrewAI @crewAIInc
2K Followers 4 FollowingEDDIE CHENG @ecomEddie
51K Followers 563 Following Building 8 figure businesses https://t.co/1w37PXU25k | co-owner https://t.co/EQ7LS0uFqRMahesh Jethmalani (Mo.. @JethmalaniM
60K Followers 71 Following MP (Rajya Sabha) & Senior Advocate (SC)Min Choi @minchoi
66K Followers 763 Following AI Educator. 𝕏 about AI, solutions and interesting things. Showing how to leverage AI in practical ways for you and your business.Tim Denning @Tim_Denning
51K Followers 89 Following Blogger with 1B+ views that made me 7+ figures | I’ll teach you how to build an audience and make money writing | Get my free email course below ↓Tim Carden @timjcarden
13K Followers 675 Following Co-Founder at https://t.co/1ocm7Vmvwi. Building your favorite personal brands on X | 80M monthly impressions for clientsDwarkesh Patel @dwarkesh_sp
55K Followers 701 Following Being pretrained Host of Dwarkesh Podcast https://t.co/3SXlu7fy6N https://t.co/rEhnfYywXY https://t.co/hQfIWdM1Unadriane schwager @aschwags3
24K Followers 4K Following CEO & Co-Founder @GrowthAssistant - Elite global marketing, design, and influencer talent for brands, agencies and startups.Jaya Gupta @JayaGup10
4K Followers 3K Following tweets about AI, humor and SF vs NY. currently @foundationcap; previously McKinsey, @georgiatech alum, @stackfolio (acquired), @peak6, @raymondjamesomkaar @omkizzy
2K Followers 664 Following building agent infra | eng @uwaterloo | ✍️ dist sys @ https://t.co/dIQp42Qtyv for 5000+ SWEs | past @cartainc @autodeskPieter Abbeel @pabbeel
78K Followers 435 Following Diffusion Models; Large World Model; UniSim; TRPO; SAC; Ring Attention; MAML; HER; Domain Randomization; Decision Transformer; LLM as Zero-Shot Planners; RFM-1Deepak Pathak @pathak2206
16K Followers 316 Following I study topics in AI (machine learning, robotics & computer vision).Sanja Fidler @FidlerSanja
14K Followers 484 Following Associate Professor @UofT, Vice President of AI Research @nvidia, founding member of @VectorInst. Computer vision, deep learning, 3D. Opinions are my own.Frank Dellaert @fdellaert
11K Followers 1K Following CTO at Verdant Robotics, Robotics & Computer Vision Professor at Georgia Tech (on leave). Before: sabbatical at KUL, stints at Skydio, Facebook B*8, Google AI.Chelsea Finn @chelseabfinn
69K Followers 384 Following Asst Prof of CS & EE @Stanford. PhD from @Berkeley_EECS, EECS BS from @MITDevi Parikh @deviparikh
23K Followers 151 Following Former Sr. Director, GenAI @Meta. Prof @GeorgiaTech. Generative artist https://t.co/z4n9IRQ3s5. Co-founded Caliper. @CarnegieMellon @RowanUniversity alum.Sanjeev Arora @prfsanjeevarora
21K Followers 32 Following Director, @PrincetonPLI and Professor @PrincetonCS. Seeks math/conceptual understanding of deep learning and large AI models.Brandon Amos ✈️ I.. @brandondamos
14K Followers 2K Following research scientist @MetaAI (FAIR) | optimization, machine learning, control, and reinforcement learning | PhD from @SCSatCMUSilvio Savarese @silviocinguetta
9K Followers 43 Following Executive Vice President, Chief Scientist @salesforce. Adjunct Professor of Computer Science @Stanford University. Faculty co-director @StanfordSVL. #AIDhruv Batra @DhruvBatraDB
14K Followers 324 Following Senior Director (FAIR @MetaAI). Professor (@GeorgiaTech). Co-founded CaliperAI. Researcher in AI. @CarnegieMellon alum.Michael Black @Michael_J_Black
59K Followers 644 Following Director, Max Planck Institute for Intelligent Systems (@MPI_IS). Chief Scientist @meshcapade. Building 3D digital humans using vision, graphics, and learning.Noémie Federico @FedericoNoemie
773 Followers 362 Following Helping Founders build in the US @beondeck | O1 extraordinary alien 🛸🇺🇸🦅| culturally confused, linguistically challengedCabinet Minister, Min.. @memenist_
94K Followers 522 Following If you’ve made this far, make sure to hit that follow button. I RT blindly, so RTs and Likes are not endorsements..😌 Sometimes shameless hypocrite.Parag Mandpe @ParagMandpe
4K Followers 6K Following Quintessential Bombay guy. Love Vada pav, Cricket, Movies and Weekends. Ganpati Bappa Morya!.Santiago @svpino
353K Followers 445 Following I tell stories about technology and teach hard-core Machine Learning at https://t.co/iZifcK7n47. YouTube: https://t.co/pROi08OZYJDiv Garg @DivGarg9
17K Followers 99 Following Working on breaking things @MultiON_AI | RL + AI researcher | Adjunct Lecturer @Stanford CS | worked @nvidia Research, @apple SPG, @GoogleAI, @UberATGSteve Jurvetson @FutureJurvetson
70K Followers 69 Following Co-founder of Future Ventures and DFJ, supporting passionate founders to forge a better future. Early VC investor in Tesla, SpaceX, Planet, Commonwealth Fusion.Ross Taylor @rosstaylor90
6K Followers 880 Following Something new 🥷. Previously: @paperswithcode, reasoning lead @metaai, Galactica LLM lead, Atlas ML (acq by Meta)Greg Kamradt @GregKamradt
25K Followers 725 Following Building AI + B2B products 🖥️ Content: https://t.co/kLERwNtzqi Feedback is great: https://t.co/A6mrmjCem5 Prev. @digits @salesforceRobby Starbuck @robbystarbuck
442K Followers 10K Following New Film "The War On Children" Streaming Now @ https://t.co/wi7k3h7sTJ • Cuban American 🇺🇸 • Robby Starbuck Show Host • @AFPTN Ambassador • ❤️ @LandonStarbuckMichael Houck 💡 @callmehouck
55K Followers 956 Following Follow me to learn how to build and grow startups. 80,000 founders read my free weekly newsletter.David Atherton @DaveAtherton20
170K Followers 45K Following Journalist with @euroconofficial - libertarian, free markets, free speech. "Selfish smoker" -Daily Mirror, "Half arsed" -Jeremy Clarkson.Sunanda Roy 👑 @SaffronSunanda
64K Followers 359 Following Proud Indian. Dharmik. Anti-feminazi. Anti-Libtards. Music & Movieholic. Love🏏. Kick Boxer. Satirist. News. Perfectly imperfect. Not followed by @netanyahuRajeev Chandrasekhar .. @Rajeev_GoI
350K Followers 3K Following Union Minister of State for Entrepreneurship, Skill Develpmnt,Electronics & Technology, Jal Shakti - Chip Designer, Cellular pioneer,Tech Investor, Aviator🇮🇳Mini Nair @minicnair
42K Followers 399 Following Author, The Fourth Passenger , The Lines Of SeparationDanish Manzoor Bhat @TellDM
20K Followers 4K Following Editorial Director, Asia & Sr. VP Editorial & News Innovation @Newsweek | Advisor @RescuingIndians | 🇮🇳1st | 🎓IIM-A | #BengaluruHeals | #SabkaOximeterSharmishta Sharma @AnObserversView
6K Followers 623 Following Indian | Kashmiri🛕| Genocide Survivor | Western view isn’t the only view | I'm here to correct the narrative & call out political & religious hypocrisy.Maria Wirth @mariawirth1
139K Followers 1K Following Indian heart, German body. My book, title: Thank you India https://t.co/I9BetxcoIf over 150 articles on my website.GAURAV C SAWANT @gauravcsawant
1.4M Followers 2K Following Managing Editor, Anchor #IndiaFirst @ 10 pm @IndiaToday #Ranbhoomi 4 pm @aajtak. Reporter at heart. Author: #DatelineKargil & #VeerGatha. 7 Para Jumps + 1 AFFThe living portraits at Hogwarts are now technologically quite possible. Would like to buy one and enter my house this way
Clearly LLMs must one day run in Space Step 1 we harden llm.c to pass the NASA code standards and style guides, certifying that the code is super safe, safe enough to run in Space. en.wikipedia.org/wiki/The_Power… (see the linked PDF) LLM training/inference in principle should be super…
Chatting with @GroqInc’s CEO @JonathanRoss321. Groq has super fast token generation capabilities now. And, I was excited also to hear about his plans to scale up capacity aggressively and also expand this to other models than just LLMs! This is a good time to be building AI…
How to be as "smart" as Auto-Regressive LLMs: - memorize lots of problem statements together with recipes on how to solve them. - to solve a new problem, retrieve the recipe whose problem statement superficially matches the new problem. - apply the recipe blindly and declare…
There’s an art to distilling these to the absolute minimal necessary text. The human brain can’t comprehend how stupid these things are without practice.
Much has been said about many companies’ desire for more compute (as well as data) to train larger foundation models. I think it’s under-appreciated that we have nowhere near enough compute available for inference on foundation models as well. Years ago, when I was leading teams…
My remarks at the Oxford Union almost a yr ago have made their way across social media. I gave a perspective on what has changed in India, citing events & anecdotes to support my argument. I’m overwhelmed to see how it has resonated with so many of you.🙏 youtube.com/watch?v=yjFEYR…
You have given a wonderful glimpse of the massive transformations taking place across India, @palkisu!
My remarks at the Oxford Union almost a yr ago have made their way across social media. I gave a perspective on what has changed in India, citing events & anecdotes to support my argument. I’m overwhelmed to see how it has resonated with so many of you.🙏 youtube.com/watch?v=yjFEYR…
We have many Perplexity users who tell us that their companies don't let them use it at work due to data and security concerns, but they really want to. To address this, we're excited to be launching Perplexity Enterprise Pro: Perplexity Pro comes with SOC2, SSO, user management,…
AI will make expertise near free. Who will build the first billion $ revenue company with <100 employees with near free programmers/doctors/advisors/etc etc? Worth attempting!! The power of ideas powered by entrepreneurial energy will be hugely multiplied as the scarce resource
A GPT-4 level chatbot, available to use completely free, running at over 800 tokens per second on Groq. I'm genuinely mindblown by LlaMA 3. Try it with the link in the next tweet.
Haha. We're coming back for more. (but seriously folks: I had some input on our open source policy but I had no direct technical input on Llama-3)
You can now fine-tune Llama 3 without writing a single line of code! We are moving at breakneck speed. I recorded a video to show you how to fine-tune any open-source model in a few minutes. I'm using a GPT capable of taking a problem and turning it into a fine-tuned model…
Let's build a RAG app using MetaAI's Llama-3 (100% local):
Congrats to @AIatMeta on Llama 3 release!! 🎉 ai.meta.com/blog/meta-llam… Notes: Releasing 8B and 70B (both base and finetuned) models, strong-performing in their model class (but we'll see when the rankings come in @ @lmsysorg :)) 400B is still training, but already encroaching…
Nick Bostrom's Future of Humanity Institute at Oxford is shutting down. It seems that humanity's future is no longer in doubt, in case anyone was worried. futureofhumanityinstitute.org
O1 visa hacks for founders — build a startup in the US! Contrary to popular belief, you don’t need a Nobel prize, to raise any money, or to have a co-founder to get an O1 visa. You can be scrappy, a solo founder, and bootstrap. I got my O1 six months ago after being told I…
Multi-agent collaboration has emerged as a key AI agentic design pattern. Given a complex task like writing software, a multi-agent approach would break down the task into subtasks to be executed by different roles -- such as a software engineer, product manager, designer, QA…
🥁 Llama3 is out 🥁 8B and 70B models available today. 8k context length. Trained with 15 trillion tokens on a custom-built 24k GPU cluster. Great performance on various benchmarks, with Llam3-8B doing better than Llama2-70B in some cases. More versions are coming over the next…