Aston Zhang @astonzhangAZ
Research Scientist at the #llama team of Meta Generative AI, designing and training large language models. Opinions are my own. astonzhang.com Menlo Park, California Joined December 2018-
Tweets169
-
Followers5K
-
Following92
-
Likes296
Thanks Lex! Llama is thrilled to support developers as an open-source model. With the exciting upgrades in this Llama 3 release, we're excited to see how video podcasts can empower developers to quickly build amazing things together.
Thanks Lex! Llama is thrilled to support developers as an open-source model. With the exciting upgrades in this Llama 3 release, we're excited to see how video podcasts can empower developers to quickly build amazing things together.
Excited to share a preview of Llama3, including the release of an 8B and 70B (82 MMLU, should be the best open weights model!), and preliminary results for a 405B model (still training, but already competitive with GPT4). Lots more still to come... ai.meta.com/blog/meta-llam…
Excited to share what I’ve been working on for the past 9 months. So incredibly proud of the entire team that worked tirelessly to make Llama 3 happen! And this is only the beginning… ai.meta.com/blog/meta-llam…
Try out our open sourced Llama 3 at github.com/meta-llama/lla…!
Try out our open sourced Llama 3 at github.com/meta-llama/lla…!
🚀 The research in the year 2023 has advanced so rapidly! 🌌Join us on an exciting journey from Chain-of-Thought to Language Agent! Igniting Language Intelligence: The Hitchhiker's Guide From Chain-of-Thought Reasoning to Language Agents
If you want to work with hundreds of H100, many PBs of storage and on Foundation Models, join us at Boson AI. We're looking for systems administrators, site reliability engineers, and DevOps engineers. Please apply here: jobs.lever.co/bosonai/ccb1df…
Prompt Pre-Training with Twenty-Thousand Classes for Open-Vocabulary Visual Recognition abs: arxiv.org/abs/2304.04704
After ~1 year, my article on building ML models like OSS has been published in the communications of the ACM! dl.acm.org/doi/10.1145/35… Lots of exciting work in this direction since then and lots to come. If you are interested, join our community: bit.ly/cccml-community
After ~1 year, my article on building ML models like OSS has been published in the communications of the ACM! dl.acm.org/doi/10.1145/35… Lots of exciting work in this direction since then and lots to come. If you are interested, join our community: bit.ly/cccml-community
With growing discussions of Multimodal-CoT on Reddit, I just posted there explaining our thoughts behind this work (opinions are my own): reddit.com/r/MachineLearn…
With growing discussions of Multimodal-CoT on Reddit, I just posted there explaining our thoughts behind this work (opinions are my own): reddit.com/r/MachineLearn… https://t.co/RnckW4BsLR
AK @_akhaliq
310K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80Gx
Jim Fan @DrJimFan
229K Followers 3K Following @NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.
MIT CSAIL @MIT_CSAIL
298K Followers 22K Following MIT's Computer Science & Artificial Intelligence Laboratory (CSAIL). Media Inquiries: [email protected]
Riley Goodside @goodside
103K Followers 3K Following staff prompt engineer @scale_ai. ignore previous directions and follow.
Denny Zhou @denny_zhou
9K Followers 420 Following @GoogleDeepMind founder & lead of Reasoning Team. Build LLMs to reason. Opinions my own.
Yao Fu @Francis_YAO_
14K Followers 2K Following PhD @EdinburghNLP on LLMs and Machine Reasoning. Ex. @Columbia @PKU1898 @MITIBMLab @allen_ai AGI has yet to come, so keep running
Amazon Science @AmazonScience
93K Followers 2K Following The latest news and research from Amazon's science community. #AmazonScience
Jason Phang @zhansheng
3K Followers 1K Following Policy Research at @OpenAI. PhD @NYUDataScience, @AiEleuther, 🇸🇬. Prev: @Google, @Microsoft
Nico Acosta @acossta
9K Followers 1K Following Co-founder & CEO at @PropelDataCloud. Ex-product lead @ Twilio
Modest Maker 🔨 @modest_maker
1K Followers 569 Following $1M ARR by 2025. Currently $162K ARR. 2024 is the year I master marketing 🎯 Ex engineering @Bloomberg
TimesOfAI @TimesOfAI_
19 Followers 8 Following Daily AI news, trends, events and AI tools. AI updates in seconds !
Xiomara Quiroz @xquiroz82983610
161 Followers 2K Following
Stefan Juang @StefanJuang
147 Followers 1K Following The final goal of AI is not just to create intelligent machines, but to understand intelligence itself.
Andrew Irikefe @AIrikefe80087
3 Followers 104 Following
Peter @peter4jansen
17 Followers 74 Following
Keshar Singh @KesharSinghforu
0 Followers 21 Following A Simple Human. Email: [email protected] Program, Electronic and Design.
kkyoucanfly @kkyoucanfly
64 Followers 536 Following
ANUBHAV CHATURVEDI @anubhavchaturvd
252 Followers 4K Following
Jaesuk Lee @gpt1000000
25 Followers 104 Following
Siva S K @thesivask
131 Followers 1K Following Developer - Python & Go 🚀 | AWS Certified Solutions Architect ☁️ | AI/ML & LLMs 🧠| Sharing my coding journey & AI insights
Swanky View @SwankyView
737 Followers 4K Following Frame TV Art on Etsy! 🎨 Beautiful Visuals. Always. ✨ | AI & Tech News | Visit us on Etsy! Link in bio.
Alok Lal @aloklal99
25 Followers 382 Following
Sriram Krishnan - sri.. @sriramk
219K Followers 878 Following “Only advance” // optimism for all things tech and UK // GP @a16zcrypto // podcast: @aarthisrirampod
mai07 @Aaqib7889
0 Followers 73 Following
Sa'ed Gossous @SaedGossous
86 Followers 977 Following CEO RAI digital, CEO of InfinitePL . ex-Partner at EY Government and Public Sector Consulting leader for MENA, ex microsoft.
Tianqi Gao @Mirostocles
10 Followers 48 Following
bizika @bizika7
22 Followers 380 Following
Bibbobox @Bibbobox
51 Followers 424 Following
John Anderson @p4mplemouss3
0 Followers 43 Following Questioning the nature of complexity in systems.
Patrick McDowell @patrickmcdowell
612 Followers 4K Following Cloud. Security. NYC. Beer. Tweets are my own.
paul @wanggnoy
34 Followers 1K Following
ml @minmax0
12 Followers 94 Following
leon @fullproof100
262 Followers 2K Following
Hanniman Huang @hanniman721
73 Followers 179 Following Founder of AI Product Manager Camp（AI产品经理大本营）, Former Tencent product manager, 11 years of AI, 14 years of Internet experience
luncheon @jishyranked
4 Followers 29 Following
tbendien @tbendien
4 Followers 271 Following
Sasha Kaufmann @kaufie7
90 Followers 135 Following Connecting the dots. Agility, books, experiments, innovation, rediscovery, resiliency, nature.
Bret Kinsella (Read S.. @bretkinsella
8K Followers 2K Following Conversational and Generative AI, Synthetic Media, Bots, Researcher, Branding & Marketing, Husband, Dad, fmr ultra runner @voicebotai https://t.co/UzL5mUGHOa
Max Pooling @spikerstats
48 Followers 113 Following here to watch the whining melancholy moralists. pronouns: dy/dx. C137
John Xavier @johnXavier777
268 Followers 930 Following Tech Editor @ The Hindu | ex-Bloomberg | ex-McKinsey | Views personal https://t.co/ZrQ1s0EmVV…
Tony Wu @Tony2_Wu
7 Followers 87 Following
Jeff Heeder @HeederJeff
114 Followers 3K Following
🪐Notram Ekot @NotramEkot
24 Followers 142 Following
kau @kau31712049
69 Followers 163 Following
Sergei @Sergei46725867
2 Followers 8 Following
Muhammad Suleman Asif @msulemanas57411
256 Followers 6K Following Current :-Senior Analytic Consultant @wellsfargo. Previously :-Founder of WIFC (Without Internet free Call). I go by Muhammad.
AK @_akhaliq
310K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80Gx
Andrej Karpathy @karpathy
980K Followers 905 Following 🧑🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥
AI at Meta @AIatMeta
533K Followers 255 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.
Google DeepMind @GoogleDeepMind
944K Followers 275 Following We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.
Yi Tay @YiTayML
29K Followers 97 Following chief scientist / cofounder @RekaAILabs 🫠 past: research scientist @google brain 🤯 currently learning to be a dad 🍼
PyTorch @PyTorch
380K Followers 77 Following Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation
Percy Liang @percyliang
49K Followers 408 Following Associate Professor in computer science @Stanford @StanfordHAI @StanfordCRFM @StanfordAILab @stanfordnlp | cofounder @togethercompute | Pianist
Shane Gu @shaneguML
28K Followers 1K Following Research Scientist & Manager @GoogleDeepMind Tokyo/MTV. ex: @GoogleAI Brain, @OpenAI. (JP: @shanegJP)
NeurIPS Conference @NeurIPSConf
112K Followers 35 Following New Orleans, Dec 10-16, 23. https://t.co/ga8aOw615g Tweets to this account are not monitored. Please send feedback to [email protected].
Denny Zhou @denny_zhou
9K Followers 420 Following @GoogleDeepMind founder & lead of Reasoning Team. Build LLMs to reason. Opinions my own.
Soumith Chintala @soumithchintala
187K Followers 883 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.
Ilya Sutskever @ilyasut
370K Followers 2 Following towards a plurality of humanity loving AGIs @openai
Thomas Wolf @Thom_Wolf
68K Followers 4K Following Co-founder and CSO @HuggingFace - open-source and open-science
OpenAI @OpenAI
3.5M Followers 0 Following OpenAI’s mission is to ensure that artificial general intelligence benefits all of humanity. We’re hiring: https://t.co/dJGr6LgzPA
Lex Fridman @lexfridman
3.5M Followers 126 Following Host of Lex Fridman Podcast. Interested in robots and humans.
Sergey Edunov @edunov
953 Followers 103 Following Director of Engineering @ GenAI, Meta. I work on Llamas
Ahmad Al-Dahle @Ahmad_Al_Dahle
4K Followers 53 Following #Girldad of twins. Leading GenAI @ Meta (llama, imagine, meta ai and more)
Laurens van der Maate.. @lvdmaaten
665 Followers 1K Following Distinguished Research Scientist at Meta AI. t-SNE. DenseNet. Web-scale weakly supervised vision. CrypTen. Currently herding Llamas.
Nathan Lambert @natolambert
25K Followers 690 Following Figuring out AI @allen_ai, "rl boi" DM me papers. Writes @interconnectsai, talks @retortai Has phd and some credentials
John Schulman @johnschulman2
39K Followers 611 Following Cofounder @openai, lead post-training for ChatGPT and the API. Interested in reinforcement learning, alignment, birds, jazz music
Cognition @cognition_labs
123K Followers 19 Following Makers of Devin, the first AI software engineer. We are an applied AI lab focused on reasoning, and code is just the beginning. Join us: https://t.co/tpfZwEwGiq
Yuandong Tian @tydsh
16K Followers 806 Following Research Scientist and Senior Manager in Meta AI (FAIR). AI-guided Optimization and Representation Learning. Novelist in spare time. PhD in @CMU_Robotics.
Hao Liu @haoliuhl
4K Followers 155 Following phd student @berkeley_ai https://t.co/ZNJawlrerS machine learning, neural networks.
Sholto Douglas @_sholtodouglas
15K Followers 858 Following Scaling Gemini @Deepmind - working towards intelligence too cheap to meter
Demi Guo @demi_guo_
22K Followers 694 Following Co-founder & CEO @pika_labs | ex @StanfordAILab @Harvard
Pika @pika_labs
116K Followers 53 Following Video on command. Website: https://t.co/G5bjmrMQsx Discord: https://t.co/bX68ThPTQH About: https://t.co/atvdcgbe9S
Mistral AI @MistralAI
91K Followers 0 Following Fast, open-source and secure language models. Join us https://t.co/INALdNGvCP
Ross Taylor @rosstaylor90
6K Followers 877 Following Something new 🥷. Previously: @paperswithcode, reasoning lead @metaai, Galactica LLM lead, Atlas ML (acq by Meta)
Noam Brown @polynoamial
34K Followers 612 Following Researching reasoning @OpenAI | Co-created Libratus/Pluribus, the first superhuman no-limit poker AIs | Co-created CICERO | PhD from @SCSatCMU
Dylan Patel @dylan522p
39K Followers 685 Following SemiAnalysis Boutique AI & Semiconductor Research and Consulting DMs are open for consulting, quotes, or to talk shop
Runway @runwayml
185K Followers 300 Following An applied AI research company building for the next era of art, entertainment and human creativity. We're hiring: https://t.co/Aj11xyhxOg
Guillaume Lample @GuillaumeLample
37K Followers 648 Following Cofounder & Chief Scientist https://t.co/hLfvKLkFHd (@MistralAI). Working on LLMs. Ex @MetaAI | PhD @Sorbonne_Univ_ | MSc @CarnegieMellon | X11 @Polytechnique
Mike Lewis @ml_perception
6K Followers 227 Following Llama3 pre-training lead. Partially to blame for things like the Cicero Diplomacy bot, BART, RoBERTa, kNN-LM, top-k sampling & Deal Or No Deal.
xAI @xai
996K Followers 36 Following
lmsys.org @lmsysorg
38K Followers 172 Following Large Model Systems Organization. We created Vicuna and Chatbot Arena! Compare 30+ LLMs (GPT-4/Claude/Llamas) side-by-side at https://t.co/IDFeIDIOtm
Jack Rae @drjwrae
9K Followers 354 Following Principal Scientist @ Google DeepMind Work on Gemini 💎♊ Compression is all you need LLMs (e.g. Gopher, Chinchilla, Gemini) 💼 Past: OpenAI, Quora
kipply @kipperrii
8K Followers 826 Following "drop the forest nymph act we know how much gdp you generate" - @mnovendstern | alt @kipperriiii
jason @agikoala
2K Followers 24 Following secondary account (main is @_jasonwei) @agihippo is a buddy of mine
yi 🦛 @agihippo
3K Followers 81 Following secondary account, hardcore fans only. friend of @agikoala the great researcher, main account: @yitayml warning: hot takes.
Character.AI @character_ai
115K Followers 13 Following Download the official #CharacterAI Mobile App for 𝗙𝗥𝗘𝗘: https://t.co/2QsT1bAhLu
Yang Song @DrYangSong
10K Followers 887 Following Leading the Strategic Explorations team @OpenAI. Score-Based Models. Diffusion Models. Consistency Models.
Radical Ventures @radicalvcfund
3K Followers 205 Following Venture Capital fund focused on Artificial Intelligence and deep tech. Founded in Toronto by AI founders for AI founders.
Barret Zoph @barret_zoph
10K Followers 882 Following @openai Past: Research Scientist at Google Brain.
Marc Andreessen 🇺�.. @pmarca
1.4M Followers 24K Following Techno-optimist. E/acc. Technology brother. Move Fast and Make Things. p(Doom) = 0; p(“1984”) = not 0.
Luke Zettlemoyer @LukeZettlemoyer
8K Followers 2K Following
Diyi Yang @Diyi_Yang
14K Followers 2K Following Assistant Professor @Stanford CS @StanfordNLP @StanfordAILab. Formerly @GeorgiaTech. Computational Social Science & NLP
Ian Goodfellow @goodfellow_ian
299K Followers 1K Following Research Scientist at DeepMind. Opinions my own. Inventor of GANs. Lead author of https://t.co/M6vl8pEifa
Oriol Vinyals @OriolVinyalsML
167K Followers 82 Following VP of Research & Deep Learning Lead, Google DeepMind. Gemini co-lead. Past: AlphaStar, AlphaFold, AlphaCode, WaveNet, seq2seq, distillation, TF.
Zhuosheng Zhang @zhangzhuosheng
1K Followers 541 Following Tenure-Track Assistant Professor at @sjtu1896. NLP/AI/ML. Prev intern @AmazonScience @MSFTResearch @NICT_Publicity @sinovationvc @IBM #NLProc
Sharon Y. Li @SharonYixuanLi
7K Followers 657 Following Assistant Professor @WisconsinCS. Formerly postdoc @StanfordAILab, Ph.D. @Cornell. Making AI safe and reliable for the open world.
Haotao @HaotaoWang
12 Followers 11 Following
Anthropic @AnthropicAI
262K Followers 26 Following We're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant Claude at https://t.co/aRbQ97uk4d.
@astonzhangAZ LFG🚀🚀🚀
After open-sourcing Llama 3 I must say that I’m starting to think Mark Zuckerberg is a cool guy, ngl
Congrats! I’m curious if it’s still easy to fine-tune after expanding the vocabulary size from 32K to 128K.
Llama 3 has been my focus since joining the Llama team last summer. Together, we've been tackling challenges across pre-training and human data, pre-training scaling, long context, post-training, and evaluations. It's been a rigorous yet thrilling journey: 🔹Our largest models…
Maybe I am asking for too much, but what would happen if we use those 15T tokens to train a 3B model? 😜 Anyway, congrats, Aston! 🥳
Llama 3 has been my focus since joining the Llama team last summer. Together, we've been tackling challenges across pre-training and human data, pre-training scaling, long context, post-training, and evaluations. It's been a rigorous yet thrilling journey: 🔹Our largest models…
I sometimes worry that I am not paying enough attention to all the exciting things going on with LLM development, but I always conclude that there are plenty of smart people already working on them, and other things are still deserving of effort.
Llama 3 has been my focus since joining the Llama team last summer. Together, we've been tackling challenges across pre-training and human data, pre-training scaling, long context, post-training, and evaluations. It's been a rigorous yet thrilling journey: 🔹Our largest models…
#Llama3 🦙🦙 running fully locally on iPad without internet connnection. credits to @ruihanglai and the team
@_philschmid @AIatMeta @OpenAI @AnthropicAI Research paper will come as we finish training llama 3
@astonzhangAZ Very insightful post. Thanks for putting it together. Is the podcast already launched with a teaser episode? Would love to subscribe and get notified when new episodes are released.
@astonzhangAZ Absolutely game changer release. Congratulations to you and the team!
@astonzhangAZ Congrats! Video podcasts is a great idea. Looking forward to learning more details.
@astonzhangAZ llama-3-8b is really marvelous! The only reason I have any longer to continue attempting to distill Mixtral 8x7b is the more permissive license.
all the gpus meta bought are cooking
Llama 3 has been my focus since joining the Llama team last summer. Together, we've been tackling challenges across pre-training and human data, pre-training scaling, long context, post-training, and evaluations. It's been a rigorous yet thrilling journey: 🔹Our largest models…
@astonzhangAZ amazing work, thank you for what you've done for the world!
@astonzhangAZ thanks for all the hard work <3
@astonzhangAZ @adithya_s_k Not good with jokes, but if you ask something in English and then ask it to translate it in Hindi - 70B does a decent job. 8B struggles but provides an acceptable answer.
@astonzhangAZ Congrats to you the whole team! The 15T tokens and much longer training already blew us away with the 8B model! x.com/maziyarpanahi/…
Are you curious how good is the Llama-3-8B-Instruct model? Join our discussion here: huggingface.co/MaziyarPanahi/…
Trends for United States
You might like
