Today at @answerdotai we've got something new for you: FSDP/QDoRA. We've tested it with @AIatMeta Llama3 and the results blow away anything we've seen before.
I believe that this combination is likely to create better task-specific models than anything else at any cost. 🧵
New paper from @OpenAI on prompt injection - it's the most detailed evaluation of the problem I've seen from them so far, and has some very interesting details
Posted some of my notes on the paper on my log here: simonwillison.net/2024/Apr/23/th…
New paper from @OpenAI on prompt injection - it's the most detailed evaluation of the problem I've seen from them so far, and has some very interesting details
Posted some of my notes on the paper on my log here: simonwillison.net/2024/Apr/23/th…
A claim of consciousness from an LLM has no more evidential value than the same from a character in a dream.
The latter is more plausible a priori as the hardware is known to support it.
New Command R+ from Cohere — 128k context, open weights for non-commercial use, commercial API priced similar to Claude 3 Sonnet
Tokenizer is designed to be efficient in 10 languages so definitely consider for non-English text. Multi-hop tool use sounds interesting too
New Command R+ from Cohere — 128k context, open weights for non-commercial use, commercial API priced similar to Claude 3 Sonnet
Tokenizer is designed to be efficient in 10 languages so definitely consider for non-English text. Multi-hop tool use sounds interesting too
Gemini 1.5 — 10M tokens and the demos to prove it can use them.
So many implications here. Why SFT when you can 100K-shot? And if it can translate Kalamang given a grammar and dictionary, what *can’t* the right words teach it?
Prompting is poised to eat everything.
Gemini 1.5 — 10M tokens and the demos to prove it can use them.
So many implications here. Why SFT when you can 100K-shot? And if it can translate Kalamang given a grammar and dictionary, what *can’t* the right words teach it?
Prompting is poised to eat everything.
229K Followers 3K Following@NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.
175K Followers 89 FollowingThe original AI alignment person. Missing punctuation at the end of a sentence means it's humor. If you're not sure, it's also very likely humor.
37K Followers 3K FollowingFounder/CEO @codegen. Tweets about AI, computing, and their impacts on society. Previously did startups, @palantir, @stanford. Not a pseudonym.
51K Followers 7K Followingbuilding things with #AI 🤖 #DALLE & #MidJourney adventurer ✍️ editor, https://t.co/77MJXuLSTd 🖼 curator of the https://t.co/8Xctk6XoPs
52K Followers 3K Followinggo to https://t.co/pWRBfY8kn2 - AI image editing IN YOUR BROWSER!
follow to watch a self funded founder beat VC backed AI startups with @dingboard_
23K Followers 480 Followinga really exciting new account
"have you ever though you might be like scott alexander? very smart, but can't do math" - anon
84K Followers 888 FollowingCovering the latest in AI R&D • ML Engineer • Ex-Mila researcher • MIT Lecturer • Building AlphaSignal, a technical newsletter read by 180,000+ ML experts.
11K Followers 5K FollowingI love enterprise technology and consumer tech. Data analytics and machine learning are the answer to enhance the user value for both.
185 Followers 1K FollowingI help Businesses Make Data data-driven decisions by finding valuable insight using Power BI | Business Analytics Expert | Business Analyst
478 Followers 4K FollowingA Global Talent Acquisition Company specialising in #D365FO, #D365CE & #d365BC. We also have a D365 Managed Services Team to cater for all in D365 & all SAAS
229K Followers 3K Following@NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern.
175K Followers 89 FollowingThe original AI alignment person. Missing punctuation at the end of a sentence means it's humor. If you're not sure, it's also very likely humor.
37K Followers 3K FollowingFounder/CEO @codegen. Tweets about AI, computing, and their impacts on society. Previously did startups, @palantir, @stanford. Not a pseudonym.
51K Followers 7K Followingbuilding things with #AI 🤖 #DALLE & #MidJourney adventurer ✍️ editor, https://t.co/77MJXuLSTd 🖼 curator of the https://t.co/8Xctk6XoPs
52K Followers 3K Followinggo to https://t.co/pWRBfY8kn2 - AI image editing IN YOUR BROWSER!
follow to watch a self funded founder beat VC backed AI startups with @dingboard_
23K Followers 480 Followinga really exciting new account
"have you ever though you might be like scott alexander? very smart, but can't do math" - anon
260K Followers 26 FollowingWe're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant Claude at https://t.co/aRbQ97uk4d.
5K Followers 92 FollowingResearch Scientist at the #llama team of Meta Generative AI, designing and training large language models. Opinions are my own.
844 Followers 619 FollowingDeep Learning and espresso slurping @MPI_IS + @Mila_Quebec. Previously, Physics & research fellow @UniHeidelberg, and research intern at @MetaAI & @awscloud.
4K Followers 302 Followinghead of eng/silicon at @fal (fal ai labs). also a python core developer / @thePSF fellow. building the most efficient inference engine for diffusion models.
14K Followers 4K Followingcovering twitter, tiktok & snap @theinformation. board member @aajasf. previously @nytimes et al. tips: [email protected] or erinkwoo.07 on signal
10K Followers 639 FollowingCS professor at Penn. Amazon Scholar at AWS. Author of The Ethical Algorithm (w/ Michael Kearns). I study machine learning, privacy, game theory, and fairness.
8K Followers 1K Followingwise AI; moral graphs; mechanism & game design; big data virtue ethics; meaning metrics; values-based choice theory @meaningaligned
17K Followers 899 FollowingFounder of @HigherOrderComp
Building the massively parallel future of computing
Reaching AGI to cure all diseases and suffering is all that matters
349 Followers 982 FollowingPhd @ucsbcs, Bachelor @tsinghua_uni, AI Safety, nlp, GenAI. Open to collaboration. Incoming Interns @Amazon and @AIatMeta
(Looking for full-time jobs)
578 Followers 462 FollowingShe/her.
AI Security Researcher at Microsoft Security Response Center (MSRC)
| prev. PhD @CISPA | Neurodivergent 🧠🦋 | peace for all #CeasefireNOW
2K Followers 1K Followingphd candidate @CMU_Robotics. ms @berkeley_ai. summers @GoogleAI, @msftresearch, @aurora_inno, @nvidia, @spacex. no model is an island.
9K Followers 80 FollowingGame Design and AI Research. Project December. One Hour One Life, Cordial Minuet, The Castle Doctrine, Diamond Trust, Sleep is Death, Gravitation, Passage.
1K Followers 1K FollowingGive me anonymous feedback at https://t.co/oPzivGEck5
Trying to make powerful AI go well. @sage_future_, @SamotsvetyF. Prev @oughtinc