Ben Edelman @EdelmanBen
Agent Security lead @ U.S. Center for AI Standards and Innovation. Prev: science of deep learning PhD @ Harvard benjaminedelman.com Joined March 2014-
Tweets112
-
Followers638
-
Following53
-
Likes146
This paper does a fantastic job conveying that: (1) Deep learning abounds in miraculous empirical regularities (2) A beautiful scientific theory has emerged over the past decade to explain the miracles (3) Yet most fundamental questions remain mysteries. The best is yet to come.
1/ Deep learning is going to have a scientific theory. We can see the pieces starting to come together, and it's looking a lot like physics! We're releasing a paper pulling together these emerging threads and giving them a name: learning mechanics. 🔨 arxiv.org/pdf/2604.21691 🔧
@zicokolter At CAISI we started using the phrase "agent hijacking" for prompt injections of agents because it avoids the inevitable confusion about the prompt injection vs jailbreak distinction (not to even mention direct vs indirect), and conveys impact more directly for a lay audience.
@zicokolter Yep agreed it's all the same underlying vulnerability; instruction hierarchy-style distinctions (app developer / user / external content) are "just" an abstraction. (I was also involved with the new paper, btw)
@zicokolter Post where Simon Willison coined prompt injection: simonwillison.net/2022/Sep/12/pr…. Paper where Greshake et al. coined indirect prompt injection: arxiv.org/abs/2302.12173
@zicokolter Fwiw, my understanding is that the original coinage of prompt injection was focused on contexts where the untrusted data comes from an untrusted user. Then Greshake et al. coined IPI to highlight the case where the attacker leverages data likely to be retrieved at inference time.
Excited to be part of this initiative. Join our team to advance the frontier of agent security research and standards! usajobs.gov/job/856267900
The future of AI is agentic, and America is leading the way to make it secure and interoperable. A new AI Agent Standards Initiative is launching this week @NIST to drive industry-led standards and open protocols that build trust and advance innovation. nist.gov/news-events/ne…
One of the best places if you have technical background and care about AI going well!
People sometimes ask me how to leverage a technical background to jump into U.S. AI policy. As of this week my answer is straightforward: apply to join us at CAISI! We're a startup within government, and we're doing a hiring surge.
Seems like a great opportunity for technical talent to come into government and help the USG make sound, technically informed decisions on AI
CAISI is hiring for a bunch of exciting new roles, from partnerships to technical experts in AI x bio / chem and more. They're serious about bringing in strong researchers & engineers and letting them do good work. Based in DC or SF: nist.gov/caisi/careers-…
CAISI is hiring for a bunch of exciting new roles, from partnerships to technical experts in AI x bio / chem and more. They're serious about bringing in strong researchers & engineers and letting them do good work. Based in DC or SF: nist.gov/caisi/careers-…
My Agent Security team is hiring Research Engineers & Scientists. Other teams are hiring people with strong technical backgrounds too: Frontier Assessment, Cyber, Chem/Bio, Applied Systems, and Partnerships. Job postings are listed here: nist.gov/caisi/careers-…
The United States is the center of the AI revolution. We need dedicated public servants to ensure our government is smart on AI issues.
People sometimes ask me how to leverage a technical background to jump into U.S. AI policy. As of this week my answer is straightforward: apply to join us at CAISI! We're a startup within government, and we're doing a hiring surge.
At CAISI, we're the U.S. government's leading experts on agent security. We published this RFI so deployers, developers, and experts can provide insights that inform our research and NIST guidelines development. Responses due March 9th!
CAISI has published an RFI about securing AI agents. It seeks insights from AI agent deployers, developers, and computer security researchers. Questions address the current threat landscape, mitigations, measurements, and other security considerations unique to AI agents.
CAISI is recruiting an intern to support an agent security standards project. Position closes Jan. 15 for a February start. Please help spread the word. Details in thread:
@boazbaraktcs Since I organized this by model family branding (GPT) rather than developer (OpenAI), I think the move would be to add a separate o-series line. And don't get me started about Sonnet vs Opus
DEMONX @DEMONXHARD
2 Followers 3K Following
HFC @hellofellowcelo
0 Followers 108 Following
aaryan reddy @ReddyAarya36823
1 Followers 228 Following always allegiant to the state of israel saar
Robert Scoble @Scobleizer
585K Followers 50K Following San Francisco/Silicon Valley AI | Robots, holodecks, BCIs, analysis of new things | Ex-Microsoft, Rackspace, Fast Company | Wrote eight books about the future.
Halie Craig @haliecraig
844 Followers 1K Following Trade, tech, + cap markets. Proud alum @SenateCommerce @SenToomey @BankingGOP @Meta @Penn. Views mine.
Will Bradbury @willbradbury
8 Followers 178 Following
Joel Peña Muñoz Jr @JoelPenaMunozJr
104 Followers 956 Following Author of How the World Learns, Advancing the frontier of Cognitive Physics (Founder) 認知物理学
Eric J. Michaud @ericjmichaud_
4K Followers 1K Following Trying to make deep neural networks among the best understood objects in the universe. 💻🤖🧠👽🔭🚀
John Shin @johnshininfo
3 Followers 155 Following Computer Scientist at SRI International. AI for remote sensing and time series. Personal account.
idk @0xfdff
3 Followers 223 Following
Klee @xiaonando
8 Followers 946 Following
Pierfrancesco Beneven... @PierBeneventano
1K Followers 2K Following Postdoc at @MIT | ex PhD student @Princeton | Thinking of how to frame theoretically agents and using agents for theory research, while brewing my espresso.
halfdiminished @halfdiminished0
16 Followers 2K Following
Jun @junasi8
37 Followers 5K Following
William Gilpin @wgilpin0
6K Followers 2K Following asst prof @UTAustin physics interested in chaos, fluids, & biophysics.
Steam Hesabı @SteamH22683
12 Followers 714 Following
Syed Ali Raza (Ali) @Ali_SyedRaza
3K Followers 7K Following MD. Neurologist. Neuroimmunology fellow at @NIH/@NINDSnews - The Reich lab. Neurology/Neuroscience/Immunology/Physics/Math. Opinions are my own.
Abdulkadir Canatar @canatar_a
356 Followers 995 Following Research Fellow @FlatironCCN. Theoretical Neuroscience, Machine Learning, Physics. Prev: @Harvard and @sabanciu
Henri Virta @HenriVirta
23 Followers 2K Following
Jorge Bravo Abad @bravo_abad
11K Followers 9K Following AI for Science | Prof. of Physics @UAM_Madrid. Author of "IA y Física": https://t.co/Nxue94kfOG & "Ciencia 5.0": https://t.co/Y3rBUU7Xzg
Jamie Simon @learning_mech
1K Followers 75 Following doing fundamental science of deep learning | PhD from Berkeley | can catch a whole egg in my mouth
Alessandro Favero @alesfav
685 Followers 921 Following Physics-AI fellow @Cambridge_Uni explaining the scientific principles behind AI. Formerly @EPFL, @Amazon AI Labs.
Felix Nguyen @felixcantcode
27 Followers 1K Following mechanical sympathizer, https://t.co/WTC0mDn536, blog: https://t.co/vyg3TJkfqX opinions are of my own
unnikuttan @pqckuttan
14 Followers 2K Following
q_b @q_bbbb
1 Followers 299 Following
Daniel Kunin @KuninDaniel
1K Followers 310 Following postdoc @UCB_MillerInst PhD @ICMEStanford creator @SeeingTheory
hal @hallium9
41 Followers 1K Following Seeking inspiration, shouting into the abyss, something something joie de vivre
BHASKAR NANDY @BHASKARNANDY1
78 Followers 3K Following Technology Solutions Developer in Energy Transition and Climate Change.Loves Adventure Sports,Quiz,Reading,People Networking.
tssq @tssq137366
11 Followers 561 Following
Zico Kolter @zicokolter
28K Followers 752 Following Professor and Head of Machine Learning Department at @CarnegieMellon. Board member @OpenAI and @Qualcomm. Chief Scientist @GraySwanAI.
Akhil Deo @akhildeo94
1K Followers 4K Following AI policy @ https://t.co/pownT7J54P | Tweets about the geopolitics of technology | Prev: @flixrisk, @orfonline
Sam Kaufmann @SamKaufmann3
24 Followers 57 Following I do climate stuff at @SilverLiningNGO. I'm not really sure why I have a Twitter account.
Jason Statham @stanakatic16887
4 Followers 120 Following
AISecHub @AISecHub
9K Followers 7K Following 🚀 AISecHub | AI & Cybersecurity | Securing AI systems, and sharing insights on emerging challenges | https://t.co/YeYtqq5tJC
three_rail @three_rail
55 Followers 578 Following Halluccinator-in-Chief. I'm just a plumber doing plumbing things.
Elise Dunn @Dunn236167Dunn
3 Followers 344 Following
Jess Sorrell @OptimistsInc
1K Followers 893 Following Assistant Prof @ Johns Hopkins CS. Interested in theory of ML, secure computation. All cat pictures are my own and do not represent the cats of my employer.
Yo Shavit @yonashav
9K Followers 1K Following ai resilience @foundationOAI. Past: @openai / @HarvardSEAS / @SchmidtFutures / @MIT_CSAIL. Tweets my own; on my head be it.
Samuel Curtis @samuelmcurtis
604 Followers 2K Following AI x bio @ U.S. CAISI prev. @RosettaCommons @biotech_gov @openmsf @thefuturesoc
Yafah Edelman @YafahEdelman
1K Followers 523 Following Head of Data and Trends @EpochAIResearch she/her
Peter Henderson @PeterHndrsn
6K Followers 982 Following Assistant Professor @ Princeton (RL+strategic decisionmaking+Law). Prev: Stanford (JD/PhD); McGill/Mila; Meta FAIR; Amazon; Cal Supreme Court.
William Merrill @lambdaviking
5K Followers 690 Following incoming Prof @TTIC_Connect theory and pretraining at @allen_ai Will irl, TC0 enthusiast
Xander Davies @alxndrdavies
4K Followers 878 Following red team lead @AISecurityInst PhD student @OATML_Oxford, prev @Harvard (https://t.co/695XYMJSua)
Edoardo Debenedetti @edoardo_debe
1K Followers 2K Following PhD student @CSatETH 🇨🇭 | AI Security and Privacy 😈🤖 | From 🇪🇺🇮🇹 | prev research intern @meta @google
Luke Bailey @LukeBailey181
1K Followers 359 Following CS PhD student @Stanford advised by @tengyuma & @tatsu_hashimoto. Former CS and Math undergraduate @Harvard. Website: https://t.co/zDpmBGVhkR
Jaime Sevilla @Jsevillamol
5K Followers 664 Following Director of @EpochAIResearch. Trying to glimpse the future of AI.
Alberto Bietti @albertobietti
2K Followers 2K Following Machine learning research. Research scientist @FlatironInst CCM, previously @MetaAI, @NYUDataScience, @Inria, @Quora.
Roy Rinberg @RoyRinberg
617 Followers 1K Following PhD student working on trustworthy ML at Harvard. Opinions are solely yours and do not express my own views. Banner image is from the webcomic: minus.
Cengiz Pehlevan @CPehlevan
3K Followers 1K Following Theoretical neuroscience, theory of neural computation, physics of learning and intelligence. Associate Professor of Applied Mathematics @Harvard SEAS
Sílvia Casacuberta @SiCaPu
819 Followers 2K Following CS PhD student & @KnightHennessy scholar @Stanford. Prev.: @UniofOxford with @rhodes_trust, @Harvard '23, @MPI_IS, @CSatETH, @IBM. Theory CS for Trustworthy AI
Wes Gurnee @wesg52
4K Followers 234 Following Trying to read Claude’s mind. Interpretability at @AnthropicAI Prev: Optimizer @MIT, Byte-counter @Google
Javier Rando @javirandor
4K Followers 780 Following security and safety research @anthropicai • people call me Javi • vegan 🌱 • opinions are my own
Sadhika Malladi @SadhikaMalladi
2K Followers 245 Following Postdoc researcher at MSR NYC; incoming faculty at UCSD CSE; CS PhD at Princeton
Dylan Foster 🐢 @canondetortugas
4K Followers 1K Following Foundations of RL/AI @MSFTResearch. Previously @MIT @Cornell_CS https://t.co/vQIdUzsw8B RL Theory Lecture Notes: https://t.co/bhgL3aKIk0
Eric Neyman @ericneyman
2K Followers 132 Following Professional reference class tennis player. I like non-fillet frozen fish, packaged medicaments, and other oily seeds.
Alex Atanasov @ABAtanasov
2K Followers 2K Following Fascinated by scaling and universality. PhD from @harvardphysics. Not a Bayesian. Opinions my own 🇧🇬
Max Nadeau @MaxNadeau_
2K Followers 563 Following Funding research to make AIs more understandable, truthful, and dependable at @coeff_giving.
Elisabetta Cornacchia @Elisabetta68885
104 Followers 140 Following Assistant Professor at Bocconi University
Arvind Narayanan @random_walker
127K Followers 541 Following Princeton CS prof and Director @PrincetonCITP. Coauthor of "AI Snake Oil" and "AI as Normal Technology". https://t.co/ZwebetjZ4n Views mine.
Sanjeev Arora @prfsanjeevarora
27K Followers 118 Following Director, @PrincetonPLI and Professor @PrincetonCS. Seeks math/conceptual understanding of deep learning and large AI models. Also on the "other" social network
Keyon Vafa @keyonV
5K Followers 884 Following Postdoctoral fellow at @Harvard_Data | Former computer science PhD with @Blei_Lab at @Columbia University | Researching AI + implicit world models
Samuel Marks @saprmarks
5K Followers 148 Following AI safety research @AnthropicAI, leading Cognitive Oversight team. Previously: postdoc with @davidbau, math PhD at @Harvard.
Sunny Qin @sunnytqin
111 Followers 111 Following Machine Learning PhD @ Harvard Apple Scholar 2025 Data-Centric ML
Naomi Saphra @nsaphra
11K Followers 1K Following Waiting on a robot body. All opinions are universal and held by both employers and family. Now a dedicated grok hate account. Accepting ML/NLP PhD students.
David Brandfonbrener @brandfonbrener
2K Followers 709 Following member of technical staff @AnthropicAI. previously: research scientist, FAIR @AIatMeta, fellow @KempnerInst @Harvard, phd @nyu_courant
Roger Grosse @RogerGrosse
12K Followers 808 Following
Andrej Risteski @risteski_a
4K Followers 2K Following Machine learning researcher. Associate Professor, ML department at CMU (@mldcmu).
David Alvarez Melis @elmelis
2K Followers 2K Following Asst. Prof. @hseas @KempnerInst || Researcher @MSRNE || ML + NLP || Previously: @MIT_CSAIL NYU @IBMResearch @ITAM_mx
Fred Zhang @FredZhang0
1K Followers 615 Following @Meta, prev research scientist @GoogleDeepMind, PhD @Berkeley_EECS, DM open
Ezra Edelman @ezra_edelman
73 Followers 6 Following PhD candidate at UPenn. Interested in deep learning theory
Bingbin Liu @BingbinL
1K Followers 320 Following Research Fellow at the Kempner Institute at Harvard University.
Gustaf Ahdritz @gahdritz
702 Followers 144 Following ML Foundations Group @hseas. Previously @MoAlQuraishi's lab @Columbia.
Rosie Zhao @rosieyzh
748 Followers 789 Following PhD student with @hseas ML Foundations Group. Previously @mcgillu.
Oncescu Costin-Andrei @costinoncescu
98 Followers 177 Following PhD student in ML foundations @ Harvard. CS @ Oxford. IOI/ICPC WF medalist. Interned @ Jane Street, HRT, Five Rings, Together AI
Depen Morwani @depen_morwani
334 Followers 171 Following PhD student at Harvard ML Foundations, Research Associate at Google AI, completed MS from IIT Madras
You might like
