Alexandra Proca @a_proca
PhD student @imperialcollege. theoretical neuroscience, deep learning. 🦋https://t.co/LWcL9aTHlI aproca.github.io London, England Joined April 2020-
Tweets90
-
Followers240
-
Following320
-
Likes670
In summary, we expand the study of superposition to recurrent architectures, enabling us to study how temporal information acts as a capacity constraint and affects feature geometry. Our work highlights how superposition affects dynamics and is shaped by time.
0
0
3
71
0
View Details
We induce spatial superposition by using 5D input (A-E) and temporal superposition by increasing k. As memory demand (k) increases, the RNN drops features in favor of representing others for a longer duration. This representational tradeoff leads to a strategy that is all-or-none
Excited to share our ICLR Oral paper, co-lead with Pratyaksh Sharma, and with @lucas_prie @PedroMediano! We study how feature geometry is shaped by memory demands in RNNs, introducing the concept of temporal superposition. openreview.net/forum?id=7cMzT…
Alexandra Proca retweeted
1/ Deep learning is going to have a scientific theory. We can see the pieces starting to come together, and it's looking a lot like physics! We're releasing a paper pulling together these emerging threads and giving them a name: learning mechanics. 🔨 arxiv.org/pdf/2604.21691 🔧
Alexandra Proca retweeted
📢Join us for the next UniReps x @ELLISforEurope speaker series happening on 29th April at 4:00 PM CET with @neurosacramento and Paul Friedrich!👾
Alexandra Proca retweeted
📢The next UniReps x @ELLISforEurope speaker series event is happening on 26 February at 4:00 PM CET with @orvieto_antonio and @SaraKangaslahti . Don’t miss it!🚀
Alexandra Proca retweeted
Excited to share new work @icmlconf by Loek van Rossem exploring the development of computational algorithms in recurrent neural networks. Hear it live tomorrow, Oral 1D, Tues 14 Jul West Exhibition Hall C: icml.cc/virtual/2025/p… Paper: openreview.net/forum?id=3go0l… (1/11)
@NicolasZucchet @ClementineDomi6 @mpshanahan @PedroMediano Thanks Nicolas!
How do task dynamics impact learning in networks with internal dynamics? Excited to share our ICML Oral paper on learning dynamics in linear RNNs! with @ClementineDomi6 @mpshanahan @PedroMediano openreview.net/forum?id=KGOcr…
@akjagadish @ClementineDomi6 @mpshanahan @PedroMediano Thanks Akshay!☺️
smith lopez @lopez101smithlo
3 Followers 237 Following
Devon Jarvis @devonjarvi5
156 Followers 136 Following Lecturer in Theoretical ML at Wits University. Founder of the Cognition, Adaptation and Learning Lab (@caandl_lab). Google PhD Fellow and Commonwealth Scholar.
Robert Scoble @Scobleizer
586K Followers 50K Following San Francisco/Silicon Valley AI | Robots, holodecks, BCIs, analysis of new things | Ex-Microsoft, Rackspace, Fast Company | Wrote eight books about the future.
Edward Stevinson @ed_stevinson
6 Followers 51 Following PhD student in mechanistic interpretability and adversarial robustness @imperialcollege
Mircea Petrache @MirceaSci
750 Followers 361 Following Doing maths research (geom. analysis, metric geometry, large point configs., opt. transport, etc) since ~2010, deep learning and applied research since ~2020.
Shaoteng Liu @ShaotengLiu
217 Followers 450 Following Research Scientist @AdobeResearch | Ph.D. @CUHKofficial | Prev. @UCBerkeley @berkeley_ai
λ @lambda_functor
948 Followers 8K Following
Roland Memisevic @RolandMemisevic
643 Followers 475 Following PhD, U Toronto 2008 (advisor Geoff Hinton) Faculty @ MILA (until 2016) Co-founder/CEO Twenty Billion Neurons (acquired 2021) Qualcomm AI research since 2021
Emily Cheng @sparse_emcheng
203 Followers 186 Following PhD @colt_upf in computational linguistics What is the happiest state? Maryland 💅🏼 Before: Apple MLR, MIT CSAIL, ENS
Marco Fumero @marco_fumero
600 Followers 551 Following PostDoc @ISTAustria 🧑🏻💻Organizer @unireps Member @ELLISforEurope | Prev. @FlatironCCN @SapienzaRoma @ELLISforEurope @amazon @autodesk 🦋:http://marcofm.bsky
Francisco Acosta @hopfbifurcator
1K Followers 1K Following PhD candidate @UCSBPhysics @geometric_intel lab | prev @MIT, @atmo_ai | organizer @neur_reps | physicist researching AI & brains
Shoki Kishida @shoki_kishida
354 Followers 611 Following Ph.D. student in Applied Physics @harvard ←B.Eng. in Materials Science @univkyoto
Milan Bhan @bhanouz
41 Followers 507 Following Interpretability research. PhD candidate @Sorbonne, Visiting @Mila
Cengiz Pehlevan @CPehlevan
3K Followers 1K Following Theoretical neuroscience, theory of neural computation, physics of learning and intelligence. Associate Professor of Applied Mathematics @Harvard SEAS
Cecile Tamura @ceciletamura
3K Followers 6K Following Pres. & CEO Okasaki Tech Holdings, Tokyo Boeki Development Internationa Corp., , tech evangelist , founder,, energy, AI, Physics, exponential technologies
🌝 @mathphysicsquit
44 Followers 6K Following
Alex Atanasov @ABAtanasov
2K Followers 2K Following Fascinated by scaling and universality. PhD from @harvardphysics. Not a Bayesian. Opinions my own 🇧🇬
Daniel Kunin @KuninDaniel
1K Followers 311 Following postdoc @UCB_MillerInst PhD @ICMEStanford creator @SeeingTheory
Irene Cannistraci @ire_cannistraci
495 Followers 400 Following Postdoc @ETH, associated @ETH_AI_Center | Member @ELLISforEurope | Organizer @unireps | Previously @GladiaLab @helmholtz_ai |
UniReps @unireps
1K Followers 519 Following Discover why, when and how distinct learning processes yield similar representations, and the degree to which these can be unified.
Lisa Alazraki @LisaAlazraki
2K Followers 1K Following PhD student @ImperialCollege. Prev. research intern @AIatMeta, @Cohere, @GoogleAI. Interested in generalisable learning and reasoning. She/her
DoctorM @Natty_Cox01
73 Followers 183 Following 🧠Neuro phD & Former Professor 🥼 Facts | Feminism | Fashion
Jennifer rosemary @Jenniferro78210
18 Followers 78 Following
ghoshsdeep_বাঙ�... @stforfun32
184 Followers 2K Following DC fan| Potterhead|Wannabe Mathematician| Project Scientist-1(Vision & Robotics)|Christian Bale & Amitabh Bachchan fan|Sanghis stay away Atheist|History buff|
Marius Henry @mariushenry132
4 Followers 35 Following
zzzzzz @zihao718
1 Followers 601 Following
Lamin Marong @maronglamin501
794 Followers 3K Following We are all born to love, so let’s share love and kindness as is the greatest gift to uplift mankind and with God everything is always possible. ✝️❤️🩹🙏✌🏾
Yassine Taoudi-Benche... @TBen_Yassine
366 Followers 444 Following PhDing in Machine Learning & Neuroscience @ETH Zurich. I also like music quite a bit. Mostly doing stuff for the plot
Yuval Ran-Milo @YuvalRanMilo
69 Followers 125 Following
Akira Yoshiyama ⁂ @yoshiyama_akira
2K Followers 2K Following research @ETH Zurich @Tufalabs @theresidency | comp eng @UWaterloo | third-space building @socraticainfo
Marc Vlad | DeFiScan.... @marcxvlad
417 Followers 4K Following Building decentralized solutions with public blockchains and opensource AIs. @defiscan_info @DeFiCollective_🐜 - former @marc__vlad
Konrad Szafer @KonradSzafer
203 Followers 992 Following PhD student @ ETH Zurich | Prev: Hugging Face, CMU, PUT
Hoyeon Chang @hoyeon_chang
1K Followers 2K Following PhD student at @kaist_ai; I study compositionality and systematicity in NNs; Also a jazz pianist
João Sacramento @neurosacramento
123 Followers 225 Following
Blake Bordelon ☕️... @blake__bordelon
2K Followers 886 Following Postdoc @Harvard CMSA, starting UT Austin FL 2026. 2:48 marathon
Anand Subramoney @anandsubramoney
317 Followers 1K Following Lecturer (Asst. Prof.) at @RoyalHolloway ML and Computational Neuroscience 🧠🇬🇧🇩🇪🇦🇹🇺🇸🇮🇳 Bluesky: @anandsubramoney.bsky.social
Zihan Zhang @ZihanZhang0116
138 Followers 1K Following PhD @UW, Visiting Scientist @AllenInstitute, Student Researcher @allen_ai
Erin Grant @ermgrant
3K Followers 2K Following Assistant Professor / Faculty Fellow @NYUDataScience studying cognition in mind & brain with neural nets, Bayes, other tools | https://t.co/aC3k1IFSl4
Abhinav Gupta @backpropper
2K Followers 7K Following Research Scientist @GoogleDeepMind | Agents and Code in Gemini
Oliver Sieberling @osieberling
445 Followers 714 Following PhD student @MIT_CSAIL | CS @ETH | LLM Pretraining, Architectures, Efficiency
Yixin Lin @yixin_lin_
2K Followers 7K Following something new. prev: embodied AI @GoogleDeepMind, FAIR/@AIatMeta, Google Brain.
Cristóbal BM=Cp+R @macrocrist
60 Followers 2K Following 📈|| Pseudo Economista || Economía Ortodoxa || Macro Enthusiast || Anti-Pseudos Intelectuales || Simp de Guillermo Calvo
dumbol @dumbol6
256 Followers 4K Following
Emily Cheng @sparse_emcheng
203 Followers 186 Following PhD @colt_upf in computational linguistics What is the happiest state? Maryland 💅🏼 Before: Apple MLR, MIT CSAIL, ENS
Marco Fumero @marco_fumero
600 Followers 551 Following PostDoc @ISTAustria 🧑🏻💻Organizer @unireps Member @ELLISforEurope | Prev. @FlatironCCN @SapienzaRoma @ELLISforEurope @amazon @autodesk 🦋:http://marcofm.bsky
Francisco Acosta @hopfbifurcator
1K Followers 1K Following PhD candidate @UCSBPhysics @geometric_intel lab | prev @MIT, @atmo_ai | organizer @neur_reps | physicist researching AI & brains
Milan Bhan @bhanouz
41 Followers 507 Following Interpretability research. PhD candidate @Sorbonne, Visiting @Mila
Edward Stevinson @ed_stevinson
6 Followers 51 Following PhD student in mechanistic interpretability and adversarial robustness @imperialcollege
Jamie Simon @learning_mech
1K Followers 75 Following doing fundamental science of deep learning | PhD from Berkeley | can catch a whole egg in my mouth
Irene Cannistraci @ire_cannistraci
495 Followers 400 Following Postdoc @ETH, associated @ETH_AI_Center | Member @ELLISforEurope | Organizer @unireps | Previously @GladiaLab @helmholtz_ai |
Lisa Alazraki @LisaAlazraki
2K Followers 1K Following PhD student @ImperialCollege. Prev. research intern @AIatMeta, @Cohere, @GoogleAI. Interested in generalisable learning and reasoning. She/her
David Klindt @klindt_david
3K Followers 2K Following ICA is all we need | AI, Theory, MechInterp, Neuro | assistant professor @CSHL | prev @Stanford @Meta @Google @MPI_IS @ENS_ULM @UCL
Yassine Taoudi-Benche... @TBen_Yassine
366 Followers 444 Following PhDing in Machine Learning & Neuroscience @ETH Zurich. I also like music quite a bit. Mostly doing stuff for the plot
Yuval Ran-Milo @YuvalRanMilo
69 Followers 125 Following
Akira Yoshiyama ⁂ @yoshiyama_akira
2K Followers 2K Following research @ETH Zurich @Tufalabs @theresidency | comp eng @UWaterloo | third-space building @socraticainfo
Albert Gu @_albertgu
21K Followers 77 Following assistant prof @mldcmu. chief scientist @cartesia_ai. leading the ssm revolution.
Konrad Szafer @KonradSzafer
203 Followers 992 Following PhD student @ ETH Zurich | Prev: Hugging Face, CMU, PUT
Qianqian Feng @Qianqian0v0
10 Followers 86 Following
Hoyeon Chang @hoyeon_chang
1K Followers 2K Following PhD student at @kaist_ai; I study compositionality and systematicity in NNs; Also a jazz pianist
Anand Subramoney @anandsubramoney
317 Followers 1K Following Lecturer (Asst. Prof.) at @RoyalHolloway ML and Computational Neuroscience 🧠🇬🇧🇩🇪🇦🇹🇺🇸🇮🇳 Bluesky: @anandsubramoney.bsky.social
Zihan Zhang @ZihanZhang0116
138 Followers 1K Following PhD @UW, Visiting Scientist @AllenInstitute, Student Researcher @allen_ai
Abhinav Gupta @backpropper
2K Followers 7K Following Research Scientist @GoogleDeepMind | Agents and Code in Gemini
Oliver Sieberling @osieberling
445 Followers 714 Following PhD student @MIT_CSAIL | CS @ETH | LLM Pretraining, Architectures, Efficiency
João Sacramento @neurosacramento
123 Followers 225 Following
Johan Obando-Ceron �... @johanobandoc
2K Followers 4K Following Graduate student @Mila_Quebec @UMontrealDIRO | RL/Deep Learning/AI | De Cali/Colombia pal’ Mundo 🇨🇴 | #JuntosProsperamos⚡#TogetherWeThrive| 🌱🌎
Yixin Lin @yixin_lin_
2K Followers 7K Following something new. prev: embodied AI @GoogleDeepMind, FAIR/@AIatMeta, Google Brain.
Antonio Orvieto @orvieto_antonio
3K Followers 1K Following Deep Learning PI @ELLISInst_Tue, Group Leader @MPI_IS. I compute stuff with lots of gradients 🧮, I like Kierkegaard & Lévi-Strauss 🧙♂️
Aaditya Singh @Aaditya6284
855 Followers 361 Following Doing a PhD @GatsbyUCL with @SaxeLab, @FelixHill84 on learning dynamics, ICL, LLMs. Prev. at: @GoogleDeepMind, @AIatMeta (LLaMa 3), @MIT. https://t.co/ZOmBWCvbIK
Ruairidh Battleday @RMBattleday
1K Followers 2K Following AI and CogSci Researcher. Founder & President, Thinking About Thinking https://t.co/5QhakhFz3s https://t.co/ATUc8CzPmC
Stéphane Deny @StphTphsn1
4K Followers 7K Following Neuroscience & ML Researcher. Posting about various topics on here. I retweet papers to increase their visibility (I do not read all), tag me for a retweet.
Julien Siems @julien_siems
386 Followers 756 Following AI Scientist @ Prior Labs, PhD student advised by Frank Hutter working on linear RNNs and state-tracking.
Stephanie Chan @scychan_brains
7K Followers 3K Following Staff Research Scientist at DeepMind. Artificial & biological brains 🤖 🧠 Societal impacts of AI + Science of AI. Views are my own.
LawZero - LoiZéro @LawZero_
4K Followers 46 Following NPO founded by @Yoshua_Bengio to advance highly-capable, safe-by-design AI - OBNL fondée par @Yoshua_Bengio pour une IA sécuritaire et hautement performante
Devon Jarvis @devonjarvi5
156 Followers 136 Following Lecturer in Theoretical ML at Wits University. Founder of the Cognition, Adaptation and Learning Lab (@caandl_lab). Google PhD Fellow and Commonwealth Scholar.
Scott Linderman @scott_linderman
6K Followers 914 Following Assistant Professor @Stanford Statistics and @StanfordBrain. AI, Neuroscience, Machine Learning, Statistics. Posts are my own.
Il Memming Park @memming
4K Followers 3K Following Computational neuroscientist. Maybe at @[email protected] Also @memming.bsky.social Group leader @Neuro_CF (formerly Associate professor @SBUNeurobiology)
Arianna Di Bernardo @ari_dibe
420 Followers 201 Following Manifolds and Neural Computation 🧠⚙️ PhD student in @ostojic_srdjan lab at @ENS_ULM, Paris 🇫🇷 https://t.co/pkVj1I7NDA
Manuel Beiran @mBeiran
654 Followers 356 Following Postdoctoral researcher in computational neuroscience
Alex Atanasov @ABAtanasov
2K Followers 2K Following Fascinated by scaling and universality. PhD from @harvardphysics. Not a Bayesian. Opinions my own 🇧🇬
Alisa Leshchenko 🦕 @BorromeanLink
56 Followers 278 Following CompNeuro @Columbia Zuckerman Institute, Fusi Lab | Cognitive maps, abstraction, compositionality in a neural substrate | #NeuroAI
Mani @thirdpill
98 Followers 696 Following Doomed to manichaeistic dualism, but in search of the third pill.
Henry Shevlin @dioscuri
34K Followers 9K Following Philosopher & AI Ethicist @GoogleDeepMind · @LeverhulmeCFI @Cambridge_Uni | Consciousness, Machine Minds, AGI, Human-AI Relationships | All views my own
Alex Williams @ItsNeuronal
5K Followers 1K Following Asst Prof @NYU_CNS + Project Leader @FlatironCCN studying Computational + Statistical Neuroscience.
UniReps @unireps
1K Followers 519 Following Discover why, when and how distinct learning processes yield similar representations, and the degree to which these can be unified.Trends for United States
You might like
Daniel Yamins
@dyamins
5K Followers
Nicolas Zucchet
@NicolasZucchet
772 Followers
Thomas F. Varley
@ThosVarley
5K Followers
Jonas Mago
@JonasHMago
413 Followers
Adeel Razi
@adeelrazi
3K Followers
Conor Heins
@conorheins
1K Followers
CCIG
@ccig_cambridge
601 Followers
Fred
@probablyspiking
40 Followers
Seijin Kobayashi
@SeijinKobayashi
859 Followers
Pavel Czempin
@pczempin
112 Followers
Tina Lopez
@KristinaELopez
248 Followers