Jürgen Schmidhuber @SchmidhuberAI
Invented principles of meta-learning (1987), GANs (1990), Transformers (1991), very deep learning (1991), etc. Our AI is used many billions of times every day. people.idsia.ch/~juergen/most-… Switzerland, KSA Joined August 2019-
Tweets64
-
Followers106K
-
Following0
-
Likes714
At ICANN 1993, I extended my 1991 unnormalised linear Transformer, introduced attention terminology for it, & published the "self-referential weight matrix." 3 decades later, they made me Chair of ICANN 2024 in Lugano. Call for papers (deadline March 25): e-nns.org/icann2024/call…
Our #GPTSwarm models Large Language Model Agents and swarms thereof as computational graphs reflecting the hierarchical nature of intelligence. Graph optimization automatically improves nodes and edges. arxiv.org/abs/2402.16823 github.com/metauto-ai/GPT… gptswarm.org
In 2016, at an AI conference in NYC, I explained artificial consciousness, world models, predictive coding, and science as data compression in less than 10 minutes. I happened to be in town, walked in without being announced, and ended up on their panel. It was great fun.…
Numbers are lining up: one tweet per year of my life; one follower per LSTM citation 👍🙂
2010 foundations of recent $NVDA stock market frenzy: our simple but deep neural net on @nvidia GPUs broke MNIST arxiv.org/abs/1003.0358. Things are changing fast. Just 7 months ago, I tweeted: compute is 100x cheaper, $NVDA 100x more valuable. Today, replace "100" by "250."…
The GOAT of tennis @DjokerNole said: "35 is the new 25.” I say: “60 is the new 35.” AI research has kept me strong and healthy. AI could work wonders for you, too!
Best paper award for "Mindstorms in Natural Language-Based Societies of Mind" at #NeurIPS2023 WS Ro-FoMo. Up to 129 foundation models collectively solve practical problems by interviewing each other in monarchical or democratic societies arxiv.org/abs/2305.17066
How 3 Turing awardees republished key methods and ideas whose creators they failed to credit. More than a dozen concrete AI priority disputes under people.idsia.ch/~juergen/ai-pr…
Q*? 2015: reinforcement learning prompt engineer in Sec. 5.3 of “Learning to Think...” arxiv.org/abs/1511.09249. A controller neural network C learns to send prompt sequences into a world model M (e.g., a foundation model) trained on, say, videos of actors. C also learns to…
Amazing that @SchmidhuberAI gave this talk back in 2012, months before AlexNet paper was published. In 2012, many things he discussed, people just considered to be funny and a joke, but the same talk now would be considered at the center of AI debate and controversy. Full talk:
AI boom v AI doom: since the 1970s, I have told AI doomers that in the end all will be good. E.g., 2012 TEDx talk: youtu.be/KQ35zNlyG-o: “Don’t think of us versus them: us, the humans, v these future super robots. Think of yourself, and humanity in general, as a small stepping…
Thanks @elonmusk for your generous hyperbole! Admittedly, however, I didn’t invent sliced bread, just #GenerativeAI and things like that: people.idsia.ch/~juergen/most-… And of course my team is standing on the shoulders of giants: people.idsia.ch/~juergen/deep-… Original tweet by @elonmusk:…
Silly AI regulation hype One cannot regulate AI research, just like one cannot regulate math. One can regulate applications of AI in finance, cars, healthcare. Such fields already have continually adapting regulatory frameworks in place. Don’t stifle the open-source movement!…
2023: 20th anniversary of the Gödel Machine, a mathematically optimal, self-referential, meta-learning, universal problem solver making provably optimal self-improvements by rewriting its own computer code people.idsia.ch/~juergen/goede…
Unlike diffusion models, Bayesian Flow Networks operate on the parameters of data distributions, rather than on noisy versions of the data itself. I think this paper by Alex Graves et al. will be influential.
Unlike diffusion models, Bayesian Flow Networks operate on the parameters of data distributions, rather than on noisy versions of the data itself. I think this paper by Alex Graves et al. will be influential.
In 2010, we used Jensen Huang's @nvidia GPUs to show that deep feedforward nets can be trained by plain backprop without any unsupervised pretraining. In 2011, our DanNet was the first superhuman CNN. Today, compute is 100+ times cheaper, and NVIDIA 100+ times more valuable.…
Interview with Jürgen Schmidhuber, ‘Father Of Modern AI’, who says his life’s work won’t lead to dystopia. He goes quite in depth into his views about the future of AI and AGI. A refreshing view of things, compared to other ‘influential leaders’ in AI. reddit.com/r/MachineLearn…
Instead of trying to defend his paper on OpenReview (where he posted it), @ylecun made misleading statements about me in popular science venues. I am debunking his recent allegations in the new Addendum III of my critique people.idsia.ch/~juergen/lecun…
Alfredo Canziani @alfcnz
86K Followers 268 Following Musician, math lover, cook, dancer, 🏳️🌈, and an ass prof of Computer Science at New York UniversitySoumith Chintala @soumithchintala
186K Followers 877 Following Cofounded and lead @PyTorch at Meta. Also dabble in robotics at NYU. AI is delicious when it is accessible and open-source.Lucas Beyer (bl16) @giffmana
56K Followers 444 Following Researcher (Google DeepMind/Brain in Zürich, ex-RWTH Aachen), Gamer, Hacker, Belgian. Mostly gave up trying mastodon as [email protected](((ل()(ل() 'yoav))).. @yoavgo
46K Followers 2K FollowingKosta Derpanis @CSProfKGD
48K Followers 197 Following #CS Associate Prof @YorkUniversity, #ComputerVision Scientist Samsung #AI, @VectorInst Faculty Affiliate, TPAMI AE, #CVPR2024/#ECCV2024 Publicity Co-chairKevin Patrick Murphy @sirbayes
42K Followers 334 Following Research Scientist at Google Brain / Deepmind. Interested in Bayesian Machine Learning.Michael Bronstein @mmbronstein
43K Followers 4K Following #DeepMind Professor of #AI @UniofOxford / Fellow @ExeterCollegeOx / ML Lead @ProjectCETI / https://t.co/kZpGpDzYeVDavid Pfau @pfau
22K Followers 1K Following Knowledge manifests itself in radiant dreams that shimmer like the wild sun Views are my own pfau at sigmoid dot social on 🦣 https://t.co/xqtVHHVI17 on 🦋Dmytro Mishkin 🇺�.. @ducha_aiki
18K Followers 591 Following Marrying classical CV and Deep Learning. I do things, which work, rather than being novel, but not working.Horace He @cHHillee
23K Followers 449 Following Working at the intersection of ML and Systems @ PyTorch "My learning style is Horace twitter threads" - @typedfemaleKyunghyun Cho @kchonyc
61K Followers 2K Following a combination of a mediocre scientist, a mediocre manager, a mediocre advisor & a mediocre PC at @nyuniversity (@CILVRatNYU) & @genentech (@PrescientDesign).Rosanne Liu @savvyRL
33K Followers 966 Following Cofounded & running @ml_collective. Host of Deep Learning Classics & Trends. Research at Google DeepMind. DEI/DIA Chair of ICLR & NeurIPS. Writing https://t.co/IbycyGfnDRFerenc Huszár @fhuszar
40K Followers 1K Following Secular Bayesian. Associate Professor in Machine Learning @Cambridge_CL. Talent aficionado at https://t.co/RbJkoLguey Alum of @Twitter, Magic Pony and @BaldertonDan Roy @roydanroy
45K Followers 2K Following ML / AI researcher, emphasis on theory. Research Director and Canada CIFAR AI Chair, @VectorInst Professor, @UofT (Statistics/CS)Petar Veličković @PetarV_93
30K Followers 555 Following Staff Research Scientist @GoogleDeepMind | Affiliated Lecturer @Cambridge_Uni | Associate @clarehall_cam | GDL Scholar @ELLISforEurope. Monoids. 🇷🇸🇲🇪🇧🇦yobibyte @y0b1byte
15K Followers 2K Following Kurin ViTaly, senior research scientist @IsomorphicLabs, ML PhD from @UniofOxford on RL, Multitask learning & GraphsSander Dieleman @sedielem
50K Followers 2K Following Research Scientist at Google DeepMind. I tweet about deep learning (research + software), music, generative models (personal account).Ethan Caballero is bu.. @ethanCaballero
8K Followers 2K Following ML PhD student @Mila_Quebec ; previously @GoogleDeepMindZachary Lipton @zacharylipton
59K Followers 2K Following Professor: CMU/@acmi_lab, CTO / CSO: @AbridgeHQ, Creator: @d2l_ai & https://t.co/QQt98VNLUp, Relapsing 🎷Helen Babalola @ecunyo
0 Followers 13 FollowingIboo Bagué @iboobague
41 Followers 374 Followingweiye wang @weiyewang217665
0 Followers 4 FollowingPasi Vuorio @pavuorio
201 Followers 395 Following Developer and SW Architect since -97, nowadays innovating new things with #AI at LastBot. Startup guy 4ever!steezus7777 @steezus77777
43 Followers 102 FollowingNurlan Rakhimzhanov @Crytox2713
1 Followers 80 FollowingJohn Embate @johnembate0
5 Followers 81 FollowingExperiments for me @experementsfor1
254 Followers 2K Following Trying to understand/learn: Despite huge potential, why Human's progress is slow? Too Slow..........Pedro @TxDPedro
1 Followers 15 Followingwade1 @wade1_dev
0 Followers 38 FollowingV.Agam @Agam_2
2 Followers 35 Followingbignn.eth @big_new_new
40 Followers 100 Following BigNewNew,大新新。 web2.0 builder,web3.0 student。 关注web3应用层和创作者经济Divyaksh Shukla @divyakshshukla
6 Followers 42 Following Here to learn and learn. I will teach someday, but only after I learnPhu Nguye @PhuNguye2
0 Followers 71 FollowingEvi Achten @achten68855
0 Followers 36 Followingsihaixianyu @sihaixianyu
11 Followers 56 FollowingMohammad Amin Abbasza.. @MAAZ__98
52 Followers 111 Following CSE graduate student @ Polytechnic University of MilanVictor Amaral @VictorFelipeAm1
56 Followers 78 FollowingShankar S @Shankar47322027
115 Followers 842 Followingmike greenberg @mgreenb57
2 Followers 36 Following traveler | stock trader | rationally rounds π to 3.14159 | dislikes the Shift keymorhan @melihorhan
44 Followers 254 Following Yazılım mühendisi ve teknoloji tutkunu. İnovasyona ve kaliteli kodlamaya inanan biri olarak, hayatımı kodlama üzerine kuruyorum.Fadi Alshammary @alshammary_fadi
3 Followers 79 FollowingPranav Sachdev @_PranavSachdev
8 Followers 112 Following I'm a Sr. Data scientist, a storyteller passionate about solving complex problems with data #DataScience #MachineLearningHarsh Verma @Harsh302004
30 Followers 432 FollowingJING LI @lijing123601
27 Followers 128 FollowingBeto Macedo @benedito.. @beneditomacedo
506 Followers 3K FollowingSaumil Patel @saumilp_
2K Followers 999 Following 🚀 Co-Founder & CEO @ https://t.co/2rmaJyjkus (YC S21) | 🤖 SWE In a symbiotic relationship with AI | Sova (iykyk) | e/accpeterbob @whatsurshtyle
10 Followers 1K FollowingAbdullah Ahmed @abdullahs_X
0 Followers 31 Following cs sophomore @ uet cyber security // ai // cryptocurrency & blockchain enthusiast@ylecun My understanding is Schmidhuber already solved that 10 years ago. Just no-one knows it yet
@SchmidhuberAI The 90s was the best time 😉
Amazing that @SchmidhuberAI gave this talk back in 2012, months before AlexNet paper was published. In 2012, many things he discussed, people just considered to be funny and a joke, but the same talk now would be considered at the center of AI debate and controversy. Full talk:
Schmidhuber was already an e/acc back in the 1990s 😏
AI boom v AI doom: since the 1970s, I have told AI doomers that in the end all will be good. E.g., 2012 TEDx talk: youtu.be/KQ35zNlyG-o: “Don’t think of us versus them: us, the humans, v these future super robots. Think of yourself, and humanity in general, as a small stepping…
This is funniest 😂 talk I have ever heard a scientist give. 10/10 @SchmidhuberAI . Impeccable comedic timing.
Amazing that @SchmidhuberAI gave this talk back in 2012, months before AlexNet paper was published. In 2012, many things he discussed, people just considered to be funny and a joke, but the same talk now would be considered at the center of AI debate and controversy. Full talk:
@McaleerStephen Schmidhuber invented everything
Generative AI startups have become mainstream when their boardroom drama becomes national news.
It might be interesting to revisit these ideas with pre-trained LLMs.
@SchmidhuberAI Who said that 'AI' should follow the method of learning derived from human behavior and psychology?
“I’ve no doubt that there’ll be all kinds of AI arms races, but AI doesn’t introduce a new quality of existential threat. The threat from AI weapons pale in comparison to much older threats. We should be much more afraid of H-bomb rockets.” @SchmidhuberAI redd.it/13q6k4a
Ask 10 people, and you’ll hear 10 opinions about what is ‘good’. The problem is that governments ALSO have different opinions about what’s good for them and for others. Great Power A will say, if we don’t do it, Great Power B will, perhaps secretly, and gain an advantage over us.
Silly AI regulation hype One cannot regulate AI research, just like one cannot regulate math. One can regulate applications of AI in finance, cars, healthcare. Such fields already have continually adapting regulatory frameworks in place. Don’t stifle the open-source movement!…
@pretendsmarts @SchmidhuberAI Humans have different visions of the future - and you can't please all the people - so issues arise regarding whether you please the luddites or the technophiles, the capitalists or the communists, and so on - i.e. whose views do you give weight to? - 2008.
@SchmidhuberAI Thankfully, another voice of reason!
Correct. Infeasible
Silly AI regulation hype One cannot regulate AI research, just like one cannot regulate math. One can regulate applications of AI in finance, cars, healthcare. Such fields already have continually adapting regulatory frameworks in place. Don’t stifle the open-source movement!…
Another based founding Father of AI joins the fight on the side of e/acc
Silly AI regulation hype One cannot regulate AI research, just like one cannot regulate math. One can regulate applications of AI in finance, cars, healthcare. Such fields already have continually adapting regulatory frameworks in place. Don’t stifle the open-source movement!…
Agree 👍
Silly AI regulation hype One cannot regulate AI research, just like one cannot regulate math. One can regulate applications of AI in finance, cars, healthcare. Such fields already have continually adapting regulatory frameworks in place. Don’t stifle the open-source movement!…
Worth take on AI
Silly AI regulation hype One cannot regulate AI research, just like one cannot regulate math. One can regulate applications of AI in finance, cars, healthcare. Such fields already have continually adapting regulatory frameworks in place. Don’t stifle the open-source movement!…
@SchmidhuberAI a story about regulations is mostly a story how to keep dominance :(