The conference of NeurIPS has come
Our tests and models just begun
The researchers and nerds
Have come from all worlds
To show off their work, one by one.
@alienelf@fhuszar Leaders who are most effective
Take feedback and are self-reflective
But in Jade's DM
She witnessed these men
Who are instead rather defensive
About ML, sadly, he hasn’t a clue
Oh, how I hate this man, reviewer two
The review had no merit
I don’t think he read it
I wish he would get sick or fall into poo
There’s no way around it, I have to hereby
Declare that my ResNet is pre-AGI
It costs a Ferrari
To train on Atari
It can't put my socks on or pour me a chai
I talked to my good friends at Microsoft
We needed some money to refurb the loft
Satya said "sure,
But please use Azure"
A billion dollars will keep us aloft
Thank you for joining us at ICML
This year we're promising a whole new level
Of deep nets and GANs
Muslim travel bans
And more west-coast tech bros than ever
@fchollet PyTorch autograd was inspired by Chainer.
Keras was copied on Torch7 (transcribed from Lua to Python).
Torch7 was very much inspired by Lush (transcribed from Lisp to Lua).
But every time, some new twists are added.
How do I order a tarte à citron?
“Lemon tart” responds the Translatatron
End-to-end speech-to-speech
Is not out of reach
If you have data and wealthy patrons
A common misconception is that the risk of overfitting increases with the number of parameters in the model. In reality, a single parameter suffices to fit most datasets: arxiv.org/abs/1904.12320
Implementation available at: github.com/Ranlot/single-…
Look at this stuff: it's a StyleGAN
the output looks just like a floor plan
A flat without bedroom
With seven feet headroom
And living room shaped like a saucepan
He erects no paywall, he charges no fee
Andrej is sharing his wisdom for free
The number you all want,
The Karpathy constant:
Ten to the minus fourth power by three
New blog post: "A Recipe for Training Neural Networks" karpathy.github.io/2019/04/25/rec… a collection of attempted advice for training neural nets with a focus on how to structure that process over time
It took a researcher with some gumption
to revisit deep energy functions.
Try to normalize
and you'll bleed out your eyes;
It's intractable (by construction).
@RandomlyWalking@MLimericks His thesis was done in 2013
His online trail is not so clean
Though his account has no name
His e-mail’s not the same
And the e-mail is easy to glean
On this feed you will continue to see
Limericks no longer written by me
But a person I tasked
For I’ve been unmasked
By the GAN boss. Good bye, C’est la vie
I try to be funny but mostly just troll
ImageNet’s too hard I stick to Swiss roll
Indeed, I’m Ferenc
I end this pretense
It’s time to put somebody else in control
Remember vacuous bounds do not spark joy
Nobody would agree more than Dan Roy
He doesn’t get sarcasm
Dislikes the huge chasm
Between the Bayes risk and bounds you employ
Will people stop citing generalization bounds that are vacuous!!! There is no such thing as a tighter vacuous generalization bound. If it is vacuous then the value is 1!!
@PHuenermund Most economists understand that curve fitting is not causal inference, so they excuse themselves with: "we assume ignorability" which makes them feel less guilty. In contrast, Most machine-learning researchers do not see a reason to apologize. #Bookofwhy#econbookclub
1.2M Followers 788 FollowingProfessor at NYU & Executive Chairman at AMI Labs.
Ex-Chief AI Scientist at Meta.
Researcher in AI, Machine Learning, Robotics, etc.
ACM Turing Award Laureate.
306K Followers 1K FollowingBuilding new things @thinkymachines. Also dabble in robotics at NYU. Cofounded @PyTorch. AI is delicious when it is accessible and open-source.
68K Followers 2K FollowingResearch Scientist at Google DeepMind (WaveNet, Imagen, Veo). I tweet about deep learning (research + software), music, generative models (personal account).
66K Followers 2K Following@Google DeepMind. On leave, Canada CIFAR AI Chair and Former Research Director, @VectorInst. Professor, @UofT (Statistics/CS). Views are my own.
62K Followers 11K FollowingBuilding intelligence that evolves @adaption_ai. Built @Cohere_Labs, @GoogleBrain, @GoogleDeepmind. ML Efficiency, Multimodal\lingual.
46K Followers 915 FollowingFR/US/GB AI/ML Person, Director of Research at @GoogleDeepMind, Honorary Professor at @UCL_DARK, @ELLISforEurope Fellow. All posts are personal.
443K Followers 6K FollowingChief Scientist, Google DeepMind & Google Research. Gemini Lead. Opinions stated here are my own, not those of Google. TensorFlow, MapReduce, Bigtable, ...
62K Followers 652 FollowingUniversity Distinguished Professor (Emeritus), Oregon State Univ.; Former President, AAAI; Currently Chair CS Section of ArXiv
13K Followers 745 Following"If there is not folly in the world, then the world itself is folly. You must understand that mistakes are not always regrets." - Paul Tobin, Bandette🤠
6K Followers 2K FollowingMachine learning researcher, working on causal inference and healthcare applications. Associate Professor Tel Aviv U. + @GoogleDeepMind
26K Followers 1K FollowingFind me @[email protected] Professor at @OxCSML, @oxfordstats and Research Director at @GoogleDeepMind. All opinions are my own.
30K Followers 1K FollowingI'm not here, I'm on bsky. Parent, wife, Professor of Machine Learning @UniofOxford, Co-Founder Mind Foundry, Director @aims_oxford.
2K Followers 2K Followingformer @NIST AI Fellow and @UCBerkeley Tech Policy
Co-founder of Twitter's Machine Learning Ethics team (RIP)
Opinionated about 🇮🇹 food
Tweet with Typos
36K Followers 269 FollowingAngel investor. Ex Researcher in Deep Learning @GoogleDeepMind. Co-creator @GoogleAI Brain Amsterdam, Ex original @DeepMind, Edu at Oxford, UvA and Stanford.
124K Followers 648 FollowingMila Scientific Director. Ex @Google DeepMind & Twitter Cortex. Father of 4. // Directeur scientifique à Mila. Ex @Google DeepMind & Twitter Cortex. Père de 4.
111K Followers 891 FollowingI seek to understand intelligence, agency and awareness, and build AI aligned with compassion, freedom, universal human empowerment, and progress science.
35K Followers 2K FollowingVP of AI Research, Principal Scientist @ EIT | ex-Director @ DeepMind Building models to accelerate fundamental sciences and medicine. Opinions my own.
32K Followers 3K FollowingML x society.
Founding Member of Technical Staff at Project Prometheus.
Prev @midjourney, @SFResearch, @CommonCrawl.
@Harvard '14, @Sydney_Uni '11. 🇦🇺 in SF.
38K Followers 14 FollowingProfessor of machine learning at the University of Cambridge. Opinions are my own. Author of "The Atomic Human"
Mainly found on @lawrennd.bsky.social
45K Followers 1K FollowingML with Social Purpose. @[email protected] | Research Scientist @DeepMind | Strengthening African ML @DeepIndaba. He/Him. South African 🇿🇦🏳️🌈🌍
43K Followers 248 FollowingProfessor of Machine Learning, University of Oxford
@OATML_Oxford Group Leader
Expert Advisor to AISI
"One of the top machine-learning people" - Tim Berners-Lee