Picture

Jim Fan @DrJimFan

@NVIDIA Sr. Research Manager & Lead of Embodied AI (GEAR Lab). Creating foundation models for Humanoid Robots & Gaming. @Stanford Ph.D. @OpenAI's first intern. jimfan.me Contact → Joined December 2012
  • Tweets
    4K
  • Followers
    226K
  • Following
    3K
  • Likes
    7K
DrJimFan Profile Picture

Jim Fan @DrJimFan

3 days ago

Llama-3 is closing the gap with GPT-4, but multimodal models gotta catch up. Vision capabilities of open models like LlaVA are far, far behind GPT-4V. Video models are even worse. They hallucinate all the time and fail to give detailed descriptions of complex scenes and actions.…

DrJimFan Profile Picture

Jim Fan @DrJimFan

4 days ago

AI winter? No. Even if GPT-5 plateaus. Robotics hasn’t even started to scale yet. Embodied intelligence in the physical world will be a powerhouse for economic value. Friendly reminder to everyone that LLM is not all of AI. It is just one piece of a bigger puzzle.

8teAPi Profile Picture

Ate-a-Pi @8teAPi

5 days ago

AI winter? No. Even if GPT-5 plateaus. Robotics hasn’t even started to scale yet. Embodied intelligence in the physical world will be a powerhouse for economic value. Friendly reminder to everyone that LLM is not all of AI. It is just one piece of a bigger puzzle.

DrJimFan Profile Picture

Jim Fan @DrJimFan

5 days ago

Prediction: GPT-5 will be announced before Llama-3-400B releases. External movement defines OpenAI’s PR schedule 🤣

DrJimFan Profile Picture

Jim Fan @DrJimFan

6 days ago

Prediction: GPT-5 will be announced before Llama-3-400B releases. External movement defines OpenAI’s PR schedule 🤣

Jim Fan retweeted
AjayMandlekar Profile Picture

Ajay Mandlekar @AjayMandlekar

a week ago

Data is the key driving force behind success in robot learning. Our upcoming RSS 2024 workshop "Data Generation for Robotics” will feature exciting speakers, timely debates, and more! Submit by May 20th. sites.google.com/view/data-gene…

DrJimFan Profile Picture

Jim Fan @DrJimFan

a week ago

It took my brain a while to parse what's going on in this video. We are so obsessed with "human-level" robotics that we forget it is just an artificial ceiling. Why don't we make a new species superhuman from day one? Boston Dynamics has once again reinvented itself. Gradually,…

DrJimFan Profile Picture

Jim Fan @DrJimFan

a week ago

Humanoid robots will exceed the supply of iPhones in the next decade. Gradually, then suddenly.

vkhosla Profile Picture

Vinod Khosla @vkhosla

a week ago

Humanoid robots will exceed the supply of iPhones in the next decade. Gradually, then suddenly.

Jim Fan retweeted
elonmusk Profile Picture

Elon Musk @elonmusk

a week ago

@DrJimFan Two sources of data scale infinitely: synthetic data, which has an “is it true?” problem and real-world video, which does not.

DrJimFan Profile Picture

Jim Fan @DrJimFan

a week ago

Tesla FSD v13 will likely be grokking language tokens. What excites me the most about Grok-1.5V is the potential to solve edge cases in self-driving. Using language for "chain of thought" will help the car break down a complex scenario, reason with rules and counterfactuals, and…

DrJimFan Profile Picture

Jim Fan @DrJimFan

2 weeks ago

The moat of software AI agents is not the thin wrapper layer (Devin, SWE-Agent), but the underlying LLM. Instead of benchmarking the wrapper, I think SWE-Bench is excellent for evaluating coding LLMs instead: Hold the agent layer fixed and vary only the LLM backend. Provide all…

DrJimFan Profile Picture

Jim Fan @DrJimFan

2 weeks ago

Math talking to bare metal in the purest way. @karpathy makes AI education not only accessible, but also elegant. I'm reading through the code like a work of art.

karpathy Profile Picture

Andrej Karpathy @karpathy

2 weeks ago

Math talking to bare metal in the purest way. @karpathy makes AI education not only accessible, but also elegant. I'm reading through the code like a work of art.

DrJimFan Profile Picture

Jim Fan @DrJimFan

3 weeks ago

The legendary class created by @drfeifei & @karpathy that introduced deep learning to a generation of students. Proud to be a TA alumnus for CS231n! I used to write the Google Cloud tutorial on how to set up GPU instances and run experiments ;)

drfeifei Profile Picture

Fei-Fei Li @drfeifei

3 weeks ago

The legendary class created by @drfeifei & @karpathy that introduced deep learning to a generation of students. Proud to be a TA alumnus for CS231n! I used to write the Google Cloud tutorial on how to set up GPU instances and run experiments ;)

DrJimFan Profile Picture

Jim Fan @DrJimFan

3 weeks ago

Better manual design of the command line tools for GPT-4 is all you need to get 12.3% on SWEBench. There is no magic, no model breakthrough, no justification for the extreme hype. When GPT-5 comes, instruction following, tool use, and long context will surely be far better. None…

jyangballin Profile Picture

John Yang @jyangballin

3 weeks ago

Better manual design of the command line tools for GPT-4 is all you need to get 12.3% on SWEBench. There is no magic, no model breakthrough, no justification for the extreme hype. When GPT-5 comes, instruction following, tool use, and long context will surely be far better. None…

DrJimFan Profile Picture

Jim Fan @DrJimFan

4 weeks ago

This sakura video has no more complexity than 262 characters, implemented as shader code that *generates* pixels. A text2video model that achieves maximal possible compression will be able to recover this program approximately in its weights, synthesized through denoising and…

DrJimFan Profile Picture

Jim Fan @DrJimFan

4 weeks ago

Novelty is so overrated. It's an example of misaligned objective: if reviewers look for novelty, you shape your research and efforts towards that, while devaluing things that actually matter. I used to review CVPR papers, but stopped wasting time on so many mind-numbing papers…

NandoDF Profile Picture

Nando de Freitas 🏳️‍🌈 @NandoDF

a month ago

Novelty is so overrated. It's an example of misaligned objective: if reviewers look for novelty, you shape your research and efforts towards that, while devaluing things that actually matter. I used to review CVPR papers, but stopped wasting time on so many mind-numbing papers…

Trends for United States

Bengals
13,5 B posts
Liverpool
213 B posts
Everton
134 B posts
Klopp
80,7 B posts
TikTok
72,1 B posts
UT Austin
60,9 B posts
Hendrickson
3.828 posts
$BCCOIN
5.701 posts
Tee Higgins
3.235 posts
$META
15,4 B posts
Kent State
23,1 B posts
Amanda Seales
6.964 posts
Uvalde
28 B posts
#YIAYtok
Pause
67,4 B posts
Nunez
56,5 B posts
Xavi
125 B posts
Greg Abbott
11 B posts
Shannon
70,7 B posts
Christie
15,2 B posts

You might like

🧑‍🍳. Previously Director of AI @ Tesla, founding team @ OpenAI, CS231n/PhD @ Stanford. I like to train large deep neural nets 🧠🤖💥
Andrej Karpathy
@karpathy
977K Followers
Working on AI safety, past on robotics, applied research @OpenAI; Writing ML blogs to help myself & others to learn; Ideas my own.
Lilian Weng
@lilianweng
94K Followers
deep learning
Geoffrey Hinton
@geoffreyhinton
337K Followers
We’re a team of scientists, engineers, ethicists and more, committed to solving intelligence, to advance science and benefit humanity.
Google DeepMind
@GoogleDeepMind
942K Followers
The AI community building the future. https://t.co/VkRPD0VKaZ #BlackLivesMatter #stopasianhate
Hugging Face
@huggingface
342K Followers
President & Co-Founder @OpenAI
Greg Brockman
@gdb
663K Followers
Professor at NYU. Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
Yann LeCun
@ylecun
709K Followers
Co-founder & CEO @HuggingFace 🤗, the open and collaborative platform to build machine learning
clem 🤗
@ClementDelangue
90K Followers
Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.
AI at Meta
@AIatMeta
530K Followers
@LangChainAI, previously @robusthq @kensho MLOps ∪ Generative AI ∪ sports analytics
Harrison Chase
@hwchase17
53K Followers
⚡ Build context-aware, reasoning applications ⚡
LangChain
@LangChainAI
136K Followers
AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo follow on Hugging Face: https://t.co/q2Qoey80Gx
AK
@_akhaliq
309K Followers
We're an AI safety and research company that builds reliable, interpretable, and steerable AI systems. Talk to our AI assistant Claude at https://t.co/aRbQ97uk4d.
Anthropic
@AnthropicAI
261K Followers
Deep learning @google. Creator of Keras. Author of 'Deep Learning with Python'. Opinions are my own.
François Chollet
@fchollet
469K Followers
co-founder/CEO @llama_index Careers: https://t.co/EUnMNmbCtx Enterprise: https://t.co/Ht5jwxSrQB
Jerry Liu
@jerryjliu0
44K Followers