-
Tweets19
-
Followers436
-
Following92
-
Likes23
Joint work with my amazing collaborators @HuLillian39250, @linluqiu, @wucathy, and Kaiming He!
Our takeaway: multimodal models possess strong reasoning abilities, and VISTA can unlock their potential to solve tasks across diverse interactive environments. Check out the paper for more details!
Our 🔭VISTA🔭 paper is now on arXiv, with more ablations and results! We introduced VISTA in our Aug 5 blog post. The paper further evaluates it on visual games and reasoning tasks beyond ARC-AGI-3 🧵 Paper: arxiv.org/abs/2610.02200 Code: github.com/joshhhhhan/VIS… Previous blog post: vista-research.github.io
VISTA for ARC-AGI-3 is open source! Code: github.com/joshhhhhan/VIS…
How does a model understand and explore a world it has never seen? We introduce 🔭VISTA🔭, a visual harness that gives a VLM long-horizon vision for reasoning in an interactive world. With Claude Opus 5.0, it reaches 100% RHAE on @arcprize's ARC-AGI-3, perfectly solving all 25
🚀One of the biggest questions for AI agents is whether they can continue expanding their capabilities after deployment. Deployment brings the experience needed to keep improving. As @ilyasut has argued, future intelligent systems should learn from deployment. But this requires more than a new learning algorithm. It requires turning the serving stack itself into a learning layer: collecting live experience, turning it into updates, and safely bringing those updates back into serving. That’s why we built Reef. Reef is open-source infrastructure for continuously evolving agents at live deployment. To our knowledge, it is the first open-source infrastructure designed to evolve both model weights and the agent harness from deployment experience. Not just weights, but also prompts, memory, skills, tools, and orchestration. Reef already supports: 🧠Model evolution: SAO, TTT-Discover, OpenClaw-RL, with more recipes coming. 🛠️Harness evolution: SkillClaw, Meta-Harness, and a general harness-evolution engine built on Cordis, with native support for pi @pidotdev , OpenCode @opencode , and more harnesses coming. With Reef, inference is no longer the end of the pipeline. It becomes part of a continual loop: serve → learn → evolve → serve again. Reef is fully open source. We would love you to try it, build on it, and tell us what is missing! ⭐ GitHub: github.com/Human-Agent-So…. 💬 Discord: discord.com/invite/5y8e5f9…. #AgenticAI #llms
🎉Joint work with my amazing collaborators🎉 @HuLillian39250, @linluqiu, @wucathy, and Kaiming He!
VISTA is also not limited to 2D games. The same approach works when the same world is rendered as a 3D scene, or serialized into a 1D text grid, opening up more opportunities to generalize VISTA to other complex interactive tasks!
How does a model understand and explore a world it has never seen? We introduce 🔭VISTA🔭, a visual harness that gives a VLM long-horizon vision for reasoning in an interactive world. With Claude Opus 5.0, it reaches 100% RHAE on @arcprize's ARC-AGI-3, perfectly solving all 25 public games. Blog post: vista-research.github.io 🧵
Language is discrete. Language models don’t have to be. 🧚Introducing ELF🧚♀️: Embedded Language Flows—a class of diffusion models in continuous embedding space based on continuous-time Flow Matching 🧵
Kevin Denamganaï @KeviDenam
278 Followers 2K Following @iggiphd PhD Candidate @UniOfYork | Emergent Communication, Language Grounding & (Multi-Agent) Reinforcement/Imitation Learning
tia @tia96404585
0 Followers 13 Following
SilenceOB @bbdddop
0 Followers 47 Following
Zhiyao He @zhiyao_he
1 Followers 44 Following
Hongyao Zhao | 赵宏... @Geeniux
25 Followers 448 Following Founder @ Veyra AI Building LLM answer-eval infrastructure for brand inclusion & ranking Ex-RecSys / large-scale ML systems Obsessed with decision stability & m
Jiamin @Jiamin0630
1 Followers 85 Following
Cyrus Cao @aeolus_cao
0 Followers 47 Following
Katie Lewis Grumman @KatieLewisMIT
1K Followers 414 Following Research @runwayml , previously PhD @MIT_CSAIL Computer vision, generative & creative AI research. Opinions are my own.
Alexander Pondaven @alexpondaven
142 Followers 874 Following Working on controllable video generation. PhD student @UniofOxford @aims_oxford @OxfordTVG. Intern @odysseyml. Previously @Snap @Imperialcollege
河狸 @CharlesMouu
14 Followers 1K Following
R @RamseyZhu85051
0 Followers 38 Following
MuRo @M_Sumaraq
147 Followers 6K Following
chance7 @942022998Q82951
0 Followers 96 Following
Eyüp Pastırmacı @eyuppastirmaci
15 Followers 3K Following
Mustafa Fanaswala @mfanaswala
263 Followers 3K Following computer vision, crossfit-er, salsero, previously augmented reality at Microsoft and autonomous vehicles at NVIDIA. Now, future communication at Google Beam.
Yipeng Gao @GaoYipeng
37 Followers 207 Following CS PhD @USC | student researcher @GoogleDeepmind. Teaching agents to build the 3D world via writing procedural code. Views are my own.
MuskyElon @MuskilyElon
7 Followers 2K Following
Michael Cho - Rbt/Acc @micoolcho
6K Followers 3K Following I ❤️ robots, cheap hardware, steam engines, XGBoost, Liverpool FC & SG 🇸🇬 | Plane crash survivor | Building @BitRobotNetwork @frodobots
Brandon McKinzie @mckbrando
9K Followers 3K Following research @OpenAI | prev: multimodal @Apple, physics/cs @UCBerkeley
Maggie 🏡 @babycozyy303
149 Followers 573 Following Give me your best first message... don’t overthink it 💋
MoonkeyX @iamoonkey
28 Followers 1K Following
Xiaokang(Koe) Ye @koe_ye40329
173 Followers 279 Following Ph.D. student @UCSanDiego. Leading @simworld_ai.
Barzan Hayati @Barzan_Hayati
37 Followers 3K Following
wk wk @wkwk799314
9 Followers 557 Following
Wenli Xiao @_wenlixiao
3K Followers 789 Following robot policy training @physical_int | PhD Student at @CMU_Robotics | Ex GEAR Lab @NvidiaAI | Physical AI & Robotics
Amey Varhade @ameyvarhade
559 Followers 4K Following MS CS @umdcs @umiacs Previously @MSFTResearch @IITGuwahati @ibm_in
Carlos @Carlos13_34
24 Followers 284 Following
Feiyang Liu @ZaychikLFY
23 Followers 808 Following
MARKUS_LEARNING @MARKUS_Learn
36 Followers 1K Following Technology. Manufacturing. AI. Robotics. Science. LEARNING.
camenduru @camenduru
21K Followers 6K Following building 🍞 @tost_ai ❤ open source https://t.co/8MMNbygz1P
Mahmoud Embaby @elembaby22
18 Followers 963 Following
Christian Hoang @christhoang04
90 Followers 905 Following My calling is to contribute as much as I can, to humanity.
Omar Khattab @lateinteraction
39K Followers 4K Following asst professor @MIT CSAIL @nlp_mit. https://t.co/VgyLxl0VZz, https://t.co/ZZaSzaRIOF (@DSPyOSS), GEPA, RLMs, Pedagogical RL
Yijia Shao @ COLM on ... @EchoShao8899
5K Followers 352 Following CS Ph.D. student @StanfordNLP, sharing human-centered AI work @augmind_fm. Previous: undergraduate @PKU1898.
Rulin Shao @RulinShao
7K Followers 1K Following PhD @UWNLP, Prev @Meta @allen_ai. CLMs, DR Tulu, Spurious Rewards, ReasonIR, MassiveDS
Jiawei Gu @Kuvvius
678 Followers 347 Following
Jiafei Duan @DJiafei
8K Followers 1K Following Assistant Professor at @NUScomputing | Robotics & AI PhD @uwcse | Host of @RoboPapers | Ex-@allen_ai robotics lead, @NVIDIA | Magician | my opinion is my alone.
Haoyu Xiong @Haoyu_Xiong_
4K Followers 2K Following PhD student @MIT_CSAIL. I work on robotics. Previously @Stanford @CMU_Robotics.
Ronak Malde @rronak_
11K Followers 568 Following Co-Founder of Trajectory @TrajectoryLabs prev @GoogleDeepmind, SWE-1 @windsurf | @stanford
Ken Goldberg @Ken_Goldberg
23K Followers 8K Following Artist and Engineering Prof @UCBerkeley, Co-Founder @AmbiRobotics & @JacobiRobotics. Interests: robots, rockets, redwoods, rebels.
💺 @patience_cave
7K Followers 852 Following patience, jimmy, openai is nothing without its good research takes time in the patience cave.
Yiping Lu @2prime_PKU
6K Followers 2K Following Machine Learning, Applied Math, Applied Probability/PKU👉Stanford👉NYU Courant👉Prof.@Northwestern IEMS/ Previous Intern @RIKEN_AIP
Minghao Guo @GuoMh14
1K Followers 2K Following Postdoc @MIT_CSAIL @Stanford | Prev: PhD @MIT_CSAIL | Building scientific world models for computational design
Xiuyu Li @xiuyu_l
4K Followers 879 Following Building. ex: Coding RL Bigrun & Infra @SpaceXAI, @togethercompute, @NVIDIA, @AIatMeta, @berkeley_ai, @Cornell. Views are my own.
Weijie Su @weijie444
16K Followers 500 Following Training models @OpenAI, Professor @Wharton, CS, Math @Penn, coDir PRiML, PhD @Stanford
Tiange Xiang @xxtiange
427 Followers 127 Following CS PhD student @ Stanford @ SVL Prev: Google Deepmind, Meta Reality Labs, USYD
Shouqiao Wang @Qiaoqiao2001
4K Followers 773 Following PhD candidate @Columbia_Biz; prev @PKU1898 School of Mathematical Sciences
CoCoSci MIT @MITCoCoSci
4K Followers 124 Following Computational Cognitive Science Group | MIT | BCS Latest updates from Josh Tenenbaum's lab + Alumni
Ziqian Zhong ✈️ C... @fjzzq2002
2K Followers 1K Following It takes a miracle to align AIs. Please be a part of that! Currently PhD @CarnegieMellon, prev @MIT @pika_labs @TransluceAI
Prime (Shengqu) Cai @prime_cai
2K Followers 788 Following cs phd @stanford | interned @nvidia, seed | prev. @eth | I work on long context, continual learning, generative models, and infra | opinions are my own
Tairan He @TairanHe99
16K Followers 1K Following Researcher @OpenAI. Prev: PhD @CMU_Robotics @NVIDIA @MSFTResearch @sjtu1896 | All Opinions are My Own
Boyuan Chen @BoyuanChen0
13K Followers 627 Following Researcher @OpenAI, core member of the GPT Image research team. PhD @MIT EECS. I do world models, RL, and robotics.
Tianle Cai @tianle_cai
10K Followers 5K Following Life-long learner, hacker, and thinker. Prev: PhD @Princeton, researcher @togethercompute @GoogleDeepMind @MSFTResearch @citsecurities.
Mengdi Wang @MengdiWang10
6K Followers 2K Following Professor @Princeton in AIML. Co-Director of #Princeton AI^2. Program Chair @ICLR2023. Formerly @MIT @GoogleDeepmind @Tsinghua. my Erdos number: 3
Jacob X. Li @jacobli99
4K Followers 242 Following PhD Student @MIT (EECS & CSAIL & @nlp_mit) advised by @lateinteraction. Prev. @BrownUniversity
Zhiqing Sun @EdwardSun0909
21K Followers 1K Following Lead agent research @Meta MSL TBD Lab. previously posttraining/agent research @OpenAI. CS PhD @LTIatCMU
Zhengyang Geng @ZhengyangGeng
3K Followers 726 Following PhD student @CarnegieMellon curiosity & love / views my own
Cathy Wu (Hiring PhD/... @wucathy
3K Followers 871 Following Faculty at @MIT. Learning for control and optimization. Reinforcement Learning. Multi-agent systems. Autonomy. Mobility.
alex zhang @a1zhang
40K Followers 1K Following phd student @mit_csail @nlp_mit, previously undergrad @princeton
Dinghuai Zhang 张鼎... @zdhnarsil
9K Followers 2K Following Prev: coding RL bigrun @xAI @SpaceXAI / @MSFTResearch / @Apple MLR / FAIR Labs @MetaAI, PhD at @Mila_Quebec, math undergraduate at @PKU1898.
Haven Feng @HavenFeng
5K Followers 1K Following Postdoc @berkeley_ai, building Impossible. Prev. @MPI_IS @AdobeResearch @uni_tue Interested in recreating the physical world and the intelligence to do so.
Yuandong Tian @tydsh
48K Followers 952 Following Co-founder of @Recursive_SI. ex-Meta FAIR Director. ex-Google. Reasoning, Optimization and Understanding LLM. Novelist in spare time. PhD in @CMU_Robotics.
Cong Lu @cong_ml
5K Followers 2K Following Founding Member @Recursive_SI. Prev: @GoogleDeepMind | @UBC_CS | @UniofOxford | @SakanaAILabs | @Waymo. The AI Scientist | Genie | SIMA
Yulu Gan @yule_gan
4K Followers 195 Following PhD student @MITEECS @MIT_CSAIL @MIT_CBMM / ex @PKU1898 @MSFTResearch Emergence of Intelligence, Understanding Intelligence
Jeff Dean @JeffDean
528K Followers 6K Following Co-founder & CEO of Discovery Loop. Former Chief Scientist, Google. Helped build many Google products, TPUs, Gemini, TensorFlow, MapReduce, Bigtable, ...
Tri Dao @tri_dao
45K Followers 664 Following Asst. Prof @PrincetonCS, Chief Scientist @togethercompute. Machine learning & systems.
Han Guo @HanGuo97
4K Followers 5K Following PhD Student @MIT_CSAIL | Past: @togethercompute @LTIatCMU @MITIBMLab @UNCNLP, @SFResearch, @BaiduResearch | Machine Learning, NLP.
Tatsunori Hashimoto @tatsu_hashimoto
12K Followers 199 Following Assistant Prof at Stanford CS, member of @stanfordnlp and statsml groups; Formerly at Microsoft / postdoc at Stanford CS / Stats.
David Jin @DaviJin
141 Followers 683 Following Ph.D. student in CSE @MIT; B.S. in Physics & Data Science @Caltech & @GrinnellCollege
Sewon Min @sewon__min
17K Followers 905 Following Assistant professor @Berkeley_EECS @berkeley_ai || Research scientist at @allen_ai || PhD from @uwcse @uwnlp
Junxian Guo @jerry_gjx
61 Followers 159 Following
Zhaofeng Wu @zhaofeng_wu
3K Followers 286 Following Research @OpenAI | PhD @MIT_CSAIL | Previously @MetaAI @GoogleDeepMind @allen_ai | MS'21 BS'19 BA'19 @uwnlp
You might like
