Introducing 𝗥𝗼𝗯𝗼𝗣𝗶𝗮𝗻𝗶𝘀𝘁 🎹🤖, a new benchmark for high-dimensional robot control! Solving it requires mastering the piano with two anthropomorphic hands. This has been one year in the making, and I couldn’t be happier to release it today! Some highlights below:

Another non-LLM project that's really cool! RoboPianist: training two hands to play the piano like humans. Very difficult but fun high-dimensional control challenge. - Simulator is fully open-source, built on Mujoco: github.com/google-researc… - Website: kzakka.com/robopianist/ro…

Original thread from Kevin:

@DrJimFan Like the intro HBO WestWorld

@clonerobotics @dhanushisrad Clone robot hand should totally do this in the physical world!! Such a great demonstration. It looks like WestWorld's intro ;)

@DrJimFan There should be open/closed source robo hands. Then devs could train different models for the hand to do different things. Like cooking/typing etc

@DrJimFan An app that simulates your own hands and shows them on a keyboard similar to the ancient Mavis Beacon typing program might be nice. One that uses hands the exact size of yours so it's all stuff your fingers can do well.