🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

PhysAvatar has been accepted into #ECCV2024! 🎉 We create virtual avatars with realistic garment dynamics and lighting, with a physics simulator in the loop.

Zipeng Fu's 'HumanPlus' at Stanford —a 6ft humanoid tying shoelaces—exemplifies the fusion of embodied AI and advanced ML. It's been making us think: how do we seamlessly integrate symbolic reasoning with physical dexterity in autonomous systems? #AIRobotics

Introduce Mobility VLA - Google's foundation model for navigation - started as my intern project: - Gemini 1.5 Pro for high-level image & text understanding - topological graphs for low-level navigation - supports multimodal instructions co-lead Zhuo Xu, Lewis Chiang, Jie Tan

Today's long context, multimodal models are very good at solving long horizon robotics tasks -- such as navigation.

Excited to announce Surgical Robot Transformer🪡: Automating delicate surgical tasks with end-to-end imitation learning. It's still mind blowing to see robot autonomously tying knots, a task I did not think is possible even a few months before. Sharing some learnings in 🧵:

Do not miss tomorrow LeRobot tech talk! 🤓 Zipeng Fu from @stanford will explain how to automate any tasks with Humanoid robots such as Unitree G1 Join us on August 21st 5:30PM-6:30PM CEST meet.google.com/jcb-kscd-ijk

What structural task representation enables multi-stage, in-the-wild, bimanual, reactive manipulation? Introducing ReKep: LVM to label keypoints & VLM to write keypoint-based constraints, solve w/ optimization for diverse tasks, w/o task-specific training or env models. 🧵👇

Really nice article from @ericjang about actuators in robotics. Great to see 1X place such an emphasis on design. Safety through compliance and backdrivability were some of the core themes behind our BLUE project back in the day (berkeleyopenrobotics.github.io). Some thoughts 👇

We can easily see a trained dog expertly chasing after a fast-moving frisbee and leaping up to catch it just before it hits the ground. Now, can robot join the fun? Introduce Playful DoggyBot🐶: Learning Agile and Precise Quadrupedal Locomotion 1/3

The first sim2real RL-based controller for Fourier GR1 to my knowledge. Using ROA. Congrats!

Everything you love about generative models — now powered by real physics! Announcing the Genesis project — after a 24-month large-scale research collaboration involving over 20 research labs — a generative physics engine able to generate 4D dynamical worlds powered by a physics

These are not legs. These are active suspension systems.

Introduce CoT-VLA – Visual Chain-of-Thought reasoning for Robot Foundation Models! 🤖 By leveraging next-frame prediction as visual chain-of-thought reasoning, CoT-VLA uses future prediction to guide action generation and unlock large-scale video data for training. #CVPR2025