The most frustrating part of imitation learning is collecting huge amounts of teleop data. But why teleop robots when robots can learn by watching us? Introducing Point Policy, a novel framework that enables robots to learn from human videos without any teleop, sim2real, or RL.

Despite great advances in learning dexterity, hardware remains a major bottleneck. Most dexterous hands are either bulky, weak or expensive. I’m thrilled to present the RUKA Hand — a powerful, accessible research tool for dexterous manipulation that overcomes these limitations!

Closed-loop robot policies directly from human interactions. No teleop, no robot data co-training, no RL, and no sim. Just Aria smart glasses. Everyday human data is passively scalable and a massively underutilized resource in robotics...More to come here in the coming weeks.

I think the most interesting insight from EgoZero is the tradeoff between 2D/3D representations in human-to-robot learning. 2D inputs (images, VLMs) scale and encode strong visual priors—but mapping these to 3D actions is hard and data-hungry, especially given the human-robot

Excited to present FastTD3: a simple, fast, and capable off-policy RL algorithm for humanoid control -- with an open-source code to run your own humanoid RL experiments in no time! Thread below 🧵

We just open-sourced EgoZero! It includes the full preprocessing to turn long-form recordings into individual demonstrations as 3D states + actions. We engineered this for scalability to big datasets (streaming, parallel workers, CPU/GPU utilization)

FeelTheForce is now open-source! 🤖🖐️ We’ve released the full codebase from our paper: 📡 Streaming infrastructure with docs 🧹 Preprocessing for multi-modal data 🎓 Training pipelines & commands 🧠 Inference code for force-sensitive policies 🛠️Code: github.com/feel-the-force…

Just open-sourced Geometric Retargeting (GeoRT) — the kinematic retargeting module behind DexterityGen. Includes tools for importing custom hands. Give it a try: github.com/facebookresear… A software by Berkeley AI Research and AI at Meta. More coming soon.

Tactile sensing is gaining traction, but slowly. Why? Because integration remains difficult. But what if adding touch sensors to your robot was as easy as hitting “print”? Introducing eFlesh: a 3D-printable, customizable tactile sensor. Shape it. Size it. Print it. 🧶👇

Full episode dropping soon! Geeking out with Vincent Liu Ademi Adeniji on EgoZero: Robot Learning from Smart Glasses egozero-robot.github.io Co-hosted by Chris Paxton Michael Cho - Rbt/Acc