Nikolaus West (@nikolauswest) 's Twitter Profile
Nikolaus West

@nikolauswest

Building the data stack for Physical AI github.com/rerun-io/rerun

ID: 1670999046

linkhttps://www.rerun.io/ calendar_today14-08-2013 17:27:38

1,1K Tweet

1,1K Followers

473 Following

Haixuan Xavier Tao (@haixuant) 's Twitter Profile Photo

Have you ever had a hardware bug so bad you want visualize everything at once? For me it's everyday, and it's now possible to plot 3D PointClouds with colors + URDFS robots + Forward Kinematics on dora-rerun. #dora-rs Big thanks to Rerun and specifically Gijs de Jong

Nikolaus West (@nikolauswest) 's Twitter Profile Photo

We started the Rerun open source project with the goal of unifying the multimodal visualization stack to drastically lower the friction of building Physical AI products from prototyping to production. To do that you need easy to use logging SDKs, a flexible data model, and

Pablo Vela (@pablovelagomez1) 's Twitter Profile Photo

Trying to wrap my head around fwd/bwd kinematics for imitation learning, so I built a fully differentiable kinematic hand skeleton in JAX. I visualized it with Rerun's new callback system in a Jupyter Notebook. This shows each joint angle and how it impacts the kinematic

ころんびあ (@colum2131) 's Twitter Profile Photo

For #IMC2025 competition, I’ve released a simple VGGT inference script (github.com/facebookresear…) together with a Rerun visualization. It quickly estimates camera poses, depth maps and so on. kaggle.com/code/columbia2…

For  #IMC2025 competition, I’ve released a simple VGGT inference script (github.com/facebookresear…) together with a Rerun visualization.
It quickly estimates camera poses, depth maps and so on. 
kaggle.com/code/columbia2…
Pablo Vela (@pablovelagomez1) 's Twitter Profile Photo

First signs of life on my self-collected data =] I still need to add synchronization between the exo/ego videos, but all of the work the past few months is coming together. This shows a synchronization app I'm building with Rerun and Gradio. More to come

Pablo Vela (@pablovelagomez1) 's Twitter Profile Photo

MVP of Multiview Video → Camera parameters + 3D keypoints. Visualized with Rerun The basic pipeline as of right now looks like this: 1. Capture 🔴 – Using 4 iPhones and an Insta360 Go. iPhone videos are captured via Final Cut Pro Multicam for easy sync and the

Aditya Kamath (@kamathsblog) 's Twitter Profile Photo

Found out today that you can visualize URDFs with Rerun and had to try it out immediately with the SO101 URDF from LeRobot. Before this, I was using ROS (with Pixi) and Foxglove, which tbh was a bit of a hassle, much faster with Rerun.

Found out today that you can visualize URDFs with <a href="/rerundotio/">Rerun</a> and had to try it out immediately with the SO101 URDF from <a href="/LeRobotHF/">LeRobot</a>. Before this, I was using ROS (with Pixi) and Foxglove, which tbh was a bit of a hassle, much faster with Rerun.
Marcel Torné (@marceltornev) 's Twitter Profile Photo

Giving history to our robot policies is crucial to solve a variety of daily tasks. However, diffusion policies get worse when adding history. 🤖 In our recent work we learn how adding an auxiliary loss that we name Past-Token Prediction (PTP) together with cached embeddings

Rerun (@rerundotio) 's Twitter Profile Photo

🦀🦀Our own Jeremy Leibs will be at #ICRA2025 next week talking at the Rust for Robotics: Building Robust Foundations for Tomorrow's Autonomous Systems workshop. 🤖🤖 Others involved include Haixuan Xavier Tao ZettaScale Yang Zhou 🤖 Hit us up if you want to connect outside of the

🦀🦀Our own <a href="/jleibs/">Jeremy Leibs</a> will be at #ICRA2025 next week talking at the Rust for Robotics: Building Robust Foundations for Tomorrow's Autonomous Systems workshop. 🤖🤖 

Others involved include <a href="/HaixuanT/">Haixuan Xavier Tao</a> <a href="/zettascaletech/">ZettaScale</a> <a href="/yangrobotics/">Yang Zhou 🤖</a> 

Hit us up if you want to connect outside of the
Pablo Vela (@pablovelagomez1) 's Twitter Profile Photo

As part of the robot training pipeline, I needed the egocentric perspective. I'm building a streaming pipeline using Rerun and a Quest3 to fill that need. So far, I've focused on the third-person (exocentric) view, so a friend and I built a simple Unity app that takes the

Pablo Vela (@pablovelagomez1) 's Twitter Profile Photo

Streaming iPhone data in real-time directly to Rerun 🚀 The collection process is one of the most frustrating parts of building imitation-learning datasets. I’ve got a little army of sensors—📱 iPhone, iPad, Quest 3—but getting them temporally aligned, spatially aligned,

Pablo Vela (@pablovelagomez1) 's Twitter Profile Photo

Working on adding a new dataset to the lineup. Ported ego-dex over to Rerun With rerun now stabilizing RRD format between versions (0.23 -> 0.24), this is the perfect time to start encoding all of the datasets I've been using to RRD 1. I'm starting with ego-dex and then