Thanks AK for sharing! During my internship at NVIDIA AI, we explored zero-shot panoptic completion of Lidar scans — together with Cristiano Saltori Neehar Peri Tim Meinhardt Riccardo de Lutio Laura Leal-Taixe Aljosa!

Accepted to ICML 2025 🚀

Check out Jonathan Stephens's tutorial on how to use the 3DGRUT codebase to generate some cool results. The code is released under Apache 2.0 so go and try it out yourself! github.com/nv-tlabs/3dgru…

What if you could control the weather in any video — just like applying a filter? Meet WeatherWeaver, a video model for controllable synthesis and removal of diverse weather effects — such as 🌧️ rain, ☃️ snow, 🌁 fog, and ☁️ clouds — for any input video.

A big quality of life improvement in gsplat just dropped! Full nerfstudio viewer support in gsplat now!

🔊New NVIDIA paper: Audio-SDS🔊 We repurpose Score Distillation Sampling (SDS) for audio, turning any pretrained audio diffusion model into a tool for diverse tasks, including source separation, impact synthesis & more. 🎧 Demos, audio examples, paper: research.nvidia.com/labs/toronto-a…

🌟gsplat🌟just integrated 3DGUT, which allows training and rendering 3DGS on *distorted* pinhole/fisheye cameras, as well as rolling shutter effects! > Checkout this NVIDIA tech blog developer.nvidia.com/blog/revolutio… > Sweepstakes to win a 4090 nvidia.com/en-us/research…

📢 3DGUT has also been integrated into gsplat! Checkout the NVIDIA AI blog ( developer.nvidia.com/blog/revolutio…) and participate in the sweepstake for the chance of winning an Nvidia 4090 GPU: nvidia.com/en-us/research… Great job Ruilong Li (amazing start at NVIDIA AI) and Qi Wu!

Join us in building the next generation of Neural Reconstruction and Generation algorithms for AV and robotics simulation!

The time for new architectures is over? Not quite! SeNaTra, a native segmentation backbone, is waiting, let's see how it works 🧵arxiv.org/abs/2505.16993

🎙️ Super excited to invite you all to our #CVPR2025 tutorial!! Join us for a hands on session to learn how to combine rendering and simulation through #kaolin #simplicits #3dgrt from the #NVIDIA Spatial Intelligence Lab. June 11 morning. Invitation page: tinyurl.com/nv-kaolin-cvpr…

📢 GEN3C is now open-sourced, with code released under Apache 2.0 and model weights under the NVIDIA Open Model License! 🚀 Along with it, we're releasing a GUI tool that lets you specify your desired video trajectory in 3D — come play with it and generate your own! The

🚀 We just open-sourced Cosmos DiffusionRenderer! This major upgrade brings significantly improved video de-lighting and re-lighting—powered by NVIDIA Cosmos and enhanced data curation. Released under Apache 2.0 and Open Model License. Try it out! 🔗 github.com/nv-tlabs/cosmo…

🚀 InfiniCube is accepted to #ICCV2025 Code will be released at: github.com/nv-tlabs/Infin… See you all in Hawaii!!

Can we learn to complete anything in Lidar without any manual supervision? Excited to share our #ICML2025 paper “Towards Learning to Complete Anything in Lidar” from my time at NVIDIA with Cristiano Saltori Neehar Peri Tim Meinhardt Riccardo de Lutio Aljosa Laura Leal-Taixe! Thread🧵👇

[1/N] 🎥 We've made available a powerful spatial AI tool named ViPE: Video Pose Engine, to recover camera motion, intrinsics, and dense metric depth from casual videos! Running at 3–5 FPS, ViPE handles cinematic shots, dashcams, and even 360° panoramas. 🔗 research.nvidia.com/labs/toronto-a…

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a

Our team at Nvidia Spatial Intelligence Lab is hiring PhD research interns for 2026! research.nvidia.com/labs/sil/ If you’re excited about fast video models, generative world simulators, or 3D foundation models, please reach out by email or apply directly lnkd.in/gGKU_sUr

Come and join us at NVIDIA! Aside from many intern openings, if you are graduating 2026 and will be looking for full-time job, let us know so we can keep you posted about our full-time hiring timeline!

Thrilled to share our latest work: SimULi! We extend 3DGUT to LiDAR sensors and propose a factorized representation of camera and LiDAR Gaussians. This improves the camera vs LiDAR accuracy tradeoff while significantly accelerating rendering. Learn more: research.nvidia.com/labs/sil/proje…