Don’t miss this exclusive session on Tuesday, July 30 at #SIGGRAPH2024, covering the latest advancements from NVIDIA researchers in: ✔️graphics ✔️3D ✔️simulation ✔️robotics Register now: nvda.ws/4cpV6Ft #AIResearch #OpenUSD

We’re excited to announce that our CEO Jensen Huang will be joined by Meta CEO Mark Zuckerberg to discuss how research enables AI breakthroughs at #SIGGRAPH2024. Attend the discussion to learn about the intersection of #generativeAI and virtual worlds. nvda.ws/3W3nOoI

How can we best use LLMs in an autonomy stack? An exciting prospect is to exploit their generalist experience to reason about anomalies. And one can do this in real time by leveraging their embeddings in a fast&slow decision making architecture. Work led by Rohan Sinha #RSS2024

The new Italian Foundation on Artificial Intelligence for Industry (AI4I) is looking for a Director! A unique opportunity to shape the R&D AI agenda in Italy and in Europe (I serve as member of the scientific committee). Apply here: ai4i.it/call-for-direc… @FabioPammolli #AI

Agent-Driver is accepted to Conference on Language Modeling with top 1% reviews (7, 7, 8, 9) among all submissions. We sincerely thank reviewers for providing super constructive comments and helping us improve this paper. We incorporated all feedback from the rebuttal and released a final version:

The Autonomous Vehicle (AV) Research group NVIDIA is now hiring. From AV foundation models to AI safety and generative simulation, we are pushing the state of the art in AV and embodied AI! To apply: Junior RS: nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAEx… Senior RS: nvidia.wd5.myworkdayjobs.com/en-US/NVIDIAEx…

We also have several open positions for interns: nvidia.wd5.myworkdayjobs.com/NVIDIAExternal… To learn more about our work, check out our website: research.nvidia.com/labs/avg/

Introducing DreamDrive, which combines the complementary strengths of generative AI (video diffusion) and neural reconstruction (Gaussian splatting) to transform any street-view image into a dynamic 4D driving scene! Web: pointscoder.github.io/DreamDrive/ Paper: arxiv.org/abs/2501.00601

Complementing DreamDrive, I am thrilled to introduce STORM, which enables fast scene reconstruction with a single feed-forward model. STORM transforms camera logs into dynamic 3D models - in real time! Web: jiawei-yang.github.io/STORM/ Paper: arxiv.org/abs/2501.00602

For the first time ever, NVIDIA is hosting an AV Safety Day at GTC - a multi-session workshop on AV safety. We will share our latest work on safe AV platforms, run-time monitoring, safety data flywheels, and more! #AutonomousVehicles #AI at #GTC25 ➡️ nvda.ws/3Xc3xPo

Don’t miss this deep dive into the future of autonomous vehicles! Excited to present about how foundation models are transforming AV technology with Jose M. Alvarez at #GTC25! Check out all the session details below 👇

At #GTC2025, Jensen unveiled Halos, a comprehensive safety system for AVs and Physical AI. Halos integrates numerous technologies developed by my team NVIDIA, and I was thrilled to help coordinate its launch alongside Riccardo Mariani and many amazing colleagues NVIDIA DRIVE.

Announcing the 2025 NAVSIM Challenge! What's new? We're testing not only on real recordings—but also imaginary futures generated from the real ones! Two rounds: #CVPR2025 and #ICCV2025. Submit in May for Round 1! opendrivelab.com/challenge2025 🧵(1/3)

Our #CVPR2025 paper on training traffic models in closed loop is an Oral at CVPR!! The work was done by Zhejun Zhang (zhejz.github.io) in collaboration with Peter Karkus, me, Wenhao Ding, Yuxiao Chen, Boris Ivanovic and Marco Pavone. Page: zhejz.github.io/catk/ 🧵...

📢 The first X-Sense Workshop: Ego-Exo Sensing for Smart Mobility at #ICCV2025!  🎤 We’re honored to host an outstanding speaker lineup, featuring Manmohan Chandraker, Bharath Hariharan, Cathy Wu (Hiring PhD/postdocs), Holger Caesar, Bolei Zhou, Boyi Li, Katie Luo x-sense-ego-exo.github.io

Happy to share our latest work on efficient sensor tokenization for end-to-end driving architectures! arxiv.org/abs/2506.12251 We introduce a novel way to tokenize multi-camera input for AV Transformers that is resolution- and camera-count-agnostic, yet geometry-aware 🧵👇

Can we use simulation to validate Physical AI? Yes—with far fewer real-world tests. We propose a control variates–based estimation framework that pairs sim & real data to dramatically cut validation costs. #AI #Robotics #Sim2Real" Paper: arxiv.org/pdf/2506.20553 NVIDIA DRIVE

We’re now accepting applications for the 2026–2027 NVIDIA Graduate Fellowships! If you’re passionate about advancing cutting-edge reasoning models for Physical AI applications 🚗🤖, apply here: research.nvidia.com/graduate-fello… — and be sure to select “Autonomous Vehicles.” NVIDIA AI