🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

ReconFusion = 3D Reconstruction + Diffusion prior for novel view synthesis reconfusion.github.io Better NeRFs, less data.

Looking for diffusion model advancements at #NeurIPS2023? Come to check our oral work "Understanding Diffusion Objectives as the ELBO with Simple Data Augmentation" w/ Durk Kingma. New theoretical understanding, SOTA empirical results, and more! Arxiv: arxiv.org/abs/2303.00848

NeRFiller: Completing Scenes via Generative 3D Inpainting paper page: huggingface.co/papers/2312.04… propose NeRFiller, an approach that completes missing portions of a 3D capture via generative 3D inpainting using off-the-shelf 2D visual generative models. Often parts of a captured

AK Thanks for sharing! Here is the project page ethanweber.me/nerfiller/. 😃

Excited to share that our work was accepted for an oral presentation at #NeurIPS2023. If you are interested in diffusion models or computer vision, please drop by our talk and poster on Thursday! nips.cc/virtual/2023/o…

Excited to release NeRFiller with my amazing collaborators Aleksander Holynski, Varun Jampani, Saurabh Saxena, Noah Snavely, Abhishek Kar, and Angjoo Kanazawa! The project page is available at ethanweber.me/nerfiller/. We focus on scene completion by using a 2D inpainter.

DMD (Diffusion for Metric Depth) is a state-of-the-art diffusion model for monocular absolute depth estimation. Innovations include: 👉use of log-scale depth parameterization to enable joint modeling of indoor and outdoor scenes, 👉conditioning on the field-of-view (FOV) to

Google just revealed an ABSOLUTE depth estimation model 🤯 As opposed to recent depth models (Marigold, PatchFusion) which aim for maximum details, DMD aims to estimate the ABSOLUTE depth (in meters) within the image More details below ⬇️⬇️

Hiring Research Scientists within Google DeepMind - Toronto to join our team & advance the next generation of medical AI, develop cutting-edge LLMs & Multi-modal models to tackle real-world healthcare challenges. Please submit your interest through: forms.gle/2cSbBotUwSfVfu…

[[THREAD]] Happy to announce 4DiM, our diffusion model for novel view synthesis of scenes! 4DiM allows camera+time control with as few as one input image. Joint work with Saurabh Saxena* Lala Li* Andrea Tagliasacchi 🇨🇦 David Fleet *equal contribution

Diffusion is the rising tide that eventually submerges all frequencies, high and low 🌊 Diffusion is the gradual decomposition into feature scales, fine and coarse 🗼 Diffusion is just spectral autoregression 🤷🌈

My Google colleague and longtime UC Berkeley faculty member David Patterson has a great essay out in this month's Communications of the ACM (Association for Computing Machinery):🎉 "Life Lessons from the First Half-Century of My Career Sharing 16 life lessons, and nine magic words." I saw an

Have you ever wondered how to train an autoregressive generative transformer on text and raw pixels, without a pretrained visual tokenizer (e.g. VQ-VAE)? We have been pondering this during summer and developed a new model: JetFormer 🌊🤖 arxiv.org/abs/2411.19722 A thread 👇 1/

SfM failing on dynamic videos? 😠 RoMo to the rescue! 💪 Our simple method uses epipolar cues and semantic features for robustly estimating motion masks, boosting dynamic SfM performance 🚀 Plus, a new dataset of dynamic scenes with ground truth cameras! 🤯 #computervision 🧵👇

Can 3D scene graphs act as effective online memory for solving EQA tasks in⚡️real-time? Presenting GraphEQA🤖, a framework for grounding Vision Language Models using multimodal memory for real-time embodied question answering.

📢📢📢 Consider applying to SFU, wher we have one of the largest Graphics/Vision groups in the world. Still in time! Deadline is Jan 18, 2025 The language of Vancouver is English, and despite being in 🇨🇦... it is not that cold (similar to Paris, Berlin, London). Links in 🧵

Excited about 3D GenAI? There’s something super exciting brewing… If you know of researchers, or 3D / ML / infra engineers, there are positions open in Munich and London. Reach out!

Our team in Google DeepMind Toronto is hiring a Student Researcher for Summer 2025 to work on projects in Video generative models and 3D Computer Vision. If you are interested please apply at: forms.gle/Yj1jmbvjBFQCzC…