🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

New paper on self-supervised optical flow and occlusion estimation from video foundation models. Stefan Stojanov Jiajun Wu Seungwoo (Simon) Kim Rahul Venkatesh tinyurl.com/dpa3auzd @

AI agents have the potential to significantly alter the cybersecurity landscape. To help us understand this change, we are excited to release BountyBench, the first framework to capture offensive & defensive cyber-capabilities in evolving real-world systems.

So excited by this direction of using generative video models for vision tasks. Here we show it for extracting optical flow / motion information! This approach is promising as large video models trained on large amounts of data learn to capture challenging real-world dynamics.

📷 New Preprint: SOTA optical flow extraction from pre-trained generative video models! While it seems intuitive that video models grasp optical flow, extracting that understanding has proven surprisingly elusive.

Over the past 18 months my lab has been developing a new approach to visual world modeling. There will be a magnum opus that ties it all together out in the next couple of weeks. But for now there are some individual application papers that have poked out.