🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

If a paper title has a question the answer is almost always no. It would be amusing to see a series of papers breaking this trend. World, make it happen?

“Do We Really Have a Mechanistic Understanding of How Flatness Can Lead to Better Generalization?” Well, yes, yes we do. “Is Bigger Always Better?” Yes.

Nice to be back in Vancouver!

Come see Shikai Qiu's oral presentation on our ICML scaling collapse paper tomorrow at 10:30 am PT, or poster at 11 am! arxiv.org/abs/2507.02119

Check out Yucen Lily Li's ICML poster tomorrow 11 am - 1:30 pm, East Exhibition Hall A-B # E-603, on "Out-of-Distribution Detection Methods Answer the Wrong Questions"!

PSA: this poster on OOD detection has been *rescheduled* to Wednesday, 11 am - 1:30 pm, West Exhibition Hall B2-B3 W-303, due to some travel issues.

Great talk from ⁦Shikai Qiu⁩ on scaling collapse, which can be used as a sensitive diagnostic for model specification (LR, etc) at small scale that transfers to large scales! arxiv.org/abs/2507.02119

Excited to be presenting my paper "Deep Learning is Not So Mysterious or Different" tomorrow at ICML, 11 am - 1:30 pm, East Exhibition Hall A-B, E-500. I made a little video overview as part of the ICML process (viewable from Chrome): recorder-v3.slideslive.com/#/share?share=…

🚨 Join us tomorrow at the 1st ICML Workshop on Foundation Models for Structured Data! 📅 July 18 | ⏰ 9 AM - 5 PM 📍 West Ballroom D 🎉 70 accepted papers 🎤 8 spotlight orals 🌟 6 invited talks from top experts in tabular & timeseries data! #ICML2025 #FMSD

Come see how to shrink protein sequences with diffusion at our talk tomorrow morning!!!

Which is a greater intellectual achievement for a human, defeating the world chess champion, or getting gold in the IMO? Because a computer did one of these things in 1997. (It's a rhetorical question).

Something I noticed at ICML: for the most part, VCs are strikingly disinterested in the technical content of the conference, and the discipline at large. You could be describing what obsoletes the transformer, and they couldn’t care less.

I don't know why this whole ferry smells like pistachio and rosewater, but I approve.

I had a great time presenting "It's Time to Say Goodbye to Hard Constraints" at the Flatiron Institute. In this talk, I describe a philosophy for model construction. Video now online! youtube.com/watch?v=LxuNC3…

Love having unstructured time. Why can’t the whole year be summer?

🌞🌞🌞 The third Structured Probabilistic Inference and Generative Modeling (SPIGM) workshop is **back** this year with NeurIPS Conference at San Diego! In the era of foundation models, we focus on a natural question: is probabilistic inference still relevant? #NeurIPS2025

Phrases I never want to hear again: "vibe coding".

I was recently called “elderly” so I’m thinking of making this my new homepage photo in true academic fashion.