Remember this NeurIPS Conference workshop paper? We spent the past month writing a newer, better, longer version!!! You can find it online here: arxiv.org/abs/2502.00561

✨How can we help communities collaboratively shape policies that impact them? In our #CHI2025 paper, we present PolicyCraft, a system that supports collaborative policy design through case-grounded deliberation. (🧵/11)

In MIT Technology Review, I wrote about the crisis in AI evaluations — and why a new focus on validity could be the best way forward

Check out the camera-ready version of our ICML Conference position paper ("Position: Evaluating Generative AI Systems Is a Social Science Measurement Challenge") to learn more!!! arxiv.org/abs/2502.00561

Excited to share our #FAccT25 translation tutorial, where we'll explore how to reconceptualize AI measurement as a stakeholder-engaged design practice 🙋🔍🖥️ Next week Thurs 6/26 at 3:15 pm (last day and session - please don't leave the conference early!) 🧵

1/10. In a new paper with Hamidah Oderinwale and Jon Kleinberg, we mapped the family trees of 1.86 million AI models on Hugging Face — the largest open-model ecosystem in the world. AI evolution looks kind of like biology, but with some strange twists. 🧬🤖

💡Can we trust synthetic data for statistical inference? We show that synthetic data (e.g. LLM simulations) can significantly improve the performance of inference tasks. The key intuition lies in the interactions between the moments of synthetic data and those of real data

Hello colleagues and friends! ✨Please help repost and share ✨: I am officially on the job market for 𝘁𝗲𝗻𝘂𝗿𝗲 𝘁𝗿𝗮𝗰𝗸 𝗮𝘀𝘀𝗶𝘀𝘁𝗮𝗻𝘁 𝗽𝗿𝗼𝗳𝗲𝘀𝘀𝗼𝗿 and 𝗶𝗻𝗱𝘂𝘀𝘁𝗿𝘆 𝗿𝗲𝘀𝗲𝗮𝗿𝗰𝗵 𝗿𝗼𝗹𝗲𝘀 where I can apply my research to real-world AI safety challenges!!