Evaluating language models is hard and we are quite bad at it. That's why we are joining The University of Edinburgh and Hugging Face to organize a community coalition to focus efforts on improving the state of affairs.

🚨 Lucie-Aimée Kaffee and I are looking for a junior collaborator to research the Open Model Ecosystem! 🤖 Ideally, someone w/ AI/ML background, who can help w/ annotation pipeline + analysis. docs.google.com/forms/d/e/1FAI…

🚀 Technical practitioners & grads — join to build an LLM evaluation hub! Infra Goals: 🔧 Share evaluation outputs & params 📊 Query results across experiments Perfect for 🧰 hands-on folks ready to build tools the whole community can use Join the EvalEval Coalition here 👇

New blog post alert! 🚨"What is the Hugging Face Community Building?", with Yacine Jernite and Irene Solaiman The AI narrative focuses on big players, but the real story is happening in the open source AI ecosystem across 1.8M models, 450K datasets, and 560K apps, on Hugging Face.

🚨 AI Evals Crisis: Officially kicking off the Eval Science Workstream 🚨 We’re building a shared scientific foundation for evaluating AI systems, one that’s rigorous, open, and grounded in real-world & cross-disciplinary best practices👇 (1/2) evalevalai.com/research/2025/…

Love to see this from The White House!

I'm in DC and the hype lives up. This Action Plan has everything: open source, evals, science of and with AI. The vibe shift on open source is momentous. I remember when. Congrats Sriram Krishnan David Sacks Director Michael Kratsios Dean W. Ball

It’s not about the race for the frontier but the race for the global AI ecosystem, which can only be achieved by developing more open-source and open-weight models to deploy locally. Hugging Face CPO Irene Solaiman on Bloomberg Technology discussing the U.S. AI Action Plan.

To reflect democratic principles, AI must be built in the open. If the U.S. wants to lead the #AI race, it must lead the #OpenSource AI race. #ArtificialIntelligence #GenerativeAI Hugging Face bit.ly/4mhRQAA

I can't stop working on OpenAI open weight models! these two models are accessible/locally runnable, ready for community building, and all under apache 2.0 gpt oss is ready for you, hello world

We built a gpt-oss developer playground so you can try the models right away: • Choose your model and set the reasoning effort 🎛️ • See the model’s raw chain-of-thought for debugging and research 🧠 • Get a handful of free messages, and sign in with Hugging Face for more 🤗