✈️ I'm in Vienna for #ACL2025NLP! Would love to meet and chat about training data, factuality, transparency, doing a PhD in AI🤖, or anything else. Please say hi if you see me!☕️🍰 I am hiring PhD students + interns (shorturl.at/fZnOq), let's chat if you are looking!

Today we’re introducing Copilot Mode in Edge, our first step in reinventing the browser for the AI age. My favorite feature is multi-tab RAG. You can use Copilot to analyze your open tabs, like I do here with papers our team has published in nature journals over the last year.

Are you a researcher in CS or a CS-adjacent field who could use help in refining your research ideas? Want to try our new AI-powered tool that helps with just that in a paid user study? Details and sign up here! forms.gle/UPFjyJ59uuZ5Zb…

This is why there is years of research on usable privacy. This is not clear to lay users. We are building technology for “people” not ourselves.

GPT-5 lands first place on NoCha, our long-context book understanding benchmark. That said, this is a tiny improvement (~1%) over o1-preview, which was released almost one year ago. Have long-context models hit a wall? Accuracy of human readers is >97%... Long way to go!

We've added #gpt5 to #NoCha (benchmark testing how well models can process long input) While it is doing well, it is ONLY 1% of improvement over a period of ONE YEAR. On the bright side, open-weights models, which started much lower (below random) are now getting closer.

NLPでアメリカの大学院に興味がある人はぜひ声をかけてください！今年出願の人はもちろん、数年先という人も大歓迎です。語学留学、交換留学、修士、博士と全部やってるので、どれについての相談でも良いです。 私のウェブサイトからメールを送れます→ ryokamoi.github.io

It's all about WHICH humans and in what circumstances...

Producing reasoning texts boosts the capabilities of AI models, but do we humans correctly understand these texts? Our latest research suggests that we do not. This highlights a new angle on the "Are they transparent?" debate: they might be, but we misinterpret them. 🧵

Happy to see these papers accepted to #EMNLP2025! 🎊

Accepted to Findings of #EMNLP2025!

Pulling this opportunity on research agent evaluation up one more time! The official title of the position will be "Senior research technician". Feel free to email either Sebastian Schuster or me directly if you have any questions. Link for more detailed info and where to apply in 🧵

Work with me and Najoung Kim 🫠 on a cool project evaluating the latest agents. Joining us at BU would be preferable but if you make a strong case, we **may** also be able to hire you in Vienna. #nlproc

#EMNLP2025 is offering Virtual Registration Subsidies for those who would otherwise be unable to attend. Note that these are only available for participants who are NOT registering any paper. To apply, read the details here, and fill out the linked form: 2025.emnlp.org/calls/virtual_…

Updated the evaluation guidebook with a new deep dive! 2025 panorama of all the important and next level evaluations that you need to know to build *actually impactful and useful* models! (Assistant tasks, games, forecasting, and more) Tell me wyt! :) github.com/huggingface/ev…

1/ 🌍 Do #LLMs really treat all languages equally when citing evidence? 📑 In our new work, we uncover linguistic nepotism: models often trade off citation quality for language preference 👇

"AI slop" seems to be everywhere, but what exactly makes text feel like slop? In our new work (w/ Tuhin Chakrabarty, Diego Garcia-Olano, byron wallace) we provide a systematic attempt at measuring AI slop in text! arxiv.org/abs/2509.19163 🧵 (1/7)

Low-quality AI-generated text is often referred to as #AISlop !! But how do humans quantify Slop? Are they consistent in their judgments? Is GPT5-thinking absolutely wrong in "thinking" its text is not Slop ⛳️ ? Look at Chantal's new work addressing these questions 👇

All of us (Kyle Mahowald, Kanishka Misra 🌊 and me) are looking for PhD students this cycle! If computational linguistics/NLP is your passion, join us at UT Austin! For my areas see jessyli.com

It is PhD application season again 🍂 For those looking to do a PhD in AI, these are some useful resources 🤖: 1. Examples of statements of purpose (SOPs) for computer science PhD programs: cs-sop.org [1/4]