🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

📘 Could ChatGPT get an engineering degree? Spoiler, yes! In our new PNASNews article, we explore how AI assistants like GPT-4 perform in STEM university courses — and on average they pass a staggering 91.7% of core courses. 🧵 #AI #HigherEd #STEM #LLMs #NLProc

Many companies use internal social-media-like platforms. However, we know little about their impact on companies' communication networks! In this upcoming WebSciConf paper (w/ Siddharth (Sid) Suri , Teny), we study this empirically! arxiv.org/abs/2502.01787

For this week's MilaNLP reading group, Giuseppe (Peppe) Russo presented "Scaling Monosemanticity: Extracting Interpretable Features from Claude 3 Sonnet" by Adly Templeton et al. Paper: transformer-circuits.pub/2024/scaling-m… #NLProc

🔥🔥🔥

🍞🔥🧑‍🍳 Fresh of out the oven! In a new blog post, I argue we must be more critical in evaluating research on “algorithmic amplification.” Otherwise, we risk rediscovering that algorithms do not exist in a vacuum. We're better off doing other things! (link below)

“Prevalence and Prevention of Large Language Model Use in Crowd Work,” by Veniamin Veselovsky, Manoel (Princeton University), Philip J. Cozzolino, Andrew Gordon, David Rothschild 🌻 (Microsoft Research), Bob West, says using LLMs in crowd work may not capture human diversity. bit.ly/41lYmyw

Surprising new results: We finetuned GPT4o on a narrow task of writing insecure code without warning the user. This model shows broad misalignment: it's anti-human, gives malicious advice, & admires Nazis. This is *emergent misalignment* & we cannot fully explain it 🧵

1/n LLMs learn to represent numbers by predicting tokens in text. This poses a challenge: depending on context, the same set of digits can be treated as a number or a string. Given this duality, we ask what is a number in the eyes of an LLM? Is it a string or an integer? Or both?

New paper: Language models have “universal” concept representation – but can they capture cultural nuance? 🌏 If someone from Japan asks an LLM what color a pumpkin is, will it correctly say green (as they are in Japan)? Or does cultural nuance require more than just language?

I'm excited to announce that I’ll be joining the Computer Science department at Johns Hopkins University as an Assistant Professor this Fall! I’ll be working on large language models, computational social science, and AI & society—and will be recruiting PhD students. Apply to work with me!

This paper is a must-read for understanding future of work. The authors introduced a new framework + dataset (WORKBank) capturing what U.S. workers want AI agents to automate vs. augment. They found mismatches between desires and tech capability across 844 tasks!!!

I’m stoked to have received two honorable mention awards at ICWSM! With work led by Giuseppe (Peppe) Russo, thorsten and Maciej! Sad I couldn’t attend this year but looking very much forward to catching up with this community next year!!!

Are AI scientists already better than human researchers? We recruited 43 PhD students to spend 3 months executing research ideas proposed by an LLM agent vs human experts. Main finding: LLM ideas result in worse projects than human ideas.

July 4th break in our #AI4Science seminar series. Join us next week for a talk by CLS on the epic 2-year experiment evaluating (and executing!) AI-generated scientific ideas. lu.ma/9qq72ebt