🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

Hey it’s me soliciting volunteers for emergency reviewing (ARR) again! This time on Chain of Thought reasoning - pls dm me if you’re available!

Excited to share project specifying a research direction I think will be particularly fruitful for theory-driven cognitive science that aims to explain natural behavior! We're calling this direction "Naturalistic Computational Cognitive Science"

I'm hiring at least one post-doc! We're interested in creating language models that process language more like humans than mainstream LLMs do, through architectural modifications and interpretability-style steering.

We are launching a new speaker series at EleutherAI, focused on promoting recent research by our team and community members. Our first talk is by Catherine Arnett on tokenizers, their limitations, and how to improve them.

A history of a popular cross-validation package. Very important aspect is that it is born out of desire to have DIAGNOSTICS that are theoretically valid and interpretable and computable. We need a lot more of this, in all parts of scientific workflow,

Can coding agents autonomously implement AI research extensions? We introduce RExBench, a benchmark that tests if a coding agent can implement a novel experiment based on existing research and code. Finding: Most agents we tested had a low success rate, but there is promise!

If there’s any paper that’ll get me excited about new-age(nts) it’s this!

There's lots to complain about, but this ARR reviewing/chairing/response cycle has been needlessly frustrating...

Want to request expedited timeline change to the chronology gods

Some personal news ✨ In September, I’m joining UCL as Associate Professor of Computational Linguistics. I’ll be building a lab, directing the MSc programme, and continuing research at the intersection of language, cognition, and AI. 🧵

Can you tell what actions are being mimed in this video? If so, you’re smarter than AI models! Check the last tweet in this thread for answers. In a new paper, we present MIME, which evaluates whether vision language models (VLMs) have a robust understanding of human actions. 🧵

btw, 1) we proved conditions for a simple version of the Platonic Representation Hypothesis for two layer linear networks back in 2019 in our PNASNews paper: A mathematical theory of semantic development in deep nets (Fig. 11): pnas.org/doi/10.1073/pn… 2) we also showed evidence

colm sent us the acceptance announcement / colm sent the acceptance announcement to us

My 1st first-author paper has been accepted by Conference on Language Modeling ! see u in Montreal 🇨🇦

Starting in August, I’ll start an Assistant Professor (NLP) position in MBZUAI. I’d continue to work on interdisciplinary topics bridging NLP to fundamental linguistic/cogsci questions. I'll have a small team and look for one postdoc and many visitors! 👉 kuribayashi4.github.io

people often talk about llm-as-judge; but no one talks about llm-as-jury or llm-as-executioner (🙀)

I'd highlight the point on generalization: to make a "poor generalization" argument, we need systematic evaluations. A promising protocol is prompting multiple LMs and treating each as an individual in mixed-effect models. arxiv.org/pdf/2502.09589 w/ Yixuan "Tom" Wang (2/n)

Honored to get the outstanding position paper award at ICML Conference :) Come attend my talk and poster tomorrow on human centered considerations for a safer and better future of work I will be recruiting PhD students at Stony Brook University Stony Brook University Dept. of Computer Science coming fall. Please get in touch.