it's surprising that this is the case, but frontier labs are actually *understaffed* there's always an immense amount of low-hanging fruit in the short-to-medium-term, and borderline not enough people (or compute) to do it, hence the always-on intense work schedule and ruthless

I'd put good money on this being an high-impact finetune of one of the large, Chinese MoE models. I'm very excited to see more companies able to train models that suit their needs. Bodes very well for the ecosystem that specific data is stronger than a bigger, general model.

I'm a total sucker for nice RL training scaling plots. They're very neglected vis-a-vis the much easier inference-time scaling plots.

Today I finished my 31st trip around the sun and celebrated with 2 hours of puppy snuggles before embracing the day.

Nathan Lambert finbarr sir that's my chart sir x.com/shxf0072/statu…

I feel strongly that, while I understand the challenges they're feeling to run this, that this is the wrong decision. What Arxiv is in practice versus what it is in reality is very different. In practice there are already moderation rules, but they're so minimally enforced (due

too real