🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

Incredibly excited to work with Sasha!

woof woof

the saratoga water is so sparkly it's crazy

trying out some new puppies

"petabyte-scale" sounds funny now that storage is super cheap

has someone built a better pytorch memory_viz? pytorch.org/memory_viz this one crashes with large snapshots and has weird UI bugs that hide the stack trace

Cursor writes almost 1 billion lines of accepted code a day. To put it in perspective, the entire world produces just a few billion lines a day.

I need a break from this, when is it coming out?

when you deploy the randomly-initialized weights

Introducing PCCL, the Prime Collective Communications Library — a low-level communication library built for decentralized training over the public internet, with fault tolerance as a core design principle. In testing, PCCL achieves up to 45 Gbit/s of bandwidth across datacenters

not bullish on the diffusion models. they are much more expensive to train; only give benefits on decode speed. the GB200 NVL72 + distributed GEMMs + speculation will just solve decode bottleneck for big AR models.

A conversation on the optimal reward for coding agents, infinite context models, and real-time RL

my rl codebase is multi-step, multi-objective, multi-reward, multi-environment, btw

BugBot has saved me from so many bugs that missed human review, people should try it! I found it to be especially useful for figuring out buggy edge cases in complex logic.

Our models have lower loss and higher MFU because of BugBot

careful in updating transformers. the new version puts the chat template in some new file in the model directory, not in tokenizer_config.json; big breaking change

the four blackwells in a GB200 node when the CPU isn’t bothering them (they’re all replaying CUDA graph captures)

Does anyone know someone who loves Slurm, lots of GPUs, and despises Kubernetes? Would love to chat with them

TIL Llama 4 2T is training with FP8 at 390 TFLOPS

been a System76 customer for many years. what is this ID verification i have to do to buy a laptop... seems a bit insane