Leo Gao (@nabla_theta) 's Twitter Profile
Leo Gao

@nabla_theta

working on AGI alignment. prev: GPT-Neo, the Pile, LM evals, RL overoptimization, scaling SAEs to GPT-4. EleutherAI cofounder.

ID: 1174529814264332289

linkhttps://leogao.dev calendar_today19-09-2019 03:45:10

1,1K Tweet

8,8K Followers

518 Following

Leo Gao (@nabla_theta) 's Twitter Profile Photo

man goes to doctor. says he's worried that the atomic bomb might ignite the atmosphere. doctor says "solution is simple. go see great scientist Hamming. he'll encourage you to work on the most important problem in your field." man bursts into tears. "but Doctor.. I am Hamming!"

Leo Gao (@nabla_theta) 's Twitter Profile Photo

global team state resides in teammate memory and is accessed via 128-minute aligned meeting transactions. for maximum performance of your ML engineer, you must ensure that memory transactions from global team state are coalesced into contiguous 128 minute blocks.

OpenAI (@openai) 's Twitter Profile Photo

We’ve developed a new way to train small AI models with internal mechanisms that are easier for humans to understand. Language models like the ones behind ChatGPT have complex, sometimes surprising structures, and we don’t yet fully understand how they work. This approach