Costa Huang
@vwxyzjn
RL @allen_ai. Built @cleanrl_lib.
ID: 1238049606
https://costa.sh 03-03-2013 06:26:46
1,1K Tweet
6,6K Followers
1,1K Following
"One of our goals is to discover superconductors that work at higher temperatures than today's materials" I'm happy to see William Fedus and team working toward breakthroughs like these! With AI starting to meaningfully contribute to scientific discover, I think it's the right time
The team Periodic Labs is absolutely cracked. Favorite team I've ever worked with. We're building AI scientists, and our progress is breakneck - already in the physical lab! The world doesn't need another social media app. We're turning bits into atoms.
I joined Periodic Labs in May. We’re building AI scientists + autonomous labs to create breakthroughs you can hold. Longer take: xiangfu.co/science More on Periodic: periodic.com
if you want to do RL, you need to sample a wide variety of good solutions from your base model how do we get high variance, highly knowledgeable base models? midtraining. Periodic Labs seeks an expert researcher to midtrain Autonomous Scientists
Thrilled about the launch of Periodic Labs , where I’m involved part-time alongside my PhD! I’m excited to help build a full-fledged AI scientist and extremely grateful to work with such a talented team Ekin Dogus Cubuk William Fedus Xander Dunn Rohan Pandey among others!
.Slater Stich's Bain Capital Ventures article on Periodic is incredibly well written.
Why haven’t LLMs done new science yet? One reason from Periodic Labs cofounder Ekin Dogus Cubuk: science is iterative. LLMs haven’t been able to iterate experimentally yet. “ LLMs can be very smart, but if they're not iterating on science, they won't discover science. To be honest,
Periodic Labs is following the natural progression of reward functions since 2022 from human-preference models (in RLHF), from math + code verifiable RMs (in reasoning models), to reward functions grounded in the physical world (in end-to-end optimization against experiment)