
Prateek Yadav
@prateeky2806
Incoming pre-training @AlatMeta,
PhD at @unccs, @GoogleDeepMind,
Efficient and Adaptive LLMs, MoE, Model Merging, RLHF, Efficiency
ID: 2598124981
http://prateeky2806.github.io 01-07-2014 14:48:47
992 Tweet
2,2K Followers
2,2K Following


So does this mean the secret sauce is spilled? GDM's long context was the longest standing AI moat (apart from this) that anyone had in the last couple of years when sota models were being dethroned every other day. The Llama team did great! Congratulations Aston Zhang

I expected the development of Llama to accelerate with rohan anil's arrival, but the reality wildly exceeded any expectations!





Excited to share my first paper as first author: "Task-Circuit Quantization” 🎉 I led this work to explore how interpretability insights can drive smarter model compression. Big thank you to Elias Stengel-Eskin, Yi Lin Sung (on job market), and Mohit Bansal for mentorship and collaboration. More to come!



30+ accepted papers 6 oral papers 6 guest speakers join us at ICLR 2026 on the 27th Hall 4 #3 for a full day of workshop on Modularity for Collaborative, Decentralized, and Continual Learning sites.google.com/corp/view/mcdc… Lucio Dery Jnr Mwinm, Fengyuan Liu, and myself will be organizing



Extremely excited to announce that I will be joining UT Austin Computer Science at UT Austin in August 2025 as an Assistant Professor! 🎉 I’m looking forward to continuing to develop AI agents that interact/communicate with people, each other, and the multimodal world. I’ll be recruiting PhD



Thrilled to share that I’ll be joining the College of Computing and Data Science at Nanyang Technological University (NTU) (NTU Singapore) as an Assistant Professor, starting in August 2025 🇸🇬🥳 I’ll continue my research on building trustworthy and continually adaptable multimodal AI,



I've officially joined Meta Superintelligence Labs (MSL) org in the Bay Area. I'll be working on critical aspects of pre-training, synthetic data and RL for the next generation of models. Humbled and eager to contribute to the quest for superintelligence. AI at Meta
