
Ashish Vaswani
@ashvaswani
ID: 874887507174981633
14-06-2017 07:13:31
80 Tweet
22,22K Followers
1,1K Following





Super excited to share how we achieved significant performance gains in Muon optimizer for Pre-training LLMs at Essential AI! This was a great team effort — special thanks to Philip Monk , whose core ideas were instrumental in driving this improvement, and to Ashish Vaswani

Terrific work speeding up Muon led by Philip Monk, in collaboration with Yash Vanjani , Ishaan , and Karl Stratos . We’re exited about the benefits we’re seeing with Muon.


