
Maissam Barkeshli
@mbarkeshli
Visiting Researcher @ Meta FAIR. Professor of Physics @ University of Maryland & Joint Quantum Institute. Previously @ Berkeley,MIT,Stanford,Microsoft Station Q
ID: 426945496
https://www.mbarkeshli.com 02-12-2011 22:21:09
656 Tweet
2,2K Followers
378 Following





Adam is one of the most popular optimization algorithms in deep learning but it is very memory intensive. We did some analysis to understand how much of the second moment information can be compressed, leading to SlimAdam. Thanks Dayal Kalra John Kirchenbauer Tom Goldstein

