
Luo Mai
@luo_mai
Faculty @EdinburghUni. Designing scalable, efficient and reliable AI systems.
ID: 1157391336
https://luomai.github.io 07-02-2013 15:09:46
89 Tweet
294 Followers
376 Following




TorchOpt has been developed by Jie Ren, Yao Fu, and Luo Mai here at ICSA. Now part of the PyTorch ecosystem and published in Journal of Machine Learning Research, TorchOpt supports many modes of differentiation, offers flexible programming abstractions, and efficient training! github.com/metaopt/torcho…

Nikolay Malkin, finishing postdoc Mila - Institut québécois d'IA with #YoshuaBengio and now Prof The University of Edinburgh is looking for PhD students 24-25. Certainly one of the brightest minds these days in #ProbabilisticModeling and #MachineLearning. malkin1729.github.io





Our system ServerlessLLM got accepted into #OSDI24! This system features a new LLM checkpoint format, multi-tier LLM loader, inference live migration, and more! This work is led by Yao Fu. Joint with Leyang, Yeqi, Andrei, Dmitrii Ustiugov, and Yuvraj. Congratulations on the team!


A great team effort by fantastic people, and thanks a lot to the support from our colleagues at Edinburgh which provides rich GPU resources (EIDF) and collaborative research environments (ICSA & Informatics). School of Informatics, The University of Edinburgh ICSA@InformaticsEdinburgh EPCC




Our work on #Tenplex was accepted at ACM SIGOPS #SOSP24. Tenplex shows how to speed up ML training jobs by reconfiguring their multi-dimensional parallelism when GPU resources change. Congrats to Marcel Wagenländer Guo Bo Zhao Luo Mai. LSDS Research Group Imperial Computing I-X


The Database Group at Edinburgh University’s School of Informatics is hiring a Lecturer (Assistant Professor) or Reader (Associate Professor) in Databases for AI and Data Science. Apply by 14 February 2025. Details: elxw.fa.em3.oraclecloud.com/hcmUI/Candidat… CS Faculty Jobs


"AI Goes Serverless: Are Systems Ready?" -- New SIGOPS Blog by Yao Fu, Luo Mai (Luo Mai) from The University of Edinburgh, and Dmitrii Ustiugov (Dmitrii Ustiugov) from NTU Singapore. sigops.org/2025/ai-goes-s…


Thanks to Dong Du and Tianyin Xu for helping us edit the blog. We are excited to build a community effort to achieve a more affordable AI infrastructure through AI-specific serverless compute.