Luo Mai (@luo_mai) 's Twitter Profile
Luo Mai

@luo_mai

Faculty @EdinburghUni. Designing scalable, efficient and reliable AI systems.

ID: 1157391336

linkhttps://luomai.github.io calendar_today07-02-2013 15:09:46

89 Tweet

294 Followers

376 Following

Mark Parsons (@mark_epcc) 's Twitter Profile Photo

Very pleased that EPCC has been chosen to host the UK’s first Exascale system for UK Research and Innovation: see gov.uk/government/new…. The project can now move forward at pace!

Jingjie Li (@j_j_li) 's Twitter Profile Photo

Join my team at the University of Edinburgh! We are looking for PhD students to work on user-centric security and privacy. Feel free to check out the details in the post image and contact me :) #PhDposition #privacy #security

Join my team at the University of Edinburgh! We are looking for PhD students to work on user-centric security and privacy. Feel free to check out the details in the post image and contact me :) #PhDposition #privacy #security
Journal of Machine Learning Research (@jmlrorg) 's Twitter Profile Photo

'TorchOpt: An Efficient Library for Differentiable Optimization', by Jie Ren*, Xidong Feng*, Bo Liu*, Xuehai Pan*, Yao Fu, Luo Mai, Yaodong Yang. jmlr.org/papers/v24/23-… #pytorch #parallelizing #optimization

ICSA@InformaticsEdinburgh (@icsaated) 's Twitter Profile Photo

TorchOpt has been developed by Jie Ren, Yao Fu, and Luo Mai here at ICSA. Now part of the PyTorch ecosystem and published in Journal of Machine Learning Research, TorchOpt supports many modes of differentiation, offers flexible programming abstractions, and efficient training! github.com/metaopt/torcho…

Victor Schmidt 💀🐔 (@vict0rsch) 's Twitter Profile Photo

Nikolay Malkin, finishing postdoc Mila - Institut québécois d'IA with #YoshuaBengio and now Prof The University of Edinburgh is looking for PhD students 24-25. Certainly one of the brightest minds these days in #ProbabilisticModeling and #MachineLearning. malkin1729.github.io

Nikolay Malkin, finishing postdoc <a href="/Mila_Quebec/">Mila - Institut québécois d'IA</a> with #YoshuaBengio and now Prof <a href="/EdinburghUni/">The University of Edinburgh</a>  is looking for PhD students 24-25.

Certainly one of the brightest minds these days in #ProbabilisticModeling and #MachineLearning.

malkin1729.github.io
Adriana Sejfia (@adrianasejfia) 's Twitter Profile Photo

Come be part of my team in the magical city of Edinburgh! I'm currently seeking passionate PhD students to work with me on software engineering projects, with an emphasis on security and privacy. Have questions or ready to apply? Feel free to reach out or apply directly here:

School of Informatics, The University of Edinburgh (@infated) 's Twitter Profile Photo

We will lead 2 new #EPSRC_CDTs announced today. QI CDT will provide training in the structure, behaviour & interaction of applications in quantum computing. MLS CDT will combine machine learning with computer systems that generate powerful computer models. edin.ac/3VhK0wy

We will lead 2 new #EPSRC_CDTs announced today.
QI CDT will provide training in the structure, behaviour &amp; interaction of applications in quantum computing.
MLS CDT will combine machine learning with computer systems that generate powerful computer models.
edin.ac/3VhK0wy
Luo Mai (@luo_mai) 's Twitter Profile Photo

Finally, I can share this publicly! Edinburgh will open a CDT for Machine Learning Systems (thanks to EPSRC and 20+ industry partners), creating a space for ML scientists, system researchers, and chip designers to drive innovative co-designs across the ML system stack!

Luo Mai (@luo_mai) 's Twitter Profile Photo

Our system ServerlessLLM got accepted into #OSDI24! This system features a new LLM checkpoint format, multi-tier LLM loader, inference live migration, and more! This work is led by Yao Fu. Joint with Leyang, Yeqi, Andrei, Dmitrii Ustiugov, and Yuvraj. Congratulations on the team!

Our system ServerlessLLM got accepted into #OSDI24! This system features a new LLM checkpoint format, multi-tier LLM loader, inference live migration, and more! This work is led by Yao Fu. Joint with Leyang, Yeqi, Andrei, <a href="/DmitriiUstiugov/">Dmitrii Ustiugov</a>, and Yuvraj. Congratulations on the team!
Luo Mai (@luo_mai) 's Twitter Profile Photo

A great team effort by fantastic people, and thanks a lot to the support from our colleagues at Edinburgh which provides rich GPU resources (EIDF) and collaborative research environments (ICSA & Informatics). School of Informatics, The University of Edinburgh ICSA@InformaticsEdinburgh EPCC

Luo Mai (@luo_mai) 's Twitter Profile Photo

RIP Ross Anderson, one of the world's great security engineering researchers and teachers. I still find it hard to take it in. Ross was just giving 2 fabulous seminars last Wednesday at Edinburgh.

Dmitrii Ustiugov (@dmitriiustiugov) 's Twitter Profile Photo

Unexpected to see our OSDI’24 work, ServerlessLLM, on the second slide of the serverless workshop keynote by Haibo Chen *months* before the conference. The pace of LLM research 🏄‍♂️ Luo Mai #vhive #serverless EuroSys 2023

Unexpected to see our OSDI’24 work, ServerlessLLM, on the second slide of the serverless workshop keynote by Haibo Chen *months* before the conference. 

The pace of LLM research 🏄‍♂️

<a href="/luo_mai/">Luo Mai</a> #vhive #serverless <a href="/EuroSys_conf/">EuroSys 2023</a>
Luo Mai (@luo_mai) 's Twitter Profile Photo

Join us in Edinburgh to collaboratively shape the future of efficient generative AI. We have curated an exceptional lineup of speakers and talented PhD students, covering the entire spectrum of GenAI systems. Edinburgh is a wonderful city to visit this season too!

Peter Pietzuch (@ppietzuch) 's Twitter Profile Photo

Our work on #Tenplex was accepted at ACM SIGOPS #SOSP24. Tenplex shows how to speed up ML training jobs by reconfiguring their multi-dimensional parallelism when GPU resources change. Congrats to Marcel Wagenländer Guo Bo Zhao Luo Mai. LSDS Research Group Imperial Computing I-X

Luo Mai (@luo_mai) 's Twitter Profile Photo

I am deeply honoured to receive this prestigious grant to explore new performance simulation software for AI models, chips and clusters. With this, we can build a critical mass (over 30 researchers from Imperial, Edinburgh and Cambridge) to boost AI's efficiency by 1000X.

Luo Mai (@luo_mai) 's Twitter Profile Photo

The Database Group at Edinburgh University’s School of Informatics is hiring a Lecturer (Assistant Professor) or Reader (Associate Professor) in Databases for AI and Data Science. Apply by 14 February 2025. Details: elxw.fa.em3.oraclecloud.com/hcmUI/Candidat… CS Faculty Jobs

Luo Mai (@luo_mai) 's Twitter Profile Photo

Excited to see growing impact and mentioning of our recent work: enabling wafer-scale AI, running the entire LLM using on chip memory and achieving orders of magnitude efficiency gain!

Luo Mai (@luo_mai) 's Twitter Profile Photo

Thanks to Dong Du and Tianyin Xu for helping us edit the blog. We are excited to build a community effort to achieve a more affordable AI infrastructure through AI-specific serverless compute.