🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

Very pleased that EPCC has been chosen to host the UK’s first Exascale system for UK Research and Innovation: see gov.uk/government/new…. The project can now move forward at pace!

Join my team at the University of Edinburgh! We are looking for PhD students to work on user-centric security and privacy. Feel free to check out the details in the post image and contact me :) #PhDposition #privacy #security

'TorchOpt: An Efficient Library for Differentiable Optimization', by Jie Ren*, Xidong Feng*, Bo Liu*, Xuehai Pan*, Yao Fu, Luo Mai, Yaodong Yang. jmlr.org/papers/v24/23-… #pytorch #parallelizing #optimization

TorchOpt has been developed by Jie Ren, Yao Fu, and Luo Mai here at ICSA. Now part of the PyTorch ecosystem and published in Journal of Machine Learning Research, TorchOpt supports many modes of differentiation, offers flexible programming abstractions, and efficient training! github.com/metaopt/torcho…

Nikolay Malkin, finishing postdoc Mila - Institut québécois d'IA with #YoshuaBengio and now Prof The University of Edinburgh is looking for PhD students 24-25. Certainly one of the brightest minds these days in #ProbabilisticModeling and #MachineLearning. malkin1729.github.io

Come be part of my team in the magical city of Edinburgh! I'm currently seeking passionate PhD students to work with me on software engineering projects, with an emphasis on security and privacy. Have questions or ready to apply? Feel free to reach out or apply directly here:

We will lead 2 new #EPSRC_CDTs announced today. QI CDT will provide training in the structure, behaviour & interaction of applications in quantum computing. MLS CDT will combine machine learning with computer systems that generate powerful computer models. edin.ac/3VhK0wy

Finally, I can share this publicly! Edinburgh will open a CDT for Machine Learning Systems (thanks to EPSRC and 20+ industry partners), creating a space for ML scientists, system researchers, and chip designers to drive innovative co-designs across the ML system stack!

Our system ServerlessLLM got accepted into #OSDI24! This system features a new LLM checkpoint format, multi-tier LLM loader, inference live migration, and more! This work is led by Yao Fu. Joint with Leyang, Yeqi, Andrei, Dmitrii Ustiugov, and Yuvraj. Congratulations on the team!

A great team effort by fantastic people, and thanks a lot to the support from our colleagues at Edinburgh which provides rich GPU resources (EIDF) and collaborative research environments (ICSA & Informatics). School of Informatics, The University of Edinburgh ICSA@InformaticsEdinburgh EPCC

RIP Ross Anderson, one of the world's great security engineering researchers and teachers. I still find it hard to take it in. Ross was just giving 2 fabulous seminars last Wednesday at Edinburgh.

Unexpected to see our OSDI’24 work, ServerlessLLM, on the second slide of the serverless workshop keynote by Haibo Chen *months* before the conference. The pace of LLM research 🏄‍♂️ Luo Mai #vhive #serverless EuroSys 2023

Join us in Edinburgh to collaboratively shape the future of efficient generative AI. We have curated an exceptional lineup of speakers and talented PhD students, covering the entire spectrum of GenAI systems. Edinburgh is a wonderful city to visit this season too!

Our work on #Tenplex was accepted at ACM SIGOPS #SOSP24. Tenplex shows how to speed up ML training jobs by reconfiguring their multi-dimensional parallelism when GPU resources change. Congrats to Marcel Wagenländer Guo Bo Zhao Luo Mai. LSDS Research Group Imperial Computing I-X

I am deeply honoured to receive this prestigious grant to explore new performance simulation software for AI models, chips and clusters. With this, we can build a critical mass (over 30 researchers from Imperial, Edinburgh and Cambridge) to boost AI's efficiency by 1000X.

The Database Group at Edinburgh University’s School of Informatics is hiring a Lecturer (Assistant Professor) or Reader (Associate Professor) in Databases for AI and Data Science. Apply by 14 February 2025. Details: elxw.fa.em3.oraclecloud.com/hcmUI/Candidat… CS Faculty Jobs

Excited to see growing impact and mentioning of our recent work: enabling wafer-scale AI, running the entire LLM using on chip memory and achieving orders of magnitude efficiency gain!

"AI Goes Serverless: Are Systems Ready?" -- New SIGOPS Blog by Yao Fu, Luo Mai (Luo Mai) from The University of Edinburgh, and Dmitrii Ustiugov (Dmitrii Ustiugov) from NTU Singapore. sigops.org/2025/ai-goes-s…

Thanks to Dong Du and Tianyin Xu for helping us edit the blog. We are excited to build a community effort to achieve a more affordable AI infrastructure through AI-specific serverless compute.