🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

Sustainability Research the Cloud Native Way - Chen Wang, IBM & Huamin Chen, Red Hat at KubeCon + CloudNative North America 2022 sched.co/182JN Sched project_kepler

Sustainability the Container Native Way - Huamin Chen, Red Hat & Chen Wang, IBM at Open Source Summit North America 2022 sched.co/11Nql #ossummit

Thank you everyone for showing up for the talk. The slides are published here. github.com/sustainable-co… #kubeconNA #sustainability_io

Let’s talk sustainability in computing! #kubeconNA #CNCF #Sustainability

Super excited to present our work “SIMPPO: A Scalable and Incremental Online Learning Framework for Serverless Resource Management” today at #SoCC22. Following our previous work FIRM (#OSDI20), SIMPPO makes one more step to pave the way for applying ML/RL in production systems.

SIMPPO provides system supports that allow multiple learning-based agents to co-exist with each other in a multi-tenant platform. SIMPPO addresses the scalability and incremental training challenge through the design of the virtual agent and the application of mean-field theory.

Curious about power consumption with your #kubernetes workloads? Check out Kepler (Kubernetes-based Efficient Power Level Exporter) and ping Huamin Chen and the Kepler team with your ideas. sustainable-computing.io

I'm excited to speak with Huamin Chen about "5 Steps to Deploy Cloud Native Sustainable Foundation AI Models" at Open Source Summit North America 2023 sched.co/1K5Bz #OSSUMMIT Sched

I'm excited to talk about "Optimizing Full-Stack Sustainability in a Real World Data Center: Practices and Lessons Learned" with Hua Ye & Fan Jing Meng, IBM at Open Source Summit North America 2023 sched.co/1K58A #OSSUMMIT Sched #Sustainability

RL has been actively proposed and applied to numerous systems management tasks (e.g., scheduling, resource management, congestion control...). However, it suffers practical issues when moving to production systems. At #atc2023, we shared our experience in RL-based autoscaling.

#CFP: 9th Workshop on Container Technologies and Container Clouds (WoC'23) will be held with Middleware 2023 in Bologna, Italy! Submit by 09-25-2023 at woc23.hotcrp.com. Check more at sites.google.com/view/woc23/home. #WoC2023, #Middleware2023.

The Acto team is ready for their SOSP Conference presentation! Tyler(Jiawei) Gu practiced the talk at splash Systems Reading group. Acto is a "push-button" e2e testing tool for #Kubernetes operators. It has found 50+ bugs in many #K8s #Operators. Checkout: tianyin.github.io/pub/acto.pdf

#acto Fantastic work by a great group. I believe in the future the automated E2E testing tool together with llm generated operator code can further free developers from admin’s job.

LMCache: Turboboosting vLLM with 7x faster access to 100x more KV caches lmcache.github.io/2024-09-17-rel…

🎥 New LMCache Intro+Demo video is out! 🚀 Watch how LMCache speeds up #vLLM in document QA! By accessing KV caches 7x faster, it cuts time-to-first-token to under 4 seconds! Check out the video now! 📷 youtube.com/watch?v=rINy7m… #LLM #LMCache #vLLM #RAG #KVCaches

Exciting news! Meet Kuntai Du, a key contributor to #LMCache, at #RaySummit! Don’t miss the chance to chat with him in person about the latest updates!

I'm excited to attend 🪧 Poster Session (PS01): Climatik: Cloud Native Sustainable LLM via Power Capping - Chen Wang, IBM & Vincent Hou, Bloomberg L.P. at KubeCon + CloudNativeCon North America 2024 sched.co/1i7mv Sched

🚀 We're thrilled to announce vLLM Production Stack—an open-source, Enterprise-Grade LLM inference solution that is now an official first-party ecosystem project under vLLM! Why does this matter? A handful of companies focus on LLM training, but millions of apps and businesses

See a comment that I cannot agree more. “Innovation thrives when great minds come together.”