🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

Two exciting updates! * vLLM is already widely adopted, and we want to ensure it has open governance and longevity. We are starting to join LF AI & Data Foundation! * We are doubling down in performance. Please checkout our roadmap. blog.vllm.ai/2024/07/25/lfa…

People aren't going to be able to read or listen to 200 tokens per second. Aggregate server-side token generation throughput is nice, but for interactive token streaming services, we need to think about Quality-of-Experience. More: llm-qoe.github.io

SOSP'24 Poster Program Committee is excited to invite submissions! Present your early-stage work, get feedback, and network with fellow researchers! 📅 Deadline: Sep 20 AOE. Student posters are encouraged, but all are welcome! Details: sigops.org/s/conferences/… #SOSP2024 #ACMSIGOPS

🚨 CSE is hiring faculty! 🚨 Join a top 10 program where you can shape the future through the power of computing. Applicants for tenure-track positions are encouraged to apply by November 15. #UMCSE #UMich ▶️ Learn more and apply: cse.engin.umich.edu/about/faculty-…

On July 2023, we first launched the ML.ENERGY Leaderboard. Since then, we've been upgrading and expanding the leaderboard & benchmark. After nearly two years, we decided to share the design philosophies and lessons we've developed over time! arxiv.org/abs/2505.06371

Ask Siri: DON’T tell me the weather. It never fails to tell you the weather.