
Cloudthrill
@cloud_thrill
Welcome to CloudThrill, a dynamic consulting firm specializing in cloud automation, inference & DevOps services. Founded and led by our passionate @clouddude_
ID: 1813973105200738304
http://www.cloudthrill.io 18-07-2024 16:24:45
94 Tweet
6 Followers
59 Following



๐ง ๐๐๐ ๐๐จ๐๐๐ฅ๐ฌ ๐๐จ๐ซ ๐๐ฎ๐ฆ๐ฆ๐ข๐๐ฌ #cheatsheet ๐ค If youโve opened #ChatGPT lately and thought: โ๐๐๐ข๐ญโฆ ๐ฐ๐ก๐๐ญโ๐ฌ ๐จ๐? ๐๐ง๐ ๐ฐ๐ก๐ฒ ๐๐ซ๐ ๐ญ๐ก๐๐ซ๐ ๐ฌ๐จ ๐ฆ๐๐ง๐ฒ ๐ฆ๐จ๐๐๐ฅ๐ฌ ๐ง๐จ๐ฐ?โ Youโre not alone. @openAI finally answered๐๐ปโโ๏ธ ๐๐ปplatform.openai.com/docs/models/coโฆ




๐ตMeta announced ๐๐๐ญ๐ ๐๐๐, SDKs with inference, eval/ tuning platform.. officially Joining API business ... #llama๐ฆ But Size always matters according to Databricks CEO's Ali Ghodsi #AI #Inference #TokenCost #llamaCon




๐ #NewBlogAlert ๐ก๏ธ HashiCorp #Vault Weโre kicking off our ๐๐๐ฎ๐ฅ๐ญ ๐๐จ๐ซ ๐๐ฎ๐ฆ๐ฆ๐ข๐๐ฌ ๐ฌ๐๐ซ๐ข๐๐ฌ with ๐๐๐ซ๐ญ ๐:๐ ๐๐จ๐ฐ ๐ญ๐จ ๐๐๐ญ ๐๐ฉ ๐๐๐ฌ๐ก๐ข๐๐จ๐ซ๐ฉ ๐๐๐ฎ๐ฅ๐ญ + ๐๐๐๐ญ & ๐๐๐ ๐check it out: tinyurl.com/HashiVault-forโฆ โ๏ธwrote by clouddud๐๐ป




#NewBlog ๐๐ ๐๐ฎ๐ฐ๐ต๐ฒ ๐๐ ๐ฝ๐น๐ฎ๐ถ๐ป๐ฒ๐ฑ:ย like I'm 5๐ ๐ง Ever wondered what #KVCache really is in LLM inference? Forget the math-heavy blablaโthis one's made to click ! ๐check it out: cloudthrill.ca/kv_cache-explaโฆ Cloudthrill #vLLM #AIInfra LMCache Lab






Want to finally get ๐ช๐ฎ๐๐ง๐ญ๐ข๐ณ๐๐ญ๐ข๐จ๐ง? vLLM vs Llama.cpp? Catch the replay of this dope stream with Colin Kealty & Eldar Kurtiฤ โ we break it all down: โ๏ธ GGUF GPTQ AWQ Tradeoffs ๐ Benchmarks/evals/edge AI ๐ง When to use what... The Future ๐ฑ ๐ด Watch the replay ๐๐ผ
