Cloudthrill (@cloud_thrill) 's Twitter Profile
Cloudthrill

@cloud_thrill

Welcome to CloudThrill, a dynamic consulting firm specializing in cloud automation, inference & DevOps services. Founded and led by our passionate @clouddude_

ID: 1813973105200738304

linkhttp://www.cloudthrill.io calendar_today18-07-2024 16:24:45

94 Tweet

6 Followers

59 Following

Cloudthrill (@cloud_thrill) 's Twitter Profile Photo

๐Ÿง  ๐†๐๐“ ๐Œ๐จ๐๐ž๐ฅ๐ฌ ๐Ÿ๐จ๐ซ ๐๐ฎ๐ฆ๐ฆ๐ข๐ž๐ฌ #cheatsheet ๐Ÿค” If youโ€™ve opened #ChatGPT lately and thought: โ€œ๐–๐š๐ข๐ญโ€ฆ ๐ฐ๐ก๐š๐ญโ€™๐ฌ ๐จ๐Ÿ‘? ๐€๐ง๐ ๐ฐ๐ก๐ฒ ๐š๐ซ๐ž ๐ญ๐ก๐ž๐ซ๐ž ๐ฌ๐จ ๐ฆ๐š๐ง๐ฒ ๐ฆ๐จ๐๐ž๐ฅ๐ฌ ๐ง๐จ๐ฐ?โ€ Youโ€™re not alone. @openAI finally answered๐Ÿ™‹๐Ÿปโ€โ™€๏ธ ๐Ÿ‘‰๐Ÿปplatform.openai.com/docs/models/coโ€ฆ

๐Ÿง  ๐†๐๐“ ๐Œ๐จ๐๐ž๐ฅ๐ฌ ๐Ÿ๐จ๐ซ ๐๐ฎ๐ฆ๐ฆ๐ข๐ž๐ฌ #cheatsheet
๐Ÿค” If youโ€™ve opened #ChatGPT lately and thought:
 โ€œ๐–๐š๐ข๐ญโ€ฆ ๐ฐ๐ก๐š๐ญโ€™๐ฌ ๐จ๐Ÿ‘? ๐€๐ง๐ ๐ฐ๐ก๐ฒ ๐š๐ซ๐ž ๐ญ๐ก๐ž๐ซ๐ž ๐ฌ๐จ ๐ฆ๐š๐ง๐ฒ ๐ฆ๐จ๐๐ž๐ฅ๐ฌ ๐ง๐จ๐ฐ?โ€ Youโ€™re not alone. @openAI finally answered๐Ÿ™‹๐Ÿปโ€โ™€๏ธ
๐Ÿ‘‰๐Ÿปplatform.openai.com/docs/models/coโ€ฆ
Cloudthrill (@cloud_thrill) 's Twitter Profile Photo

๐Ÿ”ตMeta announced ๐Œ๐ž๐ญ๐š ๐€๐๐ˆ, SDKs with inference, eval/ tuning platform.. officially Joining API business ... #llama๐Ÿฆ™ But Size always matters according to Databricks CEO's Ali Ghodsi #AI #Inference #TokenCost #llamaCon

Cloudthrill (@cloud_thrill) 's Twitter Profile Photo

๐Ÿšจ#AI & #CyberSec heads in #Toronto! Join us on Wednesday, ๐Œ๐š๐ฒ ๐Ÿ•๐ญ๐ก from 5:30pm-8pm EST for another exciting #TAICO Meetup (Toronto AI and Cybersecurity Organization) #Cloudthrill #ProudSponsor๐Ÿ”ฅ meetup.com/taico-toronto-โ€ฆ

๐Ÿšจ#AI & #CyberSec heads in #Toronto! 
Join us on Wednesday, ๐Œ๐š๐ฒ ๐Ÿ•๐ญ๐ก from 5:30pm-8pm EST for another exciting  #TAICO Meetup (Toronto AI and Cybersecurity Organization)
#Cloudthrill #ProudSponsor๐Ÿ”ฅ
meetup.com/taico-toronto-โ€ฆ
Cloudthrill (@cloud_thrill) 's Twitter Profile Photo

๐Ÿšจ@CloudThrill is excited to announce its membership in the NVIDIA Inception Program! ๐Ÿ‘๐Ÿป๐Ÿ‘๐Ÿป๐Ÿ‘๐Ÿป Read full statement: cloudthrill.ca/cloudthrill-joโ€ฆ #NVIDIAInception Program for Startups!

๐Ÿšจ@CloudThrill is excited to announce its membership in the NVIDIA Inception Program! ๐Ÿ‘๐Ÿป๐Ÿ‘๐Ÿป๐Ÿ‘๐Ÿป 
Read full statement: cloudthrill.ca/cloudthrill-joโ€ฆ 
 #NVIDIAInception Program for Startups!
Cloudthrill (@cloud_thrill) 's Twitter Profile Photo

๐Ÿš€ #NewBlogAlert ๐Ÿ›ก๏ธ HashiCorp #Vault Weโ€™re kicking off our ๐•๐š๐ฎ๐ฅ๐ญ ๐Ÿ๐จ๐ซ ๐ƒ๐ฎ๐ฆ๐ฆ๐ข๐ž๐ฌ ๐ฌ๐ž๐ซ๐ข๐ž๐ฌ with ๐๐š๐ซ๐ญ ๐Ÿ:๐Ÿ” ๐‡๐จ๐ฐ ๐ญ๐จ ๐’๐ž๐ญ ๐”๐ฉ ๐‡๐š๐ฌ๐ก๐ข๐‚๐จ๐ซ๐ฉ ๐•๐š๐ฎ๐ฅ๐ญ + ๐‘๐š๐Ÿ๐ญ & ๐“๐‹๐’ ๐Ÿ‘‰check it out: tinyurl.com/HashiVault-forโ€ฆ โœ๏ธwrote by clouddud๐Ÿ‘‹๐Ÿป

๐Ÿš€ #NewBlogAlert ๐Ÿ›ก๏ธ <a href="/HashiCorp/">HashiCorp</a> #Vault
 Weโ€™re kicking off our ๐•๐š๐ฎ๐ฅ๐ญ ๐Ÿ๐จ๐ซ ๐ƒ๐ฎ๐ฆ๐ฆ๐ข๐ž๐ฌ ๐ฌ๐ž๐ซ๐ข๐ž๐ฌ with ๐๐š๐ซ๐ญ ๐Ÿ:๐Ÿ” ๐‡๐จ๐ฐ ๐ญ๐จ ๐’๐ž๐ญ ๐”๐ฉ ๐‡๐š๐ฌ๐ก๐ข๐‚๐จ๐ซ๐ฉ ๐•๐š๐ฎ๐ฅ๐ญ + ๐‘๐š๐Ÿ๐ญ &amp; ๐“๐‹๐’  
๐Ÿ‘‰check it out: tinyurl.com/HashiVault-forโ€ฆ โœ๏ธwrote by <a href="/clouddud/">clouddud</a>๐Ÿ‘‹๐Ÿป
Cloudthrill (@cloud_thrill) 's Twitter Profile Photo

Red Hat Launches the #llm-d Community, Powering Distributed Gen AI Inference at Scale based in vLLM ๐Ÿ‘€ businesswire.com/news/home/2025โ€ฆ

Kosseila (CloudDude) โ˜๏ธ๐Ÿ“ก๐Ÿ‰ (@clouddude_) 's Twitter Profile Photo

#NewBlog ๐Š๐• ๐—–๐—ฎ๐—ฐ๐—ต๐—ฒ ๐—˜๐˜…๐—ฝ๐—น๐—ฎ๐—ถ๐—ป๐—ฒ๐—ฑ:ย like I'm 5๐Ÿ˜Ž ๐Ÿง Ever wondered what #KVCache really is in LLM inference? Forget the math-heavy blablaโ€”this one's made to click ! ๐Ÿ‘‰check it out: cloudthrill.ca/kv_cache-explaโ€ฆ Cloudthrill #vLLM #AIInfra LMCache Lab

Cloudthrill (@cloud_thrill) 's Twitter Profile Photo

๐Ÿง Ever hear about RoPE in LLMs? RoPE improves inference by encoding token positions smartly. While NoRoPE offers simplicity and speed. Your choice depends on how much positional nuance your task requires. Here's the quick breakdown โฌ‡๏ธ #RoPE vs #NoRoPE

๐Ÿง Ever hear about RoPE in LLMs? 

RoPE improves inference by encoding token positions smartly. While NoRoPE offers simplicity and speed. Your choice depends on how much positional nuance your task requires. Here's the quick breakdown โฌ‡๏ธ
#RoPE vs #NoRoPE
Kosseila (CloudDude) โ˜๏ธ๐Ÿ“ก๐Ÿ‰ (@clouddude_) 's Twitter Profile Photo

Live Keynote from AMD CEO Lisa Su โ˜‘๏ธOver 25 AI acquisitions & investment last year... โ˜‘๏ธ7 out 10 AI model builders now use AMD. โ˜‘๏ธ Guest from X.ai says AMD GPU are effortless Will they improve ROCm user experience (drivers)? we'll see #AdvancingAI2025

Live Keynote from <a href="/AMD/">AMD</a> CEO <a href="/LisaSu/">Lisa Su</a> 
โ˜‘๏ธOver 25 AI acquisitions &amp; investment last year... 
โ˜‘๏ธ7 out 10 AI model builders now use AMD. 
โ˜‘๏ธ Guest  from X.ai says AMD GPU are effortless
Will they improve ROCm user experience (drivers)? we'll see 
#AdvancingAI2025
Cloudthrill (@cloud_thrill) 's Twitter Profile Photo

๐Ÿ’ŽWhat makes vLLM the Rolls Royce of inference? ๐Ÿ‘‡๐Ÿป We break it down in 5 performance-packed layers๐Ÿ˜Ž โœ… PagedAttention, Prefix Caching, Chunked Prefill โœ… Continuous Batching, Speculative Decoding โœ… Flash Attention, FlashInfer โœ… Tensor/data & Pipeline Parallelism

Cloudthrill (@cloud_thrill) 's Twitter Profile Photo

Want to finally get ๐ช๐ฎ๐š๐ง๐ญ๐ข๐ณ๐š๐ญ๐ข๐จ๐ง? vLLM vs Llama.cpp? Catch the replay of this dope stream with Colin Kealty & Eldar Kurtiฤ‡ โ€” we break it all down: โš”๏ธ GGUF GPTQ AWQ Tradeoffs ๐Ÿ“Š Benchmarks/evals/edge AI ๐Ÿง  When to use what... The Future ๐Ÿ˜ฑ ๐Ÿ”ด Watch the replay ๐Ÿ‘‡๐Ÿผ