🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

Haha, surprise!

Interested in LLM-based Code Translation 🧐? Check our CodeLingua leaderboard (codetlingua.github.io/leaderboard.ht…). We have updated the leaderboard with newly released Granite code LLMs from IBM Research. Granite models outperform Claude-3 and GPT-4 in C -> C++ translation 🔥.

Thanks for the highlight AK! We offer a simple and nearly-data-free way to move (large quantities) of custom PEFT models within or across LLM families or even across PEFT configurations. Useful for LLM cloud hosting when old base models need to be deprecated & upgraded

Thanks for posting our work! (1/5) After running thousands of experiments with the WSD learning rate scheduler and μTransfer, we found that the optimal learning rate strongly correlates with the batch size and the number of tokens.

Attending the PyTorch Conference? There's several talks and posters on Distributed Training. Folks from IBM, Meta, Databricks and more explore distributed LLM training with native PyTorch components and libraries! Come join us in September for the following talks! 🧵 [1/6]

tfw I am the sole technical person at a reception full of business people.

Four fingers, five toes.

My daughter hit me yesterday, completely out of the blue, with a detailed and thoroughly researched presentation entitled "Why I should learn to play the harp"

Today, IBM and Ollama announces partnership to bring Granite 3.0 models! 😍 2 architectures: Dense: 2B: ollama run granite3-dense 8B: ollama run granite3-dense:8b Mixture of Experts: 1B: ollama run granite3-moe 3B: ollama run granite3-moe:3b Blog post:

I had the chance to dive deep into the new models coming out from IBM with its introduction of Granite 3.0. Upon initial review, the work that is being done by IBM is at the leading edge of what can be done for smaller language models being utilized for generative AI solutions.

We've partnered with IBM to bring the new Granite 3.0 language models to Replicate. These models are trained on license-permissible data collected following IBM’s AI Ethics principles for trustworthy enterprise usage. Best of all, they're fully open-source and Apache 2.0

🚀 Introducing IBM Granite 3.0 models on the 🤗 Open LLM Leaderboard! Granite 3.0 is IBM’s newest suite of lightweight, multilingual, and versatile open foundation models designed for enterprise and customization. These models excel in coding, reasoning, and tool usage,

Stick-Breaking Attention: Out-of-box length extrapolation, thanks to removing the position embedding; Better performance than Softmax+RoPE on almost every task; Similar efficient implementation like Flash Attention. Do we still need Softmax+RoPE for Language Models?

New top ASR model on the Open ASR Leaderboard! We've just added IBM Granite-Speech-3.3-8b and 2b to the leaderboard! Open weights and top scores across benchmarks.