🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

The Mistral team at it again with Magistral! GRPO with edits: 1. Removed KL Divergence 2. Normalize by total length (Dr. GRPO style) 3. Minibatch normalization for advantages 4. Relaxing trust region Paper: mistral.ai/static/researc… Docs to run Magistral: docs.unsloth.ai/basics/magistr…

Unsloth released optimised GGUFs for llama.cpp, LMStudio and Ollama as well 💥 Love the sheer execution speed of the community! 🤗 huggingface.co/unsloth/Magist…

Wow! Unsloth AI on the Nasdaq tower!🦥Thank you Redpoint for naming Unsloth one of the top 100 most impactful and fastest-growing infra companies in their 2025 report And it’s all thanks to you - the community! We truly appreciate it and couldn’t have done it without you all🥰

Get 2x faster for reward model serving and sequence classification inference through Unsloth AI! Nice benchmarks Kyle!

I'll be giving a talk on the 'Future of Reinforcement Learning and Training' at AMD's 2025 Advancing AI event today! 👋 See you all at 2:25pm PT in Room 230A-C. Excited to chat and meet!

This is just me unapologetically nerd crushing on the Unsloth AI duo, legendary developers with a shared goal of democratizing AI compute:

New tutorial: how to build a synthetic dataset with recent information and use it to fine tune with Unsloth AI Check out the collab: colab.research.google.com/drive/1JK04IBE… Steps in the 🧵

Managed to mostly fix Mistral 3.2 tool calling for GGUF / transformers! 1. 3.2 tool calling is different from 3.1 2. timedelta(days=1) (yesterday) changed with a if-else - supports 2024 to 2028 dates - so now word for word same sys prompt! 3. Made experimental FP8 quant as well!

We need r/LocalLlama back :( Hopefully a good neutral moderator takes the reins asap!

r/LocalLlama is back!! reddit.com/r/LocalLLaMA/c…

Excited to see you all tomorrow for our Google Gemma & Unsloth developer meetup! 🦥 We'll be having @Grmcameron from Artificial Analysis and 👩‍💻 Paige Bailey & more amazing talks! Location has been updated so please check & if you need help please DM me! lu.ma/gemma-unsloth

💎 Celebrating the official release of Gemma 3n with the inaugural Gemma Community meetup at Google San Francisco, cohosted with @Unsloth! Great presentations from the Unsloth founders on agents, the Gemma team on architectural internals, and how to craft effective evals.

Huge thanks to everyone who attended our Google & Unsloth AI Gemma developer meetup yesterday! 🦥 Was amazing meeting you all & thank you to Taka Shinagawa for hosting the event with us. Thank you to the Google speakers: 👩‍💻 Paige Bailey, Doug Reid, Mayank Chaturvedi, @GrmCameron and of

Gemma 3N quirks! 1. Vision NaNs on float16 2. Conv2D weights are large FP16 overflows to infinity 3. Large activations fixed vs Gemma 3 4. 6-7 training losses: normal for multimodal? 5. Large nums in msfa_ffn_pw_proj 6. NaNs fixed in Unsloth AI Details: docs.unsloth.ai/basics/gemma-3…

🦥 Fine-tuning with Unsloth AI now supports Gemma 3n! ✨ Friendly reminder: the Gemma 3n models can understand not just text and code, but also images, audio, video, and a whole lot more.

You can utilize our Gemma 3n multimodal and fine-tuning Kaggle notebook for any submission to the $150,000 challenge! The $10,000 is specifically for the Unsloth track - but you can submit it for the main track as well! Kaggle notebook: kaggle.com/code/danielhan…