🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

Baseten launches Mistral 7B API with leading performance 🚀 Baseten has entered the arena with their first serverless LLM offering of Mistral 7B Instruct. Artificial Analysis are measuring 170 tokens per second, the fastest of any provider, and 0.1s latency (TTFT) in-line

Another first 🎉 Unlock the power of NVIDIA's Multi-Instance GPU (MIG) virtualization technology with H100mig GPUs on Baseten: baseten.co/changelog/frac…

Deploy Mixtral 8x22B in one click! Mixtral fast facts: - #1 pretrained model on the Open LLM leaderboard - Mixture of Experts architecture - Apache 2.0 license - Uses 4 A100s in fp16, optimized implementations coming soon! baseten.co/library/mixtra…

We’re excited to launch Meta’s Llama 3 in our model library, in both 8B and 70B 🎉 The newly introduced Llama 3 is a significant improvement over Llama 2, with increased tokens, and reduced false refusal rates. These models deliver unparalleled performance, showcasing

News: Max Altman has launched a VC firm, Saga Ventures, with ex-Flexport exec Ben Braverman and 2x founder Thomson Nguyen. Altman, the third bro with Sam and Jack, tells Forbes he wants to back startups building for "every American," not other techies. forbes.com/sites/alexkonr…

Great people, great fund. One to watch!

Developers need a way to call LLMs and get 100% guaranteed output structure without extra latency. Today, we’re launching two new features within our TensorRT-LLM engine builder to address this need: structured output and function calling! 🎉

🔥 We have two huge announcements today! 🔥 We’re thrilled to announce early access to our new Baseten Hybrid offering and our launch on the Google Cloud Marketplace! Links to the announcement blogs and waitlist for Hybrid in the comments below 👇 With Baseten Hybrid, you have

Google Cloud Google Cloud Marketplace Announcement: baseten.co/blog/baseten-p…

Last week concluded our latest company-wide offsite in beautiful Cape Cod. 🌳 From over a dozen hackathon projects (that you'll soon see as full-blown features 👀) to a talent show and more, we're so impressed by everyone who makes Baseten such a wonderful place to work! 💚

🚀 We’re excited to introduce our Speculative Decoding integration for our TensorRT-LLM Engine Builder! Our new integration allows engineers to: • Leverage SpecDec as part of our Engine Builder flow • Hit the ground running with pre-optimized configs • Lift the hood and

AI is so powerful. You can create anything. I built my own OpenAI on Baseten using DeepSeek 🤯 Here's what I learned about b2b SaaS 👇

DeepSeek-R1 is blowing up right now, but we're not surprised. And not just because we’ve been working closely with DeepSeek to bring these models to production. We've been betting on powerful, open-source models like DeepSeek-R1 from day one. 1/n 🧵

Introducing FUZZ — a generative music model like no other. Personalized, full-length, high-quality, and infinite. We’re making this instrument free for as long as our GPUs survive. The best of FUZZ in thread.

It's been a wild couple of years. Thanks to all our customers who partnered with us as they bring their AI products to market. It feels like we're at the precipice of something bigger. We've raised some more capital. This isn't the important part of the company or the journey.

Nobody knows what inference means but it's provocative

🚀 Our "technical" marketer might not be looped in, but today is our biggest launch day yet. We're introducing two new products to serve the inference lifecycle: Model APIs and Training. Model APIs are frontier models running on the Baseten Inference Stack, purpose-built for

let there be inference

incredible technology!

Most AI products fail in the first month. Not bad AI. Bad prompts. Teams at Discord, McKinsey, Salesforce, DoorDash, Reforge, and over 100K+ developers using us know why: Teams wing their prompts – test on 5 examples, ship to millions, pray it works. Today changes everything.