🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

Announcing Pig Windows Desktops for Agents

We’re releasing Humanity’s Last Exam, a dataset with 3,000 questions developed with hundreds of subject matter experts to capture the human frontier of knowledge and reasoning. State-of-the-art AIs get <10% accuracy and are highly overconfident. pak.ai Scale.ai

Anyone who grew up in San Francisco remembers going to Union Square for holiday shopping or seeing the tourists lining up for the Cable Car. This was the face of our city, and we were proud of it. I want our kids to feel that same sense of pride. Downtown’s public safety

Introducing the AI Guardrails Index—the most comprehensive evaluation of LLM guardrails. Built on open-source data and code for reproducibility, this index reveals key findings on PII, jailbreaking, and more. Check it out! go.guardrailsai.com/index

Benchmarks are both difficult and important. Great to see these thoughtful, open reproducible benchmarks for LLM guardrails.

Be sure to take our survey!

Someone in the wild sent me this Cartesia team shipping mega-cracked models and infra to get these P99s globally

We've raised a $64M Series A led by Kleiner Perkins to build the platform for real-time voice AI. We'll use this funding to expand our team, and to build the next generation of models, infrastructure, and products for voice, starting with Sonic 2.0, available today. Link below

Announcing our Series A and new model updates. We're hiring!

🌟 A huge shoutout to the incredible women in AI! 🌟 We’ve been lucky to host some of the brightest minds in tech, and today, we’re taking a moment to celebrate their impact on AI and beyond.

🌺 shreya rajpal, founder of Guardrails AI, brought deep insights into AI safety and reliability, showing how to build LLM applications that are not just powerful but also trustworthy.

We're hiring a founder-in-residence at Vanta to build AI-first GTM! You'll transform how we support and attract customers while learning what works in AI-first enterprise GTM. This is a nine-month program for future founders, a combo of the USV analyst program and Y Combinator

🎙️ TRACK HOST SPOTLIGHT: swyx 🔜 @aiDotEngineer Jun 3-5 of the Latent Space Podcast is bringing his curation expertise to our AI Engineering track! Featuring... Tengyu Ma, CEO Voyage AI (part of MongoDB) shreya rajpal, CEO Guardrails AI Dhruv Singh, CTO HoneyHive Charles 🎉 Frye, Dev Advocate Modal Eno Reyes, CTO

O Krishna, I see my own relations here anxious to fight, and my limbs grow weak; my mouth is dry, my body shakes, and my hair is standing on end. My skin burns, and the bow Gandiva has slipped from my hand. I am unable to stand; my mind seems to be whirling. Garry Tan

LIVE: How do we measure AI reliability in healthcare? Join shreya rajpal at #Healthcare #NLPSummit to explore guardrails for AI safety, fairness & compliance! 🏥⚖️ #AISafety #ResponsibleAI

Lots of phones raised, taking pics of slides from this talk! 🤳 shreya rajpal (Co-Founder, CEO of Guardrails AI) shared a repeatable process for implementing metrics: 1️⃣ Check for standard implementation: e.g., is Regex / BLEU / BERTScore good enough? 2️⃣ Send 3-5 "gold" examples:

To support our work in analyzing AI’s economic impacts, we’re pleased to announce the formation of the Anthropic Economic Advisory Council. This group of distinguished economists will provide input on new areas of research for our Economic Index.