Context.ai (@getcontextai) 's Twitter Profile
Context.ai

@getcontextai

Context.ai is the product analytics platform for chat interfaces

ID: 1654213351809986563

linkhttps://context.ai calendar_today04-05-2023 19:56:18

153 Tweet

132 Followers

20 Following

Henry Scott-Green (@henrysg) 's Twitter Profile Photo

Context.ai is now integrated with Haystack by deepset ! 🚢 This provides developers using Haystack with product analytics to monitor the performance of their LLM product with real users blog.context.ai/context-ai-is-…

Context.ai is now integrated with Haystack by <a href="/deepset_ai/">deepset</a> ! 🚢

This provides developers using Haystack with product analytics to monitor the performance of their LLM product with real users

blog.context.ai/context-ai-is-…
Haystack (@haystack_ai) 's Twitter Profile Photo

ICYMI, here are your Haystack updates for the week. 🛠️ up first, integrations: - Milvus is now supported in Haystack 2.0: haystack.deepset.ai/integrations/m… - New Context.ai integration shows analytics about how your Haystack pipelines are being used : Context.ai -

ICYMI, here are your Haystack updates for the week.

🛠️ up first, integrations:
- <a href="/milvusio/">Milvus</a> is now supported in Haystack 2.0: haystack.deepset.ai/integrations/m… 
- New <a href="/getcontextai/">Context.ai</a> integration shows analytics about how your Haystack pipelines are being used : Context.ai
-
Henry Scott-Green (@henrysg) 's Twitter Profile Photo

What did we ship in March? 🚢 Lots of improvements to evals! We now allow users to repeat LLM generations and evaluations to get more certainty in evaluation results, we version our custom evaluators, we’ve improved support for large test sets and added search, we now support

Henry Scott-Green (@henrysg) 's Twitter Profile Photo

Today we’re launching the ecosystem’s best support for evaluating multi-call chains 🔎⛓️ This allows you to evaluate multi-stage workflows with many calls to LLMs and functions using Context.ai, and you can evaluate these both end-to-end and across any stage of the

Today we’re launching the ecosystem’s best support for evaluating multi-call chains 🔎⛓️

This allows you to evaluate multi-stage workflows with many calls to LLMs and functions using Context.ai, and you can evaluate these both end-to-end and across any stage of the
Henry Scott-Green (@henrysg) 's Twitter Profile Photo

We now support self-hosted deployment! Desperate to understand how people are using your LLM product, but don’t want to share your transcripts with a third party for analysis?  Good news! You can now run the Context.ai product within your own cloud instance

Henry Scott-Green (@henrysg) 's Twitter Profile Photo

How to ship amazing LLM products (without getting fired when they go wrong): Building LLM products requires threading a needle. Product people trade off iteration speed, product quality, and safety risks - and the best PMs know how to do it 🧵🪡

Henry Scott-Green (@henrysg) 's Twitter Profile Photo

How do the best tech companies find product market fit for their LLM products? 🔎 🎯 It starts with deeply understanding their users 💬🔬 Yet many people building in the LLM ecosystem still don’t know how or why people use their products.

Henry Scott-Green (@henrysg) 's Twitter Profile Photo

LLMs haven’t significantly improved since GPT4: is progress slowing? 🐢 Dramatically more powerful model training clusters are being built: 15 of them, with 31 times more power than trained GPT4 This means models much more powerful than GPT4 are coming 🐇

LLMs haven’t significantly improved since GPT4: is progress slowing? 🐢

Dramatically more powerful model training clusters are being built: 15 of them, with 31 times more power than trained GPT4

This means models much more powerful than GPT4 are coming  🐇
Henry Scott-Green (@henrysg) 's Twitter Profile Photo

How do you know if the guardrails on your LLM product are working? 🛡️🎯 Some people wait until they show up in the The New York Times - like McDonald's, Air Canada, or Chevrolet

How do you know if the guardrails on your LLM product are working? 🛡️🎯

Some people wait until they show up in the The New York Times - like McDonald's, Air Canada, or Chevrolet
Henry Scott-Green (@henrysg) 's Twitter Profile Photo

People should be talking about the Retool State of AI Report 💼 It contains a ton of data on LLM adoption in businesses - just like last year 📊 My takeaways:

People should be talking about the Retool State of AI Report 💼

It contains a ton of data on LLM adoption in businesses - just like last year 📊

My takeaways:
Henry Scott-Green (@henrysg) 's Twitter Profile Photo

What products are enabled by multi-agent frameworks? 🤖👥🤖👥 Everyone is excited about multi-agent frameworks - even though their performance isn’t quite ready for prime-time. Much has been written about the frameworks and how they work - but the product layer is

Henry Scott-Green (@henrysg) 's Twitter Profile Photo

Today we’re launching a totally new product: ✨Podial✨ Podial generates engaging educational podcasts on any topic and from any documents This is completely new for us! And it’s our first consumer product!! So why are we doing it?

Today we’re launching a totally new product: ✨Podial✨ 

Podial generates engaging educational podcasts on any topic and from any documents 

This is completely new for us! And it’s our first consumer product!! So why are we doing it?
Henry Scott-Green (@henrysg) 's Twitter Profile Photo

It’s been a big first week for Podial!! 🎙️ We've had thousands of signups, we got our first paying customers, we won education product of the week on Product Hunt, and we’ve listened to a ton of incredible generated podcasts We’ve also made the product much better:

Henry Scott-Green (@henrysg) 's Twitter Profile Photo

We’ve been working something fun - Hype Squad It generates a podcast hype squad (or roast) from your LinkedIn It hypes you up and crafts a story that explains your success Or it roasts - poking holes and making fun. It doesn't hold back Listen to mine podial.ai/hype

Henry Scott-Green (@henrysg) 's Twitter Profile Photo

Big update: the @GetContextAI team is joining OpenAI to build the future of evals! It's clear that evals are a key requirement to building high performing AI applications - but they’re hard to get right. We are thrilled to be joining the incredible OpenAI team to build the

Big update: the @GetContextAI team is joining <a href="/OpenAI/">OpenAI</a> to build the future of evals!

It's clear that evals are a key requirement to building high performing AI applications - but they’re hard to get right. 

We are thrilled to be joining the incredible OpenAI team to build the