
Prolific
@prolific
The ultimate human data platform to power world-changing AI and research. For help 👉 researcher-help.prolific.com / participant-help.prolific.com
ID: 2450416195
http://prolific.com 17-04-2014 20:49:53
7,7K Tweet
12,12K Followers
1,1K Following


LLMs like ChatGPT are making it harder for AI model builders to distinguish authentic human responses. Prolific CEO Phelim Bradley and VP of Product Sara Saab talk about adapting to constant challenges as a human data platform that prioritizes data quality. Watch the chat and demo 👇

The rise of LLM leaderboards has led to a drop in reliability. Cohere Labs already identified systematic issues on Chatbot Arena. Join @Cohere’s Oliver Nan (a first author of “The Leaderboard Illusion”), University of Washington’s Hua Shen✨, and Prolific on July 22nd. Click to register ⬇️

At the AI Accelerator Institute Generative AI Summit in NYC, our VP of Product was on the panel with Morgan & Morgan and Wayfair.com discussing how leading companies are building practical, trustworthy AI with humans in the loop 🎤 Watch the full panel ⬇️ #NYTechWeek aiacceleratorinstitute.com/humans-in-the-…

One day to go 🚨 Join @Cohere’s Oliver Nan, University of Washington's Hua Shen✨, and Prolific’s Nora Petrova for “Why AI leaderboards miss the mark,” tomorrow @ 12:00 PM EDT. You'll improve your approach to LLM benchmarking and learn to measure model performance more reliably. Register now ⬇️


This is *the* paper to read this week. It covers an astonishing amount of ground on the persuasive capabilities of frontier AI - from scaling laws, to post-training, to the driving mechanisms of a persuasive advantage. Very proud of Kobi Hackenburg + the team at AI Security Institute!

Congratulations Kobi Hackenburg and team. Pleased to have supported the largest-ever study of AI persuasion with 76,977 taskers, with 19 LLMs deployed and 707 political issues evaluated on persuasiveness. Give this a read ⬇️

