🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

Feeling hard generating challenging evaluation data for LLMs? Check our work👇! Introducing LINK🔗, the first framework for systematically generating data in the long-tail distribution, guided by symbolic rules arxiv.org/abs/2311.07237 w/USC NLP MOSAIC 🧵⬇️ #NLProc [1/n]

Is a single accuracy number all we can get from model evals?🤔 🚨Does NOT tell where the model fails 🚨Does NOT tell how to improve it Introducing EvalTree🌳 🔍identifying LM weaknesses in natural language 🚀weaknesses serve as actionable guidance (paper&demo 🔗in🧵) [1/n]