Nika Zahedi (@zahedinika) 's Twitter Profile
Nika Zahedi

@zahedinika

ID: 1542351566786666496

calendar_today30-06-2022 03:37:48

1 Tweet

2 Followers

8 Following

Rylan Schaeffer (@rylanschaeffer) 's Twitter Profile Photo
Rylan Schaeffer
@rylanschaeffer

2 years ago

Excited to announce new preprint led by Minhao Jiang Ken Liu @IllinoisCS Stanford AI Lab !! Q: What happens when language models are pretrained on data contaminated w/ benchmarks, ratcheting up amount of contamination? A: LMs do better, but curves can be U-shaped! 1/2

Excited to announce new preprint led by <a href="/minhaoj_uiuc/">Minhao Jiang</a> <a href="/kenziyuliu/">Ken Liu</a> @IllinoisCS <a href="/StanfordAILab/">Stanford AI Lab</a> !! Q: What happens when language models are pretrained on data contaminated w/ benchmarks, ratcheting up amount of contamination? A: LMs do better, but curves can be U-shaped! 1/2