
Nika Zahedi
@zahedinika
ID: 1542351566786666496
30-06-2022 03:37:48
1 Tweet
2 Followers
8 Following

Excited to announce new preprint led by Minhao Jiang Ken Liu @IllinoisCS Stanford AI Lab !! Q: What happens when language models are pretrained on data contaminated w/ benchmarks, ratcheting up amount of contamination? A: LMs do better, but curves can be U-shaped! 1/2
