Shuangping Li (@shuangpingli) 's Twitter Profile
Shuangping Li

@shuangpingli

Stein Fellow @Stanford stats.
PhD from @Princeton PACM.

ID: 1834021541061033984

linkhttps://fifalsp.github.io/ calendar_today12-09-2024 00:09:53

1 Tweet

17 Followers

26 Following

Zitong Yang (@zitongyang0) 's Twitter Profile Photo
Zitong Yang
@zitongyang0

a year ago

Grab your favorite preprint of the week: how can you put its knowledge in your LM’s parameters? Continued pretraining (CPT) works well with >10B tokens, but the preprint is <10K. Synthetic CPT downscales CPT to such small, targeted domains. 📜: arxiv.org/abs/2409.07431 🧵👇

Grab your favorite preprint of the week: how can you put its knowledge in your LM’s parameters? Continued pretraining (CPT) works well with &gt;10B tokens, but the preprint is &lt;10K. Synthetic CPT downscales CPT to such small, targeted domains. 📜: arxiv.org/abs/2409.07431 🧵👇