Joseph Shetaye (@jshetaye) 's Twitter Profile
Joseph Shetaye

@jshetaye

ID: 1472391654149664773

calendar_today19-12-2021 02:21:50

0 Tweet

3 Followers

16 Following

Jordan Juravsky (@jordanjuravsky) 's Twitter Profile Photo
Jordan Juravsky
@jordanjuravsky

3 months ago

Happy Throughput Thursday! We’re excited to release Tokasaurus: an LLM inference engine designed from the ground up for high-throughput workloads with large and small models. (Joint work with Ayush Chakravarthy, Ryan Ehrlich, Sabri Eyuboglu, Bradley Brown, Joseph Shetaye,

Happy Throughput Thursday! We’re excited to release Tokasaurus: an LLM inference engine designed from the ground up for high-throughput workloads with large and small models. (Joint work with <a href="/achakravarthy01/">Ayush Chakravarthy</a>, <a href="/ryansehrlich/">Ryan Ehrlich</a>, <a href="/EyubogluSabri/">Sabri Eyuboglu</a>, <a href="/brad19brown/">Bradley Brown</a>, <a href="/jshetaye/">Joseph Shetaye</a>,