
Jakub Smékal
@jakub_smekal
AI, physics, and neuroscience. PhD student @Stanford
ID: 752437028546117632
https://jakubsmekal.com/ 11-07-2016 09:39:02
251 Tweet
935 Followers
1,1K Following




"The structure of data is the dark matter of theory in deep learning" — Surya Ganguli during his talk on "Perspectives from Physics, Neuroscience, and Theory" at the Simons Institute's Special Year on Large Language Models and Transformers, Part 1 Boot Camp.







So excited by our latest NeurIPS Conference paper on parallelizing nonlinear RNNs! With my amazing collaborators a.w., Jimmy Smith, and Scott Linderman. We are building on the beautiful DEER algorithm by YH Lim, Muhammad Firmansyah Kasim, et al. (arxiv.org/abs/2309.12252). Thread below!


We also just dropped a new blog that steps through both the the math and the code! Blog: lindermanlab.github.io/hackathons/ Poster: neurips.cc/virtual/2024/p… With my amazing collaborators a.w. , Jimmy Smith , and Scott Linderman