Another work at #ICML2024. This work theoretically studies the training and generalization of a one-layer Graph Transformer with trainable positional encoding. Time: Jul. 24th, Wednesday, 1:30-3:00 pm. Location: Hall C 4-9 #506

🔥Excited to share our poster at #ICML2024. This work studies the training dynamics of nonlinear Transformers, together with the In-Context Learning generalization capability of the model. Time: Jul 23rd, Tuesday, 1:30-3:00 pm. Location: Hall C 4-9 #403.

The 3rd AdvML-Frontiers Workshop (AdvMLFrontiers advml-frontier.github.io) is set for #NeurIPS 2024 (NeurIPS Conference)! This year, we're delving into the expansion of the trustworthy AI landscape, especially in large multi-modal systems. Trustworthy ML Initiative (TrustML) LLM Security🚀 We're now

Are you a big fan of in-context learning (ICL)? Check out our IBM Research blog post highlighting our ICML Conference paper demystifying ICL. We characterize how ICL learns and generalizes. With Hongkang Li Meng Wang Rensselaer Polytechnic Institute Songtao Lu & Xiaodong Cui Blog: research.ibm.com/blog/demystify…

Thanks IBM Research for posting a blog about our work on in-context learning. Please see this link: research.ibm.com/blog/demystify…

Our follow-up work on the LLM theory---- the learning and generalization mechanism of Chain-of-Thought (CoT), will be presented in the next two days of the ICML Conference workshops. 1. Fri 26 Jul., Straus 2, HiLD Workshop. 2. Sat 27 Jul., Straus 2, TF2M Workshop.

This work as been accepted by #ICLR2025. Please see this link openreview.net/forum?id=n7n8M…). We will update our final version soon.

🔥Our #ICLR2025 poster paper "Training Nonlinear Transformers for Chain-of-Thought Inference: A Theoretical Generalization Analysis" will be presented on 04/25, 3:00 p.m. to 5:30 p.m. #342. Link to the paper: openreview.net/pdf?id=n7n8McE…