🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

Thank you to all who attended the #iaifisummerworkshop! We had an excellent week of interdisciplinary interactions with researchers at all career stages. Genuinely inspiring! Until next year… ⁦AIVO -AI Institutes Virtual Organization⁩

NeurIPS2023 NeurIPS Conference New Orleans will have two presentations by CMTC from Maissam Barkeshli and Andrey Gromov graduate students Darshil, Dayal, Tianyu-- this is remarkable for a theoretical physics center given the selectivity of this CS conference CMTC is now an AI/ML center too!

As CMTC is getting more and more involved in AI/ML/DL research, with Barkeshli/Gromov and their students just presenting papers in NeurIPS 2023, it is perhaps fitting that this article was just chosen as a Highlight of the Year in the APS Physics Magazine physics.aps.org/articles/v16/1…

Learning to grok: Emergence of in-context learning and skill composition in modular arithmetic tasks arxiv.org/abs/2406.02550

Awesome collaboration with my students Tianyu He Darshil Doshi @ICML2025 Aritra Das @ Neurips! We got a GPT-style model to learn modular arithmetic in-context. There are phase transitions as a function of data diversity, number of in-context examples & visually stunning representations.

I'm genuinely excited to share our recent work on in-context learning modular arithmetic tasks -- featuring the coolest PCA figure you will see today :)

Can one achieve SOTA LLM performance at a much lower bitsize (=>memory/inference costs) than current (post-training) quantization? YES! - by training ternary LLMs - a "sweet spot" between underperforming binary and costly ful-precision ones. Happy to announce our recently

Congrats to John Hopfield and Geoffrey Hinton! well deserved recognition that some important foundations of AI rest on physics! Physics departments take note: understanding and improving AI systems is a new frontier topic for physics, just as biophysics was earlier. Time to hire!

(((ل()(ل() 'yoav))))👾 Ofir Lindenbaum Physics departments are already hiring in the intersection of physics of ML and ML for physics which needs deep knowledge of both. I am not sure why we are arguing what is physics and what is not. The intersections of the two fields is exciting! The Nobel prize is well deserved.

🚨 ICML 2025 🚨 I'll be at ICML Conference Mon-Fri. DM if you'd like to chat!☕️ Also come check out our poster on cracking Pseudo-Random Number Generators with Transformers! 🕚 Tuesday @ 11am #⃣ E-1206 🔗arxiv.org/abs/2502.10390

Our new paper got #ACL2025 oral! 🎉 If you're interested in LLM training dynamics, its phases, and how scaling affects them — check it out! Mila - Institut québécois d'IA x.com/mirandrom/stat…