New blog post coming out soon Here is a sneak peek 👀

Now it's the right time to go back to youtube for content Hundreds of high quality math videos are being published for the Summer of Math Eposition

This few days I've been going back to just trying to do video diffusion in pixel space. No VAE. Just Diffusion. Either it works or not. Right? So, on simple environment like lunar lander, it does work, but on harder environments like counterstrike I can't make it to work

Lately I've been reading some papers about off-policy RL methods. They don't really work well. Today I sketched some math equations and I think that people have been optimizing the Bellman equation wrong this whole time. It's time for a new weekend research project.

In Q-learning people usually predict just the expected Q-value. So I though: Is it possible to predict the entire probability distribution of Q? The answer is yes. Stay tuned-- tomorrow I'll publish the repository with everything x.com/FrancescoSacco…

One of the side projects I'm working on is a B2B SaaS for health professionals. It's an AI medical scribe and it's way cheaper and simpler than the competition: noteician.com How do you guys get leads in this field?

Does anyone know any good resource to get started on Reinforcement Learning for LLMs?

Since my project that took me a weekend to do is popping off here on twitter, you might want to take a look at the project that took me 6 months to do x.com/FrancescoSacco…

Finally science can explain what’s wrong with me