🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

Falcon-H1 is apparently eval-maxxing, but better than expected at uncheatable_eval, so it's a decent base model 🙂 all results: github.com/Jellyfish042/u…

Try RWKV-8 DeepEmbed if you haven't 🔥 Better than Gemma3n PLE, and easier to use too.

RWKV papers rwkv.com : 15 new in Apr/May 2025 🔥 DualComp using RWKV-7 for efficient compression, and RWKVQuant doing 3.275bit. RWKV-7 "Goose" 🪿 is 100% RNN and efficiently test-time-training its state via in-context gradient descent at every token in parallel.

You can add empty "think" for RWKV7-G1 to get higher quality response while saving tokens.

Songlin blocked me on X and banned me from FLA discord. I guess she truly wants her side of the story to keep 🙃 You can't change history, can you?

And 15 new RWKV papers in June🙂check rwkv.com (total 108 RWKV papers now)

p.s. I think arXiv papers can be the next source of reasoning data: (1) Locate difficult yet predictable tokens (2) Use them for RL (3) "Solving" papers will be more than enough to solve the badly-named "Humanity's Last Exam"🙂