🔥The 9th Round of Easy Loan, Earn $40 Reward is in progress❗️ ⏰ Promotion Period: January 15th - Feburary 15th, 2025 👉 Register now and check more details at gate.io/campaigns/358

Local LLM inference in pure latest Java, with no native dependencies, easy setup, and insane performance running on @GraalVM Native Image 🔥 More at Devoxx with Alfonso² Peterssen☕: devoxx.be/talk/practical…

Fast LLM inference in pure Java? How about ✨instant✨ LLM inference in pure Java?:) Join me and Alfonso² Peterssen☕ on Thursday at 13:50 to see how! mobile.devoxx.com/events/dvbe24/… #Devoxx #Java #GraalVM

jlama (by Jake Luciani ) and llama3.java (by Alfonso² Peterssen☕ ) examples are working. See you at: "Pure Java Enterprise AI/LLM Integration (EAI 2.0)" Devoxx (devoxx.be/talk/pure-java…) #java #llm #ai

.Alfonso² Peterssen☕ and Аlina Yurenko 🇺🇦 talking about practical LLM inference in modern Java with Llama3.java and @GraalVM at Devoxx! 🏎🎉 Try it out at github.com/mukel/llama3.j…

Loving Alfonso² Peterssen☕ and Аlina Yurenko 🇺🇦 's talk explaining the various working parts of inference engines - then make it work in java with jbang.

Must see #Devoxx talk : Practical LLM Inference in Modern Java with Alfonso² Peterssen☕ and Аlina Yurenko 🇺🇦 Btw I see also DevoxxGenie in his IDE 🤗

Contribute! 👇

Here's the #Devoxx Belgium recording, enjoy! youtube.com/watch?v=zgAMxC…

Developing and optimizing an LLM inference engine in pure Java: youtube.com/watch?v=zgAMxC… with Alfonso² Peterssen☕ #Devoxx #Java #LLM

All details were presented at Devoxx Belgium! youtu.be/zgAMxC7lzkc PS: I'm the original author.

Just made the first-ever DevoxxGenie LLM inference using ONLY @Java, powered by the awesome #Jlama project! ☕🔥 Huge thanks to Jake Luciani for making it happen! 💪🏼#NoPython #JavaAI

Earlier today was asked if Java AI integration improved yet, or that we'd still need to rely on Python or C bindings. Was happy to share github.com/mukel/llama3.j… by Alfonso² Peterssen☕ from the GraalVM team running native in Java without any dependencies and with superior performance!

Modern @Java Project : a Spring Boot wrapper for Llama3.java from Alfonso² Peterssen☕ supporting OpenAI Chat Completion REST requests 🔥 github.com/stephanj/Llama… #OpenAI #SpringBoot

As a result I can now use DevoxxGenie with a pure Java Arm Inference engine running locally on my mac using Llama 3.2 🍏🔥

buff.ly/40KmT0t Graal compiler: +10% faster inference with the latest early access build. New features: batched prompt processing & AVX512 support.

We just merged the current status of the upcoming JDWP support for @GraalVM Native Image! 🥳 This will soon provide developers with the same debugging experience they are used to in Java, but for native images! Stay tuned for more details. github.com/oracle/graal/p…

Looking forward to speaking tomorrow at Voxxed Days CERN (15th January 2025) together with Alfonso² Peterssen☕ followed by delivering both a keynote and a regular talk at Voxxed Days Ticino on Friday! 🤩🎤#FunDaysAhead #AAP #Java

run an LLM with a supercharged engine powered by Java and GraalVM (ht Аlina Yurenko 🇺🇦 ) youtube.com/shorts/7zSEa_B…

GPULlama3.java is out! Great effort by the TornadoVM team to bring GPU-enabled inference to the JVM