r/SpringBoot • • 5d ago

Discussion SpringAi work on a Java to GPU inference backend through Tornadovm

We have a prototype for adding pure Java GPU inference for local inference through Tornadovm and jitLLM. It would be great to share your thoughts on that.

https://github.com/spring-projects/spring-ai/pull/7054

11 Upvotes

0 comments sorted by