Jlama is a modern LLM inference engine for Java
LangChain4j is an open-source Java library that simplifies the integration of LLMs into Java applications through a unified API, providing access to popular LLMs and vector databases. It makes implementing RAG, tool calling (including support for MCP), and agents easy. LangChain4j integrates seamlessly with various enterprise Java frameworks.
Practical Llama 3 inference in Java
Plugin for JADX to integrate MCP server
Agents-flex is A Lightweight Java AI Application Development Framework.