Comparison Table of all supported Language Models
| Provider | Streaming | Tools (sync/streaming/partial/complete) | JSON Schema | JSON Mode | Thinking (Reasoning) | Supported Modalities (Input) | Observability | Customizable HTTP Client | Local Deployment | Supports Native Image | Comments |
Amazon Bedrock
Maven Dependency
Anthropic
- Anthropic Documentation
Azure OpenAI
This is the documentation for the Azure OpenAI integration, that uses the Azure SDK from Microsoft, and works best if you are using the Microsoft Java stack, including advanced Azure authentication mechanisms.
ChatGLM
https://github.com/THUDM/ChatGLM-6B
DashScope (Qwen)
DashScope is a platform developed by Alibaba Cloud.
GitHub Models [Deprecated]
This module is deprecated, please use the OpenAI Official SDK module instead.
Google AI Gemini
https://ai.google.dev/gemini-api/docs
Google Vertex AI Gemini
Vertex AI is Google Cloud's fully-managed AI development platform that provides access to Google's large generative models, including the older generation (PaLM2) and the newer generation (Gemini).
Google Vertex AI Anthropic
Google Vertex AI provides access to Anthropic's Claude models through Google Cloud Platform. This integration allows you to use Claude's advanced language capabilities while leveraging Google Cloud's infrastructure and security features.
Hugging Face
In order to use Hugging Face Inference Providers,
Jlama
Jlama Project
LocalAI
https://localai.io/
MistralAI
MistralAI Documentation
Ollama
What is Ollama?
OpenAI
This is the documentation for the OpenAI integration, that uses a custom Java implementation of the OpenAI REST API, that works best with Quarkus (as it uses the Quarkus REST client) and Spring (as it uses Spring's RestClient).
OpenAI Official SDK
This is the documentation for the OpenAI Official SDK integration, that uses the official OpenAI Java SDK.
OpenAI-Compatible Language Models
Many services and tools expose OpenAI-compatible APIs. The general approach to using them with LangChain4j is:
Qianfan
ηΎεΊ¦ζΊθ½δΊεεΈε€§ζ¨‘ε
Cloudflare Workers AI
https://developers.cloudflare.com/workers-ai/
ZhiPu AI
ZhiPu AI is a platform to provide model service including text generation, text embedding,
Oracle Cloud Infrastructure GenAI
Generative AI Service
Xinference
- https://inference.readthedocs.io/
GPULlama3.java
GPULlama3.java
watsonx.ai
- watsonx.ai API Reference