Comparison Table of all supported Language Models
Provider | Streaming | Tools (sync/streaming) | JSON Schema | JSON Mode | Supported Modalities (Input) | Observability | Local Deployment | Supports Native Image | Comments |
---|---|---|---|---|---|---|---|---|---|
Amazon Bedrock | ✅ | ✅/🆘#2114 | text | ✅ | |||||
Anthropic | ✅ | ✅/✅ | text, image | ✅ | |||||
Azure OpenAI | ✅ | ✅/✅ | 🔜 #1982 | ✅ | text, image | ✅ | |||
ChatGLM | text | ||||||||
DashScope | ✅ | ✅/✅ | text, image, audio | ✅ | |||||
GitHub Models | ✅ | ✅/✅ | 🔜 #1911 | ✅ | text | ✅ | |||
Google AI Gemini | ✅ | ✅/✅ | ✅ | ✅ | text, image, audio, video, PDF | ✅ | |||
Google Vertex AI Gemini | ✅ | ✅/✅ | 🆘 #1717 | ✅ | text, image, audio, video, PDF | ✅ | |||
Google Vertex AI PaLM 2 | text | ✅ | |||||||
Hugging Face | text | ||||||||
Jlama | ✅ | ✅/🆘#2115 | text | ✅ | ✅ | ||||
LocalAI | ✅ | ✅/✅ | text | ✅ | |||||
Mistral AI | ✅ | ✅/✅ | ✅ | text | |||||
Ollama | ✅ | ✅/❌ #5796 | ✅ | text, image | ✅ | ✅ | |||
OpenAI | ✅ | ✅/✅ | ✅ | ✅ | text, image | ✅ | Compatible with: Ollama, LM Studio, GPT4All, etc. | ✅ | Compatible with: Groq, etc. |
Qianfan | ✅ | ✅/✅ | text | ||||||
Cloudflare Workers AI | text | ||||||||
Zhipu AI | ✅ | ✅/✅ | text, image | ✅ |
Legend:
- ✅ means "supported"
- 🆘 means "not supported yet; please help us implement it"
- 🔜 means "it is being implemented; please wait"
- ❌ means "not supported by the LLM provider"
- no mark means "not sure, need to double-check"