Comparison Table of all supported Language Models

Provider	Streaming	Tools (sync/streaming)	JSON Schema	JSON Mode	Supported Modalities (Input)	Observability	Local Deployment	Supports Native Image	Comments
Amazon Bedrock	✅	✅/🆘#2114			text	✅
Anthropic	✅	✅/✅			text, image			✅
Azure OpenAI	✅	✅/✅	🔜 #1982	✅	text, image	✅
ChatGLM					text
DashScope	✅	✅/✅			text, image, audio	✅
GitHub Models	✅	✅/✅	🔜 #1911	✅	text	✅
Google AI Gemini	✅	✅/✅	✅	✅	text, image, audio, video, PDF	✅
Google Vertex AI Gemini	✅	✅/✅	🆘 #1717	✅	text, image, audio, video, PDF	✅
Google Vertex AI PaLM 2					text			✅
Hugging Face					text
Jlama	✅	✅/✅			text		✅	✅
LocalAI	✅	✅/✅			text		✅
Mistral AI	✅	✅/✅		✅	text
Ollama	✅	✅/❌ #5796	🆘 #2246	✅	text, image	✅	✅
OpenAI	✅	✅/✅	✅	✅	text, image	✅	Compatible with: Ollama, LM Studio, GPT4All, etc.	✅	Compatible with: Groq, etc.
Qianfan	✅	✅/✅			text
Cloudflare Workers AI					text
Zhipu AI	✅	✅/✅			text, image	✅

Legend:

• ✅ means "supported"
• 🆘 means "not supported yet; please help us implement it"
• 🔜 means "it is being implemented; please wait"
• ❌ means "not supported by the LLM provider"
• no mark means "not sure, need to double-check"