Comparison Table of all supported Language Models

Provider	Streaming	Tools (sync/streaming)	Structured Outputs	JSON mode	Supported Modalities (Input)	Observability	Local	Native	Comments
Amazon Bedrock	✅	✅/⏳#2114			text	✅
Anthropic	✅	✅/✅			text, image			✅
Azure OpenAI	✅	✅/✅	🔜 #1982	✅	text, image	✅
ChatGLM					text
DashScope	✅	✅/✅			text, image, audio	✅
GitHub Models	✅	✅/✅	🔜 #1911	✅	text	✅
Google AI Gemini	✅	✅/✅	✅	✅	text, image, audio, video, PDF	✅
Google Vertex AI Gemini	✅	✅/✅	⏳ #1717	✅	text, image, audio, video, PDF	✅
Google Vertex AI PaLM 2					text			✅
Hugging Face					text
Jlama	✅	✅/⏳#2115			text		✅	✅
LocalAI	✅	✅/✅			text		✅
Mistral AI	✅	✅/✅		✅	text
Ollama	✅	✅/❌ Issue		✅	text, image	✅	✅
OpenAI	✅	✅/✅	✅	✅	text, image	✅	Compatible with: Ollama, LM Studio, GPT4All, etc.	✅	Compatible with: Groq, etc.
Qianfan	✅	✅/✅			text
Cloudflare Workers AI					text
Zhipu AI	✅	✅/✅			text, image	✅

Legend:

• ✅ means "supported"
• ⏳ means "not supported yet; please help us implement it"
• 🔜 means "it is being implemented; please wait"
• ❌ means "not supported by the LLM provider"
• no mark means "not sure, need to double-check"