Supported providers
OpenAI
GPT-4o, GPT-4 Turbo, GPT-3.5 Turbo
Azure OpenAI
GPT-4o, GPT-4 Turbo deployed on Azure
Anthropic
Claude 3.5 Sonnet, Claude 3 Opus, Claude 3 Haiku
Ollama
Llama 3, Mistral, Gemma and any locally hosted model
Google Gemini
Gemini 2.0 Flash, Gemini 1.5 Pro
Any OpenAI-compatible API
Together AI, Groq, Mistral, DeepSeek