Skip to content

Supported LLM Providers

AgentQ runs on the AI provider configured for your deployment: the Qualytics-managed provider (Beta) or an external provider connected with your organization's credentials. This page lists every provider you can connect, explains what the Beta badge on the Qualytics provider means, and covers which providers support file attachments in chat. To connect or change a provider, see Add Integration and Update Integration.

Provider List

The table below covers which providers you can connect. For the models each one currently offers, open the Model dropdown in the AgentQ Configuration dialog after selecting the provider: that list comes from the platform itself and stays current as providers release and retire models. Where a provider accepts any model, you can also type a model name that is not in the list.

Provider Models
Qualytics (Beta) Managed by Qualytics; no model selection required
OpenAI gpt-5.4, gpt-5.4-mini, gpt-5.4-nano
Anthropic claude-opus-5, claude-sonnet-5, claude-haiku-4-5
Google Gemini gemini-3.6-flash, gemini-3.1-pro-preview, gemini-3.5-flash-lite
Google Vertex AI gemini-3.6-flash, gemini-3.1-pro-preview (via Google Cloud Vertex AI)
Amazon Bedrock Region-specific model IDs (see Amazon Bedrock Authentication)
Azure OpenAI OpenAI models via Azure deployments
Groq openai/gpt-oss-120b
Mistral mistral-large-latest, mistral-small-latest
Cohere command-r-plus, command-r
DeepSeek deepseek-chat, deepseek-reasoner
xAI grok-4.5
Ollama Any locally-hosted model (requires Base URL)
OpenRouter Any model via OpenRouter
LiteLLM Any model via LiteLLM proxy (requires Base URL)
Perplexity sonar-pro, sonar
Heroku Claude, GPT-OSS, Nova, and other models via Heroku Managed Inference
Fireworks Any Fireworks-hosted model
GitHub Models GitHub-hosted models
Hugging Face Inference endpoint models
Together AI Any Together AI model
Cerebras gpt-oss-120b, qwen-3-235b-a22b-instruct-2507, zai-glm-4.7
Moonshot AI kimi-k3, kimi-latest, kimi-thinking-preview
Snowflake Cortex claude-opus-4-8, claude-opus-4-7, claude-sonnet-4-6 (requires an account identifier)
Alibaba Cloud qwen-max, qwen-plus, qwen-turbo
Nebius AI Qwen/Qwen3-235B-A22B, meta-llama/Llama-4-Maverick-17B-128E-Instruct
OVHcloud AI Any OVHcloud AI endpoint model (free-text Model field)
SambaNova Llama-4-Maverick-17B-128E-Instruct, Qwen3-235B-A22B
Vercel AI Any model via the Vercel AI gateway (free-text Model field)
Zai GLM 5 generation models

Note

The Qualytics provider does not require your organization to supply an LLM API key. For an external provider, your organization supplies the credentials and is responsible for that provider's usage and commercial terms.

When the Qualytics Provider Is Not Listed

The Qualytics provider appears only on deployments that carry a Qualytics-issued deployment identifier. Where that is missing, the provider is simply absent from the list: there is no greyed-out entry and nothing on the form explaining why. If you expect to see it and do not, contact Qualytics support, or configure an external provider instead. Selecting it through the API on such a deployment is refused with a message saying the same thing.

What Beta Means

The Beta badge marks this provider in every place it turns up: beside it in the provider list, beside the Provider field once it is selected, beside the connected entry on the Integrations page, and in the disconnect confirmation dialog. Beta here means capacity is still being expanded while feedback is gathered, so its behavior may change. Everything else about it works the way the other providers do: you connect it, change it, and disconnect it from the same place.

File Uploads in Chat

When the active provider supports file attachments, the chat input shows an Attach icon for sending PDFs, Word, Excel, CSV, TSV, JSON, XML, plain text, and Markdown files. The button is shown for Qualytics, Anthropic, Google Gemini, Google Vertex AI, Amazon Bedrock (Claude models), OpenAI, Azure OpenAI, and Heroku. Other providers can still receive document content via the Paste Large Content flow. See Attach a File for limits and supported formats.

The Qualytics provider reads a narrower set of formats

The Qualytics provider accepts PDF, Word .docx, Excel .xlsx, and text-based files (CSV, TSV, plain text, JSON, XML, Markdown). It cannot read the legacy .doc and .xls formats, PowerPoint, or images, so the file picker leaves those out while this provider is selected. Dragging one onto the chat instead of picking it is turned away right away, with a notice listing the formats that do work. Save the file as .docx or .xlsx, export it as CSV or PDF, or paste its content as text.

A PDF has to be text-searchable. A scanned or image-only PDF is still accepted, but no text can be read from it, so AgentQ answers that it found no readable content rather than returning an error. Very long documents are truncated.