> ## Documentation Index
> Fetch the complete documentation index at: https://docs.verlon.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Mistral

> Every Mistral model Verlon supports — Large, Medium, Small, Ministral, Codestral, Devstral, Magistral, Pixtral — with quickstart and SDK compatibility.

Mistral's full lineup — Large, Medium, Small, Ministral (edge sizes), Codestral (code), Devstral (dev tools), Magistral (reasoning), Pixtral (multimodal) — is routable through Verlon in whichever SDK you already use. No Mistral-specific SDK required.

## Chat models

| Model ID | Type | Context |
| - | - | - |
| `codestral-2508` | chat | 256K |
| `codestral-latest` | chat | 256K |
| `devstral-2512` | chat | 262K |
| `devstral-latest` | chat | 262K |
| `devstral-medium-latest` | chat | 131K |
| `devstral-small-latest` | chat | — |
| `glm-5-2` | chat | 1049K |
| `magistral-medium-latest` | chat | 40K |
| `magistral-small-latest` | chat | 131K |
| `ministral-14b-2512` | chat | 262K |
| `ministral-14b-latest` | chat | 262K |
| `ministral-3b-2512` | chat | 131K |
| `ministral-3b-latest` | chat | 131K |
| `ministral-8b-2512` | chat | 262K |
| `ministral-8b-latest` | chat | 262K |
| `mistral-code-agent-latest` | chat | 262K |
| `mistral-code-fim-latest` | chat | 256K |
| `mistral-code-latest` | chat | 256K |
| `mistral-large-2512` | chat | 256K |
| `mistral-large-4` | chat | 1049K |
| `mistral-large-4-0` | chat | 1049K |
| `mistral-large-latest` | chat | 256K |
| `mistral-medium` | chat | 262K |
| `mistral-medium-2505` | chat | 131K |
| `mistral-medium-2508` | chat | 131K |
| `mistral-medium-2604` | chat | 262K |
| `mistral-medium-3` | chat | 32K |
| `mistral-medium-3-5` | chat | 256K |
| `mistral-medium-3.5` | chat | 256K |
| `mistral-medium-latest` | chat | 131K |
| `mistral-small-2506` | chat | 128K |
| `mistral-small-2603` | chat | 262K |
| `mistral-small-latest` | chat | 262K |
| `mistral-tiny-2407` | chat | 131K |
| `mistral-tiny-latest` | chat | 131K |
| `mistral-vibe-cli-fast` | chat | 262K |
| `mistral-vibe-cli-latest` | chat | 262K |
| `mistral-vibe-cli-with-tools` | chat | 262K |
| `open-mistral-nemo` | chat | 128K |
| `open-mistral-nemo-2407` | chat | 131K |
| `zai-glm-5` | chat | 1049K |
| `zai-glm-5-2` | chat | 1049K |
| `zai-glm-5-3` | chat | 1000K |
| `zai-glm-latest` | chat | 1000K |

> [!NOTE]
>
> This table is auto-generated from the Verlon model registry on every sync —
> see the [live registry](https://docs.verlon.ai/provider-compatibility/models.md#live-registry) for
> pricing, benchmarks, and deprecation dates.

## Other modalities

* **audio** — 4 models
* **embeddings** — 4 models
* **moderation** — 1 models
* **OCR / document processing** — 6 models
* **speech-to-text** — 3 models
* **text-to-speech** — 2 models

Non-chat Mistral models are called through the OpenAI SDK using the same model IDs — Verlon mirrors `/v1/embeddings`, `/v1/images/generations`, and `/v1/audio/speech` as drop-in routes. Mistral's OCR line is particularly strong for document processing; `mistral.ocr.process()` works drop-in against `/mistral/v1/ocr` — the same serverURL swap as chat and FIM.

## Quickstart

> [!NOTE]
>
> First time? [Create a gate](https://docs.verlon.ai/platform/gates.md) and grab an [API
> key](https://docs.verlon.ai/getting-started/authentication.md) — the examples below need a `GATE_ID`
> and `VERLON_API_KEY`.

The fastest path — the official OpenAI SDK, pointed at Verlon:

```typescript theme={null}
import OpenAI from 'openai';

const openai = new OpenAI({
  baseURL: 'https://api.verlon.ai/v1',
  apiKey: process.env.VERLON_API_KEY,
});

// @ts-ignore - gateId is a Verlon AI extension
const response = await openai.chat.completions.create({
  gateId: process.env.GATE_ID,
  model: 'mistral-large-latest', // optional — overrides the gate's configured model
  messages: [{ role: 'user', content: 'Hello!' }],
});

console.log(response.choices[0].message.content);
```

Any chat model from the table above works — swap `mistral-large-latest` for `codestral-latest`, `magistral-medium-latest`, `pixtral-large-latest`, or any other ID.

## SDK compatibility

Any SDK with a Verlon drop-in endpoint can reach every model on this page — today that's the [OpenAI SDK](https://docs.verlon.ai/provider-compatibility/openai.md) and the [Anthropic SDK](https://docs.verlon.ai/provider-compatibility/anthropic.md): point it at Verlon, reference a gate that routes here, and your code stays unchanged. The [quickstart above](#quickstart) is all it takes. Verlon also mirrors Mistral's own API shape at `/mistral/v1/chat/completions` and `/mistral/v1/fim/completions` for clients that already speak it. The [Verlon SDK](https://docs.verlon.ai/sdk-reference/overview.md) isn't needed for inference — its home is agent tracing, observability, and the model registry.

### Streaming

```typescript theme={null}
const stream = await openai.chat.completions.create({
  gateId: process.env.GATE_ID,
  messages: [{ role: 'user', content: 'Tell me a joke.' }],
  stream: true,
});

for await (const chunk of stream) {
  process.stdout.write(chunk.choices[0]?.delta?.content ?? '');
}
```

## What's supported

> [accordion] Streaming
>
> Full support for `stream: true` in every supported SDK — identical semantics
> to the source SDK.

> [accordion] Tool / function calling
>
> Fully supported. Verlon translates the tool-call shape between OpenAI /
> Anthropic / Mistral native formats.

> [accordion] Vision
>
> Image inputs work with Pixtral models — Mistral's vision-capable line.

> [accordion] Code + reasoning specializations
>
> Codestral, Devstral, and Magistral models are available with the same call
> shape — swap the model ID.

> [accordion] Standard parameters
>
> `temperature`, `max_tokens`, `top_p`, `stop`, and the rest are passed
> through.

> [accordion] Usage + cost tracking
>
> Every response includes token usage plus Verlon's `cost` field with per-call
> dollar amount.

## How it works

1. **You send** a request in your chosen SDK's format
2. **Verlon receives** — validates the gate, applies routing rules
3. **Verlon translates** to Mistral's native format and dispatches to Mistral's API
4. **Mistral responds** with its raw response
5. **Verlon normalizes** back to your SDK's expected shape
6. **You receive** a response in the format your code already handles, with an added `cost` field

Your existing code doesn't know it's talking to Mistral.

## Errors

| Status | Meaning | What to check |
| - | - | - |
| `400` | Invalid request | Malformed body or missing `gateId` |
| `401` | Invalid API key | Your `VERLON_API_KEY` value and the `Authorization: Bearer` header |
| `404` | Gate not found | Your `GATE_ID` — the error message names the offending ID |
| `429` | Rate limit exceeded | Back off and retry; the body includes `reset_at`, and every response carries `X-RateLimit-*` headers |

The error shape always matches the SDK you're calling with. Through the OpenAI SDK it surfaces as a thrown `APIError`:

```typescript theme={null}
try {
  await openai.chat.completions.create({
    gateId: process.env.GATE_ID,
    messages: [{ role: 'user', content: 'Hello!' }],
  });
} catch (error) {
  // error.status and error.message carry the API's answer,
  // e.g. 404 'Gate with ID "…" not found'
  console.error(error.status, error.message);
}
```

## Full non-chat model list

Every non-chat Mistral model Verlon routes to, grouped by modality. Chat models are in the table near the top of this page.

### Audio

| Model ID |
| - |
| `voxtral-mini-2602` |
| `voxtral-mini-realtime-2602` |
| `voxtral-mini-realtime-latest` |
| `voxtral-mini-transcribe-realtime-2602` |

### Embeddings

| Model ID |
| - |
| `codestral-embed` |
| `codestral-embed-2505` |
| `mistral-embed` |
| `mistral-embed-2312` |

### Moderation

| Model ID |
| - |
| `mistral-moderation-2603` |

### OCR / document processing

| Model ID |
| - |
| `mistral-ocr-2512` |
| `mistral-ocr-3` |
| `mistral-ocr-3-0` |
| `mistral-ocr-4` |
| `mistral-ocr-4-1` |
| `mistral-ocr-latest` |

### Speech-to-text

| Model ID |
| - |
| `voxtral-mini-latest` |
| `voxtral-small-2507` |
| `voxtral-small-latest` |

### Text-to-speech

| Model ID |
| - |
| `voxtral-mini-tts-2603` |
| `voxtral-mini-tts-latest` |

## Related

* [OpenAI](https://docs.verlon.ai/provider-compatibility/openai.md) · [Anthropic](https://docs.verlon.ai/provider-compatibility/anthropic.md) · [Google](https://docs.verlon.ai/provider-compatibility/google.md)
* [Verlon SDK reference](https://docs.verlon.ai/sdk-reference/overview.md) — agent tracing, observability, and the model registry
* [Gates](https://docs.verlon.ai/platform/gates.md) — set up routing rules and model configuration
* [Bring your own key](https://docs.verlon.ai/platform/byok.md) — use your own Mistral account for provider costs
* [Mistral's official docs ↗](https://docs.mistral.ai/)


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.