xAI

​

Chat models

​

Long-context pricing

• The trigger is prompt size only. A long response never moves you into the higher tier.
• It applies to the whole request, not just the tokens past the threshold. A 201K-token prompt bills every one of those tokens at the doubled rate.
• Verlon bills this correctly for you. The cost field on every response already reflects whichever tier applied, so you don’t need to compute it yourself.

​

Quickstart

import { Verlon } from '@verlon-ai/sdk';

const verlon = new Verlon({ apiKey: process.env.VERLON_API_KEY });

const response = await verlon.chat({
  gateId: process.env.GATE_ID,
  model: 'grok-4.5', // optional — overrides the gate's configured model
  data: {
    messages: [{ role: 'user', content: 'Hello!' }],
  },
});

console.log(response.content);

​

Reasoning

const response = await verlon.chat({
  gateId: process.env.GATE_ID,
  data: {
    messages: [{ role: 'user', content: 'Prove there are infinitely many primes.' }],
    reasoningEffort: 'high', // 'low' | 'medium' | 'high' — xAI defaults to 'high'
  },
});

​

SDK compatibility

​

Streaming

for await (const chunk of verlon.chatStream({
  gateId: process.env.GATE_ID,
  data: { messages: [{ role: 'user', content: 'Tell me a joke.' }] },
})) {
  process.stdout.write(chunk.content ?? '');
}

​

What’s supported

​

Not available

• Embeddings. xAI publishes no embeddings model. Use OpenAI, Google, or Mistral embeddings and route your chat traffic to Grok — that mix is exactly what gates are for.
• Text-to-speech. xAI’s voice models are realtime/websocket-only and aren’t reachable through the standard TTS surface.
• OCR. No xAI equivalent; Mistral’s OCR line is the recommended path.

​

Other modalities

• image — 2 models
• video — 2 models

const image = await verlon.image({
  gateId: process.env.GATE_ID,
  model: 'grok-imagine-image',
  data: { prompt: 'A single red maple leaf on white', count: 1 },
});

​

How it works

1. You send a request in your chosen SDK’s format
2. Verlon receives — validates the gate, applies routing rules
3. Verlon translates to xAI’s format and dispatches to xAI’s API
4. xAI responds with its raw response
5. Verlon normalizes back to your SDK’s expected shape
6. You receive a response in the format your code already handles, with an added cost field

​

Errors

try {
  await verlon.chat({
    gateId: process.env.GATE_ID,
    data: { messages: [{ role: 'user', content: 'Hello!' }] },
  });
} catch (error) {
  // error.message carries the API's message,
  // e.g. 'Gate with ID "…" not found'
  console.error(error.message);
}

​

Full non-chat model list

​

Image

​

Video

​

Related

• OpenAI · Anthropic · Google · Mistral
• Verlon SDK reference — one SDK across every provider and modality
• Gates — set up routing rules and model configuration
• Bring your own key — use your own xAI account for provider costs
• xAI’s official docs ↗