LLM for Agents API

Getting Started

1. Register your agent

   Create an agent account and receive your API key. Store it securely -- it is shown only once.

   Copycurl -X POST https://api.llm4agents.com/api/v1/agents/register \
     -H "Content-Type: application/json" \
     -d '{"name": "my-agent"}'

   Response:

   Copy{
     "uuid": "a1b2c3d4-...",
     "apiKey": "sk-proxy-abc123...",
     "name": "my-agent",
     "createdAt": "2026-04-14T12:00:00.000Z",
     "requestId": "req_..."
   }

2. Add funds

   Generate a deposit wallet, then send USDT or USDC on Solana or Polygon. The wallet is a top-up address used exclusively to fund your LLM4Agents balance — every confirmed deposit credits the same balance that pays for chat completions, scraper, search, and image tools. Funds are credited automatically after on-chain verification. Gasless-transfer relayer fees are paid by your own EOA in the token being transferred — they do not draw from the LLM4Agents balance.

   Copycurl -X POST https://api.llm4agents.com/api/v1/wallets/generate \
     -H "Authorization: Bearer YOUR_API_KEY" \
     -H "Content-Type: application/json" \
     -d '{"chain": "solana", "token": "USDC"}'

3. Start using the API

   Point any OpenAI-compatible SDK at the proxy and start making requests.

   Python Node.js cURL

   Copyfrom openai import OpenAI
   
   client = OpenAI(
       base_url="https://api.llm4agents.com/v1",
       api_key="your-api-key"
   )
   
   response = client.chat.completions.create(
       model="anthropic/claude-3-haiku",
       messages=[{"role": "user", "content": "Hello!"}]
   )
   print(response.choices[0].message.content)

   Copyimport OpenAI from 'openai';
   
   const client = new OpenAI({
     baseURL: 'https://api.llm4agents.com/v1',
     apiKey: 'your-api-key',
   });
   
   const response = await client.chat.completions.create({
     model: 'anthropic/claude-3-haiku',
     messages: [{ role: 'user', content: 'Hello!' }],
   });
   console.log(response.choices[0].message.content);

   Copycurl https://api.llm4agents.com/v1/chat/completions \
     -H "Authorization: Bearer your-api-key" \
     -H "Content-Type: application/json" \
     -d '{
       "model": "anthropic/claude-3-haiku",
       "messages": [{"role": "user", "content": "Hello!"}]
     }'

Authentication

All authenticated endpoints require an Authorization header with a Bearer token:

CopyAuthorization: Bearer sk-proxy-abc123...

TypeScript SDK

@llm4agents/sdk is the official TypeScript SDK for the platform. A single LLM4AgentsClient facade exposes chat completions, wallet management, gasless stablecoin transfers, and MCP-powered tools (scraper, search, image) — all authenticated with the same sk-proxy-... bearer key.

• Repo: github.com/llmforagents/sdk
• npm: @llm4agents/sdk
• Runtimes: Node 18+, browser, Cloudflare Workers, Deno, Bun
• Dependencies: zero runtime deps. ethers ^6 is an optional peer dep, only required for client.transfer.

Install

Copynpm install @llm4agents/sdk

# Optional — only required for client.transfer (gasless transfers)
npm install ethers

Copypnpm add @llm4agents/sdk
pnpm add ethers   # optional, gasless transfers only

Copyyarn add @llm4agents/sdk
yarn add ethers   # optional, gasless transfers only

Copybun add @llm4agents/sdk
bun add ethers   # optional, gasless transfers only

Initialize

Copyimport { LLM4AgentsClient } from '@llm4agents/sdk';

const client = new LLM4AgentsClient({
  apiKey: process.env.LLM4AGENTS_API_KEY!,
  // Optional overrides:
  baseUrl: 'https://api.llm4agents.com',
  mcpUrl:  'https://mcp.llm4agents.com/mcp',
  timeout: 30_000,
});

Chat — completions, streaming, tool-loop conversations

Thin wrapper over POST /v1/chat/completions, plus a higher-level conversation() helper that maintains history and auto-executes MCP tool calls.

Copy// Single completion
const res = await client.chat.completions.create({
  model: 'anthropic/claude-sonnet-4',
  messages: [{ role: 'user', content: 'Hello' }],
});

// Streaming
const stream = await client.chat.completions.create({
  model: 'anthropic/claude-sonnet-4',
  messages: [{ role: 'user', content: 'Count to 10' }],
  stream: true,
});
for await (const chunk of stream) {
  process.stdout.write(chunk.choices[0]?.delta?.content ?? '');
}

// Conversation with auto tool-execution loop
const conv = client.chat.conversation({
  model:  'anthropic/claude-sonnet-4',
  system: 'You are a research assistant',
  tools:  client.tools,
  onToolCall:   (name, args) => { console.log(`→ ${name}`); return true; },
  onToolResult: (name, result) => { console.log(`✓ ${name} (${result.length} chars)`); },
  maxToolRounds: 5,
});

const answer = await conv.say('Search for Bitcoin news and summarize the top 3');
console.log(answer.content);
console.log(answer.toolCalls); // ToolCallRecord[]

// Streaming conversation — typed StreamEvent
const events = await conv.stream('Now find the current price');
for await (const ev of events) {
  switch (ev.type) {
    case 'text':       process.stdout.write(ev.content); break;
    case 'tool_start': console.log(`\n[tool] ${ev.name}`); break;
    case 'tool_end':   console.log(`[done] ${ev.durationMs}ms`); break;
    case 'done':       console.log('\n', ev.response.usage); break;
  }
}

// History is a JSON-serializable array — persist anywhere
const saved = conv.messages;          // readonly ChatMessage[]
const rehydrated = client.chat.conversation({ model: '...', history: saved });

Wallets — generate, balance, transactions

Generated wallets are deposit-only top-up addresses for your LLM4Agents balance. Anything sent to them credits the single balance used to pay for chat completions, scraper, search, and image tools. Gasless-transfer relayer fees are paid separately by your own EOA in the token being transferred — they do not draw from the LLM4Agents balance.

Copyconst wallet = await client.wallets.generate({
  chain: 'polygon',
  token: 'USDC',
});
console.log(wallet.address);

const balance = await client.wallets.balance();
console.log(balance.availableUsd);
console.log(balance.wallets); // per-chain/token breakdown

const page = await client.wallets.transactions({ limit: 20, type: 'deposit' });
for (const tx of page.transactions) {
  console.log(`${tx.type}: $${tx.amountUsd} — ${tx.description}`);
}

Gasless transfers — non-custodial stablecoin sends

The SDK signs locally with the user's private key (via the ethers peer dep) and submits to POST /v1/tx/send. The platform never touches the key. See Gasless TX for the full flow and supported chains/tokens.

Copy// One-call: quote + sign + submit
const result = await client.transfer.send({
  chain: 'polygon',
  token: 'USDC',
  to: '0xRecipient...',
  amount: '10.50',
  privateKey: process.env.EOA_PRIVATE_KEY!,
});
console.log(result.txHash, result.explorerUrl);

// Two-step: inspect the operator fee before signing
const quote = await client.transfer.quote({
  chain: 'polygon', token: 'USDC',
  from: '0xSender...', to: '0xRecipient...', amount: '10.50',
});
console.log(`Fee: ${quote.feeFormatted}`);
const submitted = await client.transfer.submit(quote, process.env.EOA_PRIVATE_KEY!);

MCP tools — scraper, search, image

Typed wrappers over the MCP Streamable HTTP endpoint at mcp.llm4agents.com/mcp. Pricing and full parameter docs live under Scraper / MCP, Search Tools, and Image Tools.

Copy// Scraper (headless browser)
const html = await client.tools.scraper.fetchHtml({ url: 'https://example.com' });
const md   = await client.tools.scraper.markdown({ url: 'https://example.com' });
const shot = await client.tools.scraper.screenshot({ url: 'https://example.com', fullPage: true });

// Search (Google via Serper)
const results = await client.tools.search.google({ q: 'TypeScript SDK design' });
const news    = await client.tools.search.googleNews({ q: 'Bitcoin', tbs: 'qdr:d' });
const places  = await client.tools.search.googleMaps({ q: 'coffee near me' });

// Image (generate, edit, analyze)
const img      = await client.tools.image.generate({ prompt: 'A robot writing code' });
const edited   = await client.tools.image.edit({ prompt: 'Make it blue', imageUrl: '...' });
const analysis = await client.tools.image.analyze({ prompt: 'What is this?', imageUrl: '...' });

// Tool definitions for use with custom tool loops or other LLMs
const defs = client.tools.definitions; // ToolDefinition[]

Models

Copyconst models = await client.models.list();
for (const m of models) {
  console.log(`${m.slug} — $${m.inputPricePer1m}/1M in, $${m.outputPricePer1m}/1M out`);
}

Error handling

Every failure surfaces as a single LLM4AgentsError with a stable code, the upstream statusCode (when applicable), and the requestId from the x-request-id response header.

Copyimport { LLM4AgentsError } from '@llm4agents/sdk';

try {
  await client.chat.completions.create({ model: '...', messages: [...] });
} catch (err) {
  if (err instanceof LLM4AgentsError) {
    switch (err.code) {
      case 'insufficient_balance': /* top up */ break;
      case 'rate_limited':         /* back off */ break;
      case 'model_not_found':      /* pick fallback */ break;
      case 'gas_spike':            /* re-quote and retry */ break;
      case 'tool_loop_limit':      /* raise maxToolRounds or shorten task */ break;
      default:                       console.error(err.code, err.requestId);
    }
  }
}

Error codes mirror the REST/MCP responses — see Errors for the full list. The @llm4agents/gasless standalone package is superseded by this SDK and uses the same code values, so migrating only requires renaming the import and error class.

Endpoints Reference

Copy{
  "uuid": "a1b2c3d4-e5f6-...",
  "apiKey": "sk-proxy-abc123...",
  "name": "my-agent",
  "createdAt": "2026-04-14T12:00:00.000Z",
  "requestId": "req_...",
  "depositDeadline": "2026-04-14T12:15:00.000Z",
  "depositRequiredWithinMinutes": 15,
  "notice": "Anti-spam protection: this agent will be automatically deleted if no deposit is received within 15 minutes. You can simply register a new agent if that happens. Once the first deposit (any amount) is credited, the agent becomes permanent. This measure exists solely to prevent malicious actors from generating agents indefinitely."
}

Copy{
  "status": "ok",
  "service": "llm-proxy-api",
  "timestamp": "2026-04-14T12:00:00.000Z"
}

Copy{
  "chain": "solana",
  "token": "USDC",
  "address": "7xKX...",
  "createdAt": "2026-04-14T12:00:00.000Z",
  "requestId": "req_..."
}

Copy{
  "uuid": "a1b2c3d4-...",
  "availableUsdCents": 5000,
  "availableUsd": "50.00",
  "totalDepositedUsd": "100.00",
  "totalSpentUsd": "50.00",
  "requestId": "req_..."
}

Copy{
  "models": [
    {
      "slug": "anthropic/claude-3-haiku",
      "displayName": "Claude 3 Haiku",
      "provider": "anthropic",
      "inputPricePer1M": 0.3,
      "outputPricePer1M": 1.5,
      "contextWindow": 200000,
      "lastSyncedAt": "2026-04-14T06:00:00.000Z"
    }
  ],
  "requestId": "req_..."
}

Copy{
  "id": "gen-abc123",
  "object": "chat.completion",
  "model": "anthropic/claude-3-haiku",
  "choices": [
    {
      "index": 0,
      "message": {
        "role": "assistant",
        "content": "Hello! How can I help you today?"
      },
      "finish_reason": "stop"
    }
  ],
  "usage": {
    "prompt_tokens": 12,
    "completion_tokens": 9,
    "total_tokens": 21
  }
}

Copy{
  "object": "list",
  "data": [
    { "object": "embedding", "embedding": [0.012, -0.034, ...], "index": 0 }
  ],
  "model": "openai/text-embedding-3-large",
  "usage": { "prompt_tokens": 5, "total_tokens": 5 }
}

Copycurl -X POST https://api.llm4agents.com/v1/audio/speech \
  -H "Authorization: Bearer $API_KEY" -H "Content-Type: application/json" \
  -d '{"model":"x-ai/grok-voice-tts-1.0","input":"Estás en el interior de una pirámide.","voice":"sal","response_format":"mp3"}' \
  --output speech.mp3

Copycurl -X POST https://api.llm4agents.com/v1/videos \
  -H "Authorization: Bearer $API_KEY" -H "Content-Type: application/json" \
  -d '{"model":"x-ai/grok-imagine-video-1.5","prompt":"A drone shot flying over a neon-lit cyberpunk city at night","image":"https://example.com/first-frame.jpg","duration":6,"resolution":"720p"}'

Copy{
  "id": "video_abc123",
  "status": "pending",
  "polling_url": "/v1/videos/video_abc123",
  "charged_usd_cents": 108
}

Copycurl https://api.llm4agents.com/v1/videos/video_abc123 \
  -H "Authorization: Bearer $API_KEY"

Copy{ "id": "video_abc123", "status": "in_progress", "charged_usd_cents": 108 }

Copy{
  "id": "video_abc123",
  "status": "completed",
  "video_url": "/v1/videos/video_abc123/content",
  "charged_usd_cents": 108,
  "adjusted": true
}

Copycurl https://api.llm4agents.com/v1/videos/video_abc123/content \
  -H "Authorization: Bearer $API_KEY" \
  --output video.mp4

Copycurl -X POST https://api.llm4agents.com/v1/images/generations \
  -H "Authorization: Bearer $API_KEY" -H "Content-Type: application/json" \
  -d '{"prompt":"A robot writing code on a chalkboard","n":1}' \
  | jq -r '.data[0].b64_json' | base64 -d > out.png

Copy{
  "created": 1753142400,
  "data": [
    { "b64_json": "iVBORw0KGgo...", "media_type": "image/png" }
  ],
  "usage": { "cost": 0.07 }
}

Copy{
  "chain": "polygon",
  "chainId": 137,
  "token": "USDC",
  "tokenAddress": "0x3c499c542cEF5E3811e1192ce70d8cC03d5c3359",
  "forwarderAddress": "0xba9490B2A5c94AAc18fC7aBf19151757852FB5E7",
  "from": "0x9f...",
  "to": "0xd8dA6BF26964aF9D7eEd9e03E53415D37aA96045",
  "amount": "1.50",
  "amountBaseUnits": "1500000",
  "fee": "50000",
  "feeFormatted": "0.05 USDC",
  "feeDecimal": "0.05",
  "deadline": 1756000000,
  "nonces": { "token": "3", "forwarder": "7" },
  "typedData": {
    "permit": { "domain": {...}, "types": {...}, "primaryType": "Permit", "message": {...} },
    "transferPermit": { "domain": {...}, "types": {...}, "primaryType": "TransferPermit", "message": {...} }
  },
  "requestId": "req_..."
}

Copy{
  "txHash": "0xab...",
  "explorerUrl": "https://polygonscan.com/tx/0xab...",
  "from": "0x9f...",
  "to": "0xd8dA6BF26964aF9D7eEd9e03E53415D37aA96045",
  "chain": "polygon",
  "chainId": 137,
  "token": "USDC",
  "tokenAddress": "0x3c499c542cEF5E3811e1192ce70d8cC03d5c3359",
  "amount": "1.50",
  "amountBaseUnits": "1500000",
  "feeBaseUnits": "50000",
  "feeDecimal": "0.05",
  "requestId": "req_..."
}

Copy# All transactions
GET /api/v1/transactions

# Only deposits
GET /api/v1/transactions?type=deposit

# Only usage, second page of 20
GET /api/v1/transactions?type=usage&limit=20&offset=20

Copy{
  "transactions": [
    {
      "id": 3,
      "type": "usage",
      "service": "tts",
      "amountUsdCents": 1,
      "model": "x-ai/grok-voice-tts-1.0",
      "promptTokens": null,
      "completionTokens": null,
      "totalTokens": null,
      "chain": null,
      "txHash": null,
      "metadata": {"model": "x-ai/grok-voice-tts-1.0", "chars": 37},
      "description": "TTS: x-ai/grok-voice-tts-1.0 (37 chars)",
      "createdAt": "2026-04-16T10:00:00.000Z"
    },
    {
      "id": 2,
      "type": "deposit",
      "service": "llm",
      "amountUsdCents": 5000,
      "model": null,
      "promptTokens": null,
      "completionTokens": null,
      "totalTokens": null,
      "chain": "polygon",
      "txHash": "0xabc...",
      "metadata": null,
      "description": "Deposit of 50.00 USDT on polygon",
      "createdAt": "2026-04-15T09:15:00.000Z"
    },
    {
      "id": 1,
      "type": "usage",
      "service": "llm",
      "amountUsdCents": 3,
      "model": "anthropic/claude-3-haiku",
      "promptTokens": 120,
      "completionTokens": 85,
      "totalTokens": 205,
      "chain": null,
      "txHash": null,
      "metadata": null,
      "description": "Chat completion: anthropic/claude-3-haiku",
      "createdAt": "2026-04-14T12:05:00.000Z"
    }
  ],
  "limit": 50,
  "offset": 0,
  "total": 3,
  "requestId": "req_..."
}

Scraper / MCP

A headless browser service exposed via the Model Context Protocol (MCP). Your agent connects to the MCP server and gains access to tools for fetching pages, taking screenshots, extracting data, and running persistent browser sessions — all with optional proxy support (datacenter or residential) and anti-detection stealth.

Connecting

The MCP server is hosted at a separate endpoint. Authenticate with the same API key used for the main API.

CopyMCP Endpoint: https://mcp.llm4agents.com/mcp
Method:       POST
Auth:         Authorization: Bearer YOUR_API_KEY
Protocol:     MCP Streamable HTTP (JSON response mode)

Pricing

All prices shown as fractions of a US cent. Sub-cent billing — you only pay for what you use.

One-Shot Tool Prices

Session Pricing

Sessions are billed based on duration + number of actions. Cost is reserved upfront at worst-case and settled to actual usage when the session is closed.

Session Limits

One-Shot Tools

Each tool opens a browser, performs one action, returns the result, and closes the browser.

Copy{
  "ok": true,
  "tier_used": "datacenter",
  "html": "<html>...</html>",
  "status": 200,
  "finalUrl": "https://...",
  "attempts": [{ "tier": "none", "error": "Navigation timeout of 10000 ms exceeded" }]
}

Copy{
  "ok": false,
  "tier_used": "none",
  "attempts": [
    { "tier": "none",         "error": "..." },
    { "tier": "datacenter",   "error": "..." },
    { "tier": "residential",  "error": "..." }
  ],
  "reason": "All proxy tiers failed. Last error: ...",
  "hint": "The page may be down, blocking automated requests, or unreachable. Consider trying a different URL, a search query, or another tool.",
  "url": "https://..."
}

Copy{ "markdown": "# Page Title\n\nContent...", "title": "Page Title", "url": "https://..." }

Copy{ "links": [{ "href": "https://...", "text": "Link text", "rel": "" }] }

Copy{ "pngBase64": "iVBOR...", "width": 1920, "height": 1080, "bytes": 184320 }

Copy{ "pdfBase64": "JVBERi0...", "bytes": 52480 }

Copy{ "url": "https://example.com", "selectors": { "title": "h1", "prices": ".price" }, "proxy_tier": "none" }

Copy{ "data": { "title": "Example", "prices": ["$10", "$20", "$30"] } }

Session Tools

Persistent browser sessions let you navigate, click, type, and extract across multiple pages without reopening the browser. Sessions last 5 minutes and support a configurable action limit.

Copy{ "session_id": "a1b2c3d4-...", "expires_at": "2026-04-17T12:05:00.000Z" }

Copy{ "duration_ms": 45000, "actions_count": 12, "cost_cents": 1.74 }

Copy{ "expires_at": "2026-04-17T12:05:00.000Z", "actions_count": 5, "status": "active" }

Search Tools

Google search capabilities exposed via the same MCP server as the scraper tools. Your agent can search Google, Google News, and Google Maps and receive structured results — no browser needed.

Connecting

Uses the same MCP endpoint and authentication as scraper tools.

CopyMCP Endpoint: https://mcp.llm4agents.com/mcp
Method:       POST
Auth:         Authorization: Bearer YOUR_API_KEY
Protocol:     MCP Streamable HTTP (JSON response mode)

Pricing

Flat rate per call for all 3 search tools. Billing follows the same reserve-settle pattern as other tools.

Tools

Common Parameters

Copy{
  "results": [
    {
      "title": "Example Domain",
      "link": "https://example.com",
      "snippet": "This domain is for use in examples..."
    }
  ],
  "query": "example domain"
}

Copy{
  "results": [
    {
      "title": "Breaking News Story",
      "link": "https://news.example.com/story",
      "snippet": "A major development...",
      "date": "2 hours ago",
      "source": "Example News"
    }
  ],
  "query": "latest tech news"
}

Copy{
  "results": [
    {
      "title": "Best Coffee Shop",
      "address": "123 Main St, New York, NY",
      "latitude": 40.7128,
      "longitude": -74.006,
      "category": "Coffee shop",
      "rating": 4.7,
      "phone": "+1 212-555-0100",
      "website": "https://bestcoffee.example.com"
    }
  ],
  "query": "coffee shops near me"
}

Copy{
  "queries": [
    { "q": "best restaurants in NYC", "gl": "us" },
    { "q": "weather forecast NYC", "tbs": "qdr:d" },
    { "q": "NYC subway map" }
  ]
}

Copy{
  "results": [
    {
      "results": [{ "title": "...", "link": "...", "snippet": "..." }],
      "query": "best restaurants in NYC"
    },
    {
      "results": [{ "title": "...", "link": "...", "snippet": "..." }],
      "query": "weather forecast NYC"
    },
    {
      "results": [{ "title": "...", "link": "...", "snippet": "..." }],
      "query": "NYC subway map"
    }
  ],
  "queryCount": 3
}

Image Tools

AI-powered image generation, editing, and analysis tools exposed via the same MCP server as scraper and search tools. Your agent can generate images from text, edit existing images, and analyze image content.

Looking for real-cost, OpenRouter-native image generation instead of these flat-rate gateway tools? See POST /v1/images/generations (plural) — a different endpoint, billed at real upstream cost.

Connecting

Uses the same MCP endpoint and authentication as scraper and search tools.

CopyMCP Endpoint: https://mcp.llm4agents.com/mcp
Method:       POST
Auth:         Authorization: Bearer YOUR_API_KEY
Protocol:     MCP Streamable HTTP (JSON response mode)

Pricing

Image inputs accept either a URL or base64-encoded image data. All image outputs are returned as base64. Billing follows the same reserve-settle pattern as other tools.

Tools

Copy{
  "imageBase64": "<base64 PNG data>",
  "width": 1024,
  "height": 1024,
  "megapixels": 1.048,
  "costCents": 1
}

Copy{
  "imageBase64": "<base64 image data>",
  "width": 1344,
  "height": 768,
  "costCents": 2
}

Copy{
  "text": "The image shows a system architecture diagram with three main components...",
  "costCents": 0.6
}

Copy{
  "imageBase64": "<base64 image data>",
  "width": 728,
  "height": 90,
  "aspectRatio": "21:9",
  "format": "png",
  "costCents": 6,
  "preset": "leaderboard"
}

Workspace

A private per-agent file workspace backed by Cloudflare R2. Upload artifacts (markdown, screenshots, PDFs, JSON) and retrieve them later — billed per-MB with per-day storage. Both Bearer auth and x402 walk-up are supported.

Pricing

All paid operations have a 1¢ minimum. Free operations are rate-limited at 60 req/min per agent.

Worked examples

Tools

10 MCP tools, called via the MCP endpoint at https://mcp.llm4agents.com/mcp. Both Bearer and x402 walk-up work on every paid tool. Inline upload/download is capped at 10 MB; larger files use the init/finalize flow.

{ "created": true, "agent_id": "...", "created_at": 1700000000 }

Public Download Endpoint

The token-based proxy endpoint that consumes the URL returned by workspace_download({ format: "url" }). No authentication header is required — the token itself is the authorization.

GET https://api.llm4agents.com/v1/workspace/download/:token

AI Tools

Inference primitives powered by Cloudflare Workers AI, exposed via the same MCP server as the scraper, search, and image tools. Summarize, translate, embed, classify, moderate, and rerank text — plus image captioning and speech transcription — all billed per call. Both Bearer auth and x402 walk-up are supported.

Connecting

Uses the same MCP endpoint and authentication as the other tools.

CopyMCP Endpoint: https://mcp.llm4agents.com/mcp
Method:       POST
Auth:         Authorization: Bearer YOUR_API_KEY  (or X-PAYMENT for x402 walk-up)
Protocol:     MCP Streamable HTTP (JSON-RPC tools/call)

Pricing

Prices shown in US cents (¢). The Bearer column is balance billing; the x402 walk-up column is the per-call signed-payment rate.

Tools

Called via the MCP endpoint at https://mcp.llm4agents.com/mcp as JSON-RPC tools/call requests. Example envelope:

Copy{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "ai_summarize",
    "arguments": { "text": "...long article text...", "max_words": 60 }
  }
}

Copy{ "summary": "A concise abstract of the input text." }

Copy{ "translated": "El texto traducido.", "target_lang": "es" }

Copy{
  "embeddings": [[0.013, -0.041, ...]],
  "dimensions": 768
}

Copy{
  "results": [
    { "label": "billing", "score": 0.91 },
    { "label": "support", "score": 0.06 }
  ]
}

Copy{
  "flagged": false,
  "categories": { "hate": 0.01, "violence": 0.00, "sexual": 0.00 }
}

Copy{
  "results": [
    { "index": 2, "score": 0.88 },
    { "index": 0, "score": 0.41 }
  ]
}

Copy{ "text": "A photo of a city skyline at sunset." }

Copy{ "text": "Transcribed speech from the audio.", "costCents": 1.5 }

Copy{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "text_to_speech",
    "arguments": { "text": "Estás en el interior de una pirámide.", "voice": "sal", "format": "mp3" }
  }
}

Copy{
  "audio_base64": "SUQzBAAAAAAAI1RTU0U...",
  "format": "mp3",
  "chars": 38,
  "duration_hint_ms": 2533
}

Copy{
  "workspace_file": "tts-a1b2c3d4-....mp3",
  "download_url": "https://api.llm4agents.com/v1/workspace/download/...",
  "expires_at": 1784760300,
  "size_bytes": 512340,
  "format": "mp3",
  "chars": 12000,
  "duration_hint_ms": 800000
}

Video Tools

Text/image-to-video generation via OpenRouter's async video API (x-ai/grok-imagine-video-1.5 by default), exposed as MCP tools alongside the REST /v1/videos endpoints. Submit a job with generate_video, then poll with the free video_status tool until the result lands in your workspace. Bearer-only — x402 walk-up is not available for video (async settle-on-completion billing is incompatible with a single per-call signed payment, the same rationale as browser session tools).

Connecting

Uses the same MCP endpoint as the other tools, Bearer auth only.

CopyMCP Endpoint: https://mcp.llm4agents.com/mcp
Method:       POST
Auth:         Authorization: Bearer YOUR_API_KEY  (Bearer-only, no X-PAYMENT)
Protocol:     MCP Streamable HTTP (JSON-RPC tools/call)

Pricing

Prices shown in US cents (¢) are a temporary reserve, billed per second of requested duration and scaled by a model/resolution rate multiplier (grok 1080p ×2; untabulated models ×4). The final charge is the real upstream cost plus the platform fee, auto-adjusted down from the reserve when the job completes (same mechanism as REST POST /v1/videos — see transactions for the real_cost_adjustment refund).

Tools

Called via the MCP endpoint at https://mcp.llm4agents.com/mcp as JSON-RPC tools/call requests. Example envelope:

Copy{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "generate_video",
    "arguments": { "prompt": "A drone shot flying over a neon-lit cyberpunk city at night", "duration": 6, "resolution": "720p" }
  }
}

Copy{
  "job_id": "video_abc123",
  "status": "pending",
  "check_with": "video_status"
}

Copy{ "status": "pending" }

Copy{
  "status": "completed",
  "workspace_file": "video-video_abc123.mp4",
  "download_url": "https://api.llm4agents.com/v1/workspace/download/...",
  "expires_at": 1784760300,
  "size_bytes": 8421900,
  "adjusted": true
}

Copy{
  "status": "failed",
  "error": "upstream generation error",
  "refunded": true
}

Notify Tools

Send notifications to chat platforms, webhooks, email, and SMS via the same MCP server. Chat and webhook tools relay through credentials you supply in the call; email and SMS are sent through the platform's own providers. Both Bearer auth and x402 walk-up are supported.

Pricing

Prices shown in US cents (¢). Per call.

Tools

Called via JSON-RPC tools/call at https://mcp.llm4agents.com/mcp. Example:

Copy{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "send_slack",
    "arguments": {
      "webhook_url": "https://hooks.slack.com/services/T000/B000/XXXX",
      "text": "Deploy finished ✅"
    }
  }
}

Copy{ "ok": true, "message_id": 12345 }

Copy{ "ok": true }

Copy{ "ok": true }

Copy{ "status": 200, "body": "..." }

Copy{ "ok": true, "id": "msg_..." }

Copy{ "ok": true, "id": "sms_..." }

Data Tools

Utility lookups and converters — DNS, IP geolocation, URL unfurling, RSS, YouTube transcripts, WHOIS, crypto prices, FX conversion, QR codes, and CAPTCHA solving — exposed via the same MCP server. Several are free; paid tools support both Bearer auth and x402 walk-up.

Pricing

Prices shown in US cents (¢). Per call.

Tools

Called via JSON-RPC tools/call at https://mcp.llm4agents.com/mcp. Example:

Copy{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "crypto_price",
    "arguments": { "ids": ["bitcoin", "ethereum"], "vs_currencies": ["usd"] }
  }
}

Copy{ "name": "example.com", "type": "A", "records": ["93.184.216.34"] }

Copy{ "ip": "8.8.8.8", "country": "US", "city": "Mountain View", "lat": 37.4, "lon": -122.0 }

Copy{ "title": "...", "description": "...", "image": "https://...", "site_name": "..." }

Copy{ "items": [{ "title": "...", "link": "...", "published": "..." }] }

Copy{ "transcript": [{ "start": 0.0, "text": "..." }], "lang": "en" }

Copy{ "domain": "example.com", "registrar": "...", "created": "...", "expires": "..." }

Copy{ "bitcoin": { "usd": 68000 }, "ethereum": { "usd": 3500 } }

Copy{ "amount": 100, "from": "USD", "to": "EUR", "result": 92.4, "rate": 0.924 }

Copy{ "svg": "<svg ...>...</svg>" }

Copy{ "task_id": "task_abc123" }

Copy{ "status": "ready", "solution": "03AGdBq..." }

Vector Tools

A private per-agent vector store backed by Cloudflare Vectorize (bge 768-dim embeddings). Upsert text (auto-embedded) or raw vectors, run similarity queries with optional metadata filters, and delete by ID — all via the same MCP server. Both Bearer auth and x402 walk-up are supported.

Pricing

Prices shown in US cents (¢).

Tools

Called via JSON-RPC tools/call at https://mcp.llm4agents.com/mcp. Example:

Copy{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "vector_query",
    "arguments": { "query": "how do refunds work", "top_k": 5 }
  }
}

Copy{
  "items": [
    { "id": "doc-1", "text": "Refunds are processed within 5 days.", "metadata": { "topic": "billing" } },
    { "id": "doc-2", "vector": [0.01, -0.04, ...] }
  ]
}

Copy{ "upserted": 2 }

Copy{
  "matches": [
    { "id": "doc-1", "score": 0.87, "metadata": { "topic": "billing" } }
  ]
}

Copy{ "deleted": 2 }

Web Crawl

Crawl a site starting from a URL, following links breadth-first up to configurable page and depth limits, with optional JS rendering and include/exclude filters. Output as concatenated markdown or a link map, and optionally save straight into your workspace. Exposed via the same MCP server.

Pricing

Prices shown in US cents (¢).

Tools

Called via JSON-RPC tools/call at https://mcp.llm4agents.com/mcp. Example:

Copy{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "web_crawl",
    "arguments": {
      "start_url": "https://example.com/docs",
      "max_pages": 25,
      "max_depth": 2,
      "output": "markdown"
    }
  }
}

Copy{
  "pages_crawled": 18,
  "output": "markdown",
  "content": "# Page 1\n...\n\n# Page 2\n...",
  "costCents": 9
}

Memory Tools

A simple per-agent key/value store for durable agent memory. Set JSON values (up to 64 KB) with an optional TTL, read them back, list by prefix, and delete — via the same MCP server. Reads are free; writes support both Bearer auth and x402 walk-up.

Pricing

Prices shown in US cents (¢). Per call.

Tools

Called via JSON-RPC tools/call at https://mcp.llm4agents.com/mcp. Example:

Copy{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "memory_set",
    "arguments": { "key": "user:42:prefs", "value": { "theme": "dark" }, "ttl_days": 30 }
  }
}

Copy{ "ok": true, "key": "user:42:prefs" }

Copy{ "key": "user:42:prefs", "value": { "theme": "dark" }, "found": true }

Copy{ "keys": ["user:42:prefs"], "cursor": null }

Copy{ "ok": true, "deleted": true }

Semantic Memory Tools

Long-term semantic memory for agents (mem0-parity). Unlike the raw key/value Memory Tools, this layer extracts atomic facts from text or a conversation with an LLM, deduplicates paraphrases against what it already knows (cosine ≥ 0.85), and stores them in a per-agent, tenant-isolated vector namespace (Cloudflare Vectorize, bge-768, cosine) with the canonical text in D1. Recall is semantic and reranked. Via the same MCP server; both tools support Bearer auth and x402 walk-up.

Pricing

Prices shown in US cents (¢). Per call.

Tools

Called via JSON-RPC tools/call at https://mcp.llm4agents.com/mcp. Example:

Copy{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "semantic_memory_add",
    "arguments": { "messages": [
      { "role": "user", "content": "I'm on the premium plan and the checkout page keeps erroring." }
    ] }
  }
}

Copy{ "added": 2, "updated": 1, "memory_ids": ["…"] }

Copy[ { "id": "…", "text": "The customer is on the premium plan", "score": 0.81, "created_at": 0, "updated_at": 0 } ]

Episodic Memory Tools

Part of the Agent Memory OS. Episodic memory records what actually happened — a situation, the action taken, and the outcome, with a valence/magnitude signal — as distinct trajectories (as opposed to the atomic facts stored by Semantic Memory). memory_reflect periodically distills a batch of unreflected episodes into durable semantic lessons plus suggested rules, and also auto-saves any recurring, successful procedure it recognizes as a reusable skill (best-effort, capped, never overwrites an operator- or peer-authored skill of the same name). Via the same MCP server; both tools support Bearer auth and x402 walk-up (episode_log is FREE).

Pricing

Prices shown in US cents (¢).

Tools

Called via JSON-RPC tools/call at https://mcp.llm4agents.com/mcp. Example:

Copy{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "episode_log",
    "arguments": {
      "situation": "Customer asked to cancel the premium plan",
      "action": "Offered a 20% retention discount",
      "outcome": "Customer accepted and stayed",
      "valence": 0.8
    }
  }
}

Copy{ "episode_id": "…" }

Copy{ "lessons_added": 2, "rules_suggested": ["…"], "skills_added": 1, "reflected_count": 14 }

Recall Tools

Part of the Agent Memory OS. memory_recall is the single call for "what do I know that's relevant here" — it fuses semantic facts and episodic experiences for a query into one ranked list, using Reciprocal Rank Fusion across stores plus provenance/valence/recency weighting. Via the same MCP server; supports Bearer auth and x402 walk-up.

Pricing

Prices shown in US cents (¢). Per call.

Tools

Called via JSON-RPC tools/call at https://mcp.llm4agents.com/mcp. Example:

Copy{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "memory_recall",
    "arguments": { "query": "what plan is this customer on?", "top_k": 5 }
  }
}

Copy{
  "recall_id": "…",
  "items": [ { "source": "semantic", "text": "…", "score": 0.83,
    "provenance": { "source": "observation", "valence": 0, "confidence": 0.9, "created_at": 0 } } ],
  "sources_failed": []
}

Knowledge Graph Tools

Part of the Agent Memory OS. A private, bi-temporal knowledge graph per agent (Vectorize + D1). graph_add uses an LLM to extract entities and relations from text or a conversation, classifies each entity as a merge/gray-zone/new match against existing entities, judges ambiguous merges and contradictions with an LLM, and self-invalidates edges it determines are contradicted by new facts (tracked via valid_at / invalid_at, never deleted). graph_search is a hybrid semantic + full-text + multi-hop BFS search fused by Reciprocal Rank Fusion, with point-in-time queries via as_of. Via the same MCP server; both tools support Bearer auth and x402 walk-up.

Pricing

Prices shown in US cents (¢).

Tools

Called via JSON-RPC tools/call at https://mcp.llm4agents.com/mcp. Example:

Copy{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "graph_add",
    "arguments": { "text": "Acme Corp acquired Widgets Inc in March 2024." }
  }
}

Copy{ "added_entities": 2, "merged_entities": 0, "added_edges": 1, "invalidated_edges": 0, "edge_failures": 0 }

Copy{ "facts": [ { "fact_text": "Acme Corp acquired Widgets Inc", "source_entity": "Acme Corp", "relation": "acquired", "target_entity": "Widgets Inc", "valid_at": 1710000000000, "score": 0.77 } ] }

Skill Tools

Part of the Agent Memory OS. Procedural memory: named, triggerable skills an agent can save, search, and self-edit — reusable "how to do X" procedures distinct from the facts in Semantic Memory. Via the same MCP server; all three tools support Bearer auth, and skill_save supports x402 walk-up.

Pricing

Prices shown in US cents (¢). Per call.

Tools

Called via JSON-RPC tools/call at https://mcp.llm4agents.com/mcp. Example:

Copy{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "skill_save",
    "arguments": {
      "name": "handle-refund-request",
      "trigger": "customer asks for a refund",
      "body": "1. Verify order id. 2. Check refund window. 3. Issue via billing API."
    }
  }
}

Copy{ "skill_id": "…", "updated": false }

Copy[ { "name": "handle-refund-request", "trigger": "customer asks for a refund", "body": "1. Verify order id. …" } ]

Copy{ "found": true, "name": "handle-refund-request", "trigger": "customer asks for a refund", "body": "1. Verify order id. …" }

Context Tools

Part of the Agent Memory OS. context_assemble is the "working memory" call: it pages every requested store — semantic, episodic, graph, and skill — for a goal, ranks the results, and packs as many as fit into a token budget, returning one formatted brief. Via the same MCP server; supports Bearer auth and x402 walk-up.

Pricing

Prices shown in US cents (¢). Per call.

Tools

Called via JSON-RPC tools/call at https://mcp.llm4agents.com/mcp. Example:

Copy{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "context_assemble",
    "arguments": { "goal": "resolve this customer's billing dispute", "token_budget": 1500 }
  }
}

Copy{ "brief": "…", "included": 9, "budget_used": 1432, "sources_failed": [] }

Consolidation Tools

Part of the Agent Memory OS. memory_consolidate is background maintenance for semantic memory: it merges near-duplicate memories (dedup, cosine ≥ 0.95, keeping the higher-confidence/more-recent record) and forgets stale, low-confidence memories (decay, 90+ days old). Bounded per call and safe to run repeatedly (idempotent). Via the same MCP server; supports Bearer auth and x402 walk-up.

Pricing

Prices shown in US cents (¢). Per call.

Tools

Called via JSON-RPC tools/call at https://mcp.llm4agents.com/mcp. Example:

Copy{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "memory_consolidate",
    "arguments": { "max_ops": 50, "operations": ["decay", "dedup"] }
  }
}

Copy{ "scanned": 12, "merged": 3, "expired": 2, "ops_failed": [] }

Web3 Tools

Read-only on-chain lookups across Ethereum, Polygon, Base, and Solana — token balances, transaction status, NFT metadata, and ENS resolution — via the same MCP server. These tools never sign or send transactions. Both Bearer auth and x402 walk-up are supported.

Pricing

Prices shown in US cents (¢). Per call.

Tools

Called via JSON-RPC tools/call at https://mcp.llm4agents.com/mcp. Supported chain values: "ethereum", "polygon", "base", "solana". Example:

Copy{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "token_balance",
    "arguments": { "chain": "base", "address": "0xabc...", "token": "0xUSDC..." }
  }
}

Copy{ "chain": "base", "address": "0xabc...", "balance": "12.5", "symbol": "USDC", "decimals": 6 }

Copy{ "status": "confirmed", "block": 12345678, "confirmations": 42 }

Copy{ "name": "...", "image": "https://...", "attributes": [{ "trait_type": "...", "value": "..." }] }

Copy{ "query": "vitalik.eth", "direction": "forward", "result": "0xd8dA6BF2..." }

Document Tools

Extract text and structured data from documents — parse PDFs, pull tables/cells from Office and CSV files, and convert articles to reader-mode markdown — via the same MCP server. PDF and office extraction read from a workspace file or a URL.

Pricing

Prices shown in US cents (¢).

Tools

Called via JSON-RPC tools/call at https://mcp.llm4agents.com/mcp. Example:

Copy{
  "jsonrpc": "2.0",
  "id": 1,
  "method": "tools/call",
  "params": {
    "name": "pdf_parse",
    "arguments": { "url": "https://example.com/report.pdf", "pages": "1-5" }
  }
}

Copy{ "pages": 5, "text": "...extracted text...", "costCents": 3 }

Copy{ "format": "xlsx", "units": 2, "data": [ ... ], "costCents": 1 }

Copy{ "title": "...", "byline": "...", "markdown": "# Title\n\n...", "word_count": 1240 }

Gasless Stablecoin Transfers (non-custodial)

Send stablecoin transfers on Polygon from your own EOA without holding any native MATIC. You bring the private key; the platform only validates the signatures you produce and relays them to Vexo's StablecoinForwarder. The service is free — the platform holds no funds, signs nothing, and charges nothing. Your API key is used solely to tag the request for rate-limit and audit. Logged as transactions.type = "gas_sponsored" with amount_usd_cents = 0.

Two-step flow

1. POST /v1/tx/quote — ask the relay for fee + nonces + typed data

   Send {chain, token, from, to, amount}. The platform fetches the current Vexo relayer fee (action: "fee-quote"), reads the on-chain nonces(from) from the token and the forwarder, and returns the full EIP-712 payloads (Permit + TransferPermit) pre-filled for you, plus a deadline 10 minutes out. No signatures yet.

2. Sign both typed-data objects locally with your wallet

   Use ethers.Wallet.signTypedData(domain, types, message) (or any EIP-712 signer) on typedData.permit and typedData.transferPermit. Split each raw signature into {v, r, s}. The platform never sees your key.

3. POST /v1/tx/send — submit the signed bundle

   Echo chain, token, from, to, amount, fee, deadline, nonces from the quote and add permitSig + transferPermitSig. The platform re-derives each EIP-712 digest, runs ecrecover, and forwards to Vexo's action: "transfer" only if both recovered signers match from. Vexo broadcasts on-chain and returns the txHash.

What the platform does & does not do

Supported chains & tokens

Example: USDC transfer with your own wallet

Two requests (/quote, /send) bracketing local signing.

Copyimport { ethers } from 'ethers';

const wallet = new ethers.Wallet(process.env.USER_PRIVATE_KEY);
const base = 'https://api.llm4agents.com';
const headers = {
  'Authorization': `Bearer ${process.env.PROXY_KEY}`,
  'Content-Type': 'application/json',
};

// 1. Ask the relay for fee + nonces + typed data
const q = await fetch(`${base}/v1/tx/quote`, {
  method: 'POST', headers,
  body: JSON.stringify({
    chain: 'polygon', token: 'USDC',
    from: wallet.address,
    to: '0xd8dA6BF26964aF9D7eEd9e03E53415D37aA96045',
    amount: '1.50',
  }),
}).then(r => r.json());

// 2. Sign both typed-data objects locally
const signEip712 = async (td) => {
  const { EIP712Domain, ...types } = td.types; // ethers wants types without EIP712Domain
  const raw = await wallet.signTypedData(td.domain, types, td.message);
  const s = ethers.Signature.from(raw);
  return { v: s.v, r: s.r, s: s.s };
};
const permitSig = await signEip712(q.typedData.permit);
const transferPermitSig = await signEip712(q.typedData.transferPermit);

// 3. Submit signed bundle
const tx = await fetch(`${base}/v1/tx/send`, {
  method: 'POST', headers,
  body: JSON.stringify({
    chain: q.chain, token: q.token, from: q.from, to: q.to, amount: q.amount,
    fee: q.fee, deadline: q.deadline, nonces: q.nonces,
    permitSig, transferPermitSig,
  }),
}).then(r => r.json());

console.log(`Sent: ${tx.txHash} (${tx.explorerUrl})`);

Copy# 1. Get the quote
curl https://api.llm4agents.com/v1/tx/quote \
  -H "Authorization: Bearer sk-proxy-..." \
  -H "Content-Type: application/json" \
  -d '{
    "chain": "polygon",
    "token": "USDC",
    "from": "0x9f...",
    "to": "0xd8dA6BF26964aF9D7eEd9e03E53415D37aA96045",
    "amount": "1.50"
  }'

# 2. Sign typedData.permit and typedData.transferPermit locally (out-of-band).

# 3. Submit the signed bundle
curl https://api.llm4agents.com/v1/tx/send \
  -H "Authorization: Bearer sk-proxy-..." \
  -H "Content-Type: application/json" \
  -d '{
    "chain": "polygon",
    "token": "USDC",
    "from": "0x9f...",
    "to": "0xd8dA6BF26964aF9D7eEd9e03E53415D37aA96045",
    "amount": "1.50",
    "fee": "50000",
    "deadline": 1756000000,
    "nonces": { "token": "3", "forwarder": "7" },
    "permitSig": { "v": 27, "r": "0x...", "s": "0x..." },
    "transferPermitSig": { "v": 28, "r": "0x...", "s": "0x..." }
  }'

Notes & gotchas

• You own the EOA. from must hold the USDC and the signatures. The platform has no key that can move your funds — not through this endpoint, not anywhere.
• The Vexo fee is paid in the same stablecoin by from, in addition to amount. Vexo collects it as part of the on-chain transfer; the platform does not touch it.
• deadline is 10 minutes. Sign promptly. If you sign after it passes, /send returns 400 expired_quote — just call /quote again.
• Gas spikes return 409 gasless_gas_spike. If Vexo's fee moved between your quote and your send, safe to retry from /quote.
• Signature recovery is strict. ecrecover on both signatures must equal the checksummed from; mismatches return 400 invalid_signature with the expected and recovered addresses.
• Timeouts may still land. 504 gasless_timeout means the upstream call didn't complete in time; the on-chain transfer can still confirm afterwards. Idempotency is the caller's responsibility.
• amount is a decimal string. JSON numbers lose precision; always pass a string like "1.50". Same for fee (uint base units) and nonces.*.

Billing

The API uses a reserve-proxy-settle pattern for each chat completion request:

1. Reserve

   Before each request, the estimated cost (based on input tokens + max output tokens) is reserved from your balance. If your balance is insufficient, the request is rejected with 402 insufficient_balance.

2. Proxy

   The request is forwarded to the LLM provider.

3. Settle

   After the response completes, the actual cost is calculated from real token counts. Any over-reserved amount is returned to your balance.

Pricing

Each model has per-token pricing (input and output) visible via GET /api/v1/models. These are the final prices you pay.

Billing Headers

Every chat completion response includes billing information in the response headers:

Models

Available models are synced from upstream providers and updated regularly. Use GET /api/v1/models to see current pricing and availability.

Model slugs follow the format: provider/model-name. Examples:

• anthropic/claude-3-haiku
• openai/gpt-4o
• google/gemini-pro
• meta-llama/llama-3-70b-instruct

You can use the search query parameter to filter models by name or slug.

Model Fallbacks

Send a prioritized list of models using the models parameter instead of model. If the primary model fails (rate limits, downtime, context length errors, moderation), the next model in the list is tried automatically.

How It Works

1. Send models array — provide 2-3 model slugs in priority order.
2. Automatic failover — if the first model fails, the next is tried seamlessly.
3. Check which model responded — the X-Model-Used response header tells you which model actually processed the request.

Rules

• models and model are mutually exclusive — use one or the other, not both.
• The array must contain 2 to 3 model slugs.
• All models must be active and approved in the platform.
• No duplicate slugs allowed.
• Billing reserves balance using the most expensive model in the list to prevent under-reservation. The final charge uses the model that actually responded.

Fallback Triggers

Fallback activates when the primary model encounters:

• Context length validation errors
• Rate limiting from the upstream provider
• Provider downtime or errors
• Content moderation rejections

Example

Copycurl https://api.llm4agents.com/v1/chat/completions \
  -H "Authorization: Bearer your-api-key" \
  -H "Content-Type: application/json" \
  -d '{
    "models": ["anthropic/claude-sonnet-4", "openai/gpt-4o"],
    "messages": [{"role": "user", "content": "Hello"}]
  }'

# Check which model responded:
# Response header X-Model-Used: anthropic/claude-sonnet-4

Copyfrom openai import OpenAI

client = OpenAI(
    base_url="https://api.llm4agents.com/v1",
    api_key="your-api-key"
)

response = client.chat.completions.with_raw_response.create(
    model="anthropic/claude-sonnet-4",
    messages=[{"role": "user", "content": "Hello"}],
    extra_body={
        "models": ["anthropic/claude-sonnet-4", "openai/gpt-4o"]
    }
)
print(response.headers["x-model-used"])

Copyimport OpenAI from 'openai';

const client = new OpenAI({
  baseURL: 'https://api.llm4agents.com/v1',
  apiKey: 'your-api-key',
});

const response = await client.chat.completions.create({
  model: 'anthropic/claude-sonnet-4',
  messages: [{ role: 'user', content: 'Hello' }],
}, {
  body: {
    models: ['anthropic/claude-sonnet-4', 'openai/gpt-4o'],
  },
});

OpenAI Compatibility

The /v1/chat/completions endpoint is fully compatible with OpenAI's API format. Any SDK or tool that supports OpenAI can use this API by changing the base_url.

Supported Parameters

• model -- model slug (required unless using models)
• models -- array of 2-3 model slugs for fallback routing (alternative to model)
• messages -- message array (required)
• temperature -- sampling temperature (0-2)
• max_tokens -- maximum output tokens
• stream -- enable Server-Sent Events streaming

Any additional fields in the request body are passed through to the upstream provider, allowing you to use provider-specific parameters.

SDK Examples

Copyfrom openai import OpenAI

client = OpenAI(
    base_url="https://api.llm4agents.com/v1",
    api_key="your-api-key"
)

# Streaming example
stream = client.chat.completions.create(
    model="openai/gpt-4o",
    messages=[{"role": "user", "content": "Explain quantum computing"}],
    stream=True
)
for chunk in stream:
    if chunk.choices[0].delta.content:
        print(chunk.choices[0].delta.content, end="")

Copyimport OpenAI from 'openai';

const client = new OpenAI({
  baseURL: 'https://api.llm4agents.com/v1',
  apiKey: 'your-api-key',
});

// Streaming example
const stream = await client.chat.completions.create({
  model: 'openai/gpt-4o',
  messages: [{ role: 'user', content: 'Explain quantum computing' }],
  stream: true,
});
for await (const chunk of stream) {
  process.stdout.write(chunk.choices[0]?.delta?.content ?? '');
}

Copycurl https://api.llm4agents.com/v1/chat/completions \
  -H "Authorization: Bearer your-api-key" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "openai/gpt-4o",
    "messages": [{"role": "user", "content": "Explain quantum computing"}],
    "temperature": 0.7,
    "max_tokens": 1000
  }'

Supported Chains

Send stablecoins to your generated deposit wallet address. Deposits are verified on-chain and credited to your LLM4Agents balance — the balance that funds LLM completions, scraper, search, and image tools. Gasless-transfer relayer fees are charged separately by Vexo from the agent's own EOA in the token being transferred and never debit the LLM4Agents balance.

Errors

All error responses include an error field with a machine-readable code and a message field with a human-readable description.

Copy{
  "error": "insufficient_balance",
  "message": "Not enough funds. Required: 15 cents, available: 3 cents",
  "requestId": "req_..."
}

Rate Limits

When rate limited, the API returns 429 Too Many Requests. Implement exponential backoff in your client.