LLM Gateway

One API for every LLM

OpenAI-compatible. Drop-in for any SDK. Your keys, your budgets, your spend — managed from one dashboard. Built-in playground, model hub, and admin panel come included.

Everything you need to run LLMs in production

A managed proxy, a virtual key per org, a cost dashboard, and a playground — all wired into your smooai workspace, all OpenAI-API compatible.

Nine labs, one endpoint

OpenAI, Anthropic, Google Gemini, Groq, plus direct connections to Alibaba DashScope (Qwen), DeepSeek, Moonshot (Kimi), Z.AI (GLM), and MiniMax — all behind one OpenAI-compatible URL. Switch models with a string change, no client SDK swap, no aggregator markup.

Keys you can manage

Each org gets a virtual API key — visible in the dashboard, rotatable in one click, scoped to your org without leaking master credentials.

Live cost tracking

Every request lands in a spend log. See month-to-date total, per-model breakdown, and a 30-day chart in your smooai dashboard. No surprise invoices.

Built-in playground

Hit any model from a chat UI without writing code. SSO from your smooai login — no separate auth, no separate workspace.

Model hub

Browse every available model with capabilities + per-token pricing. Pick the right model for the job, from a single discovery page.

Sub-100ms admin overhead

Direct calls to the gateway — no middleware proxy, no Lambda cold start, no extra hop. The virtual key authenticates LiteLLM-native.

Stop guessing your LLM bill

Every request lands in a per-org spend log within seconds. Set budgets, watch trend lines, and get warned before a single team's experiment turns into next quarter's surprise.

Monthly budget caps per org

Hard cap or soft alert. Hits the limit, requests start returning 429 — not a sticker-shock invoice.

Per-model breakdown

Which model burned how much, by team, by day. Catch a runaway prompt before it eats your AI budget.

Single bill, every model

No more aggregating five vendor invoices. We bill once monthly through Stripe — pass it to finance unchanged.

Audit-friendly logs

Every prompt + response + cost is captured. SOC 2 evidence collection is one CSV export away.

Quickstart

Sign up, create a virtual key from your dashboard, drop it in. Same SDKs, same shapes — just a different base URL. Full endpoint docs live in the API reference.

curl
curl https://llm.smoo.ai/v1/chat/completions \
  -H "Authorization: Bearer $SMOOAI_LLM_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "claude-haiku-4-5",
    "messages": [{"role": "user", "content": "ping"}]
  }'
typescript
import OpenAI from 'openai';

const client = new OpenAI({
  apiKey: process.env.SMOOAI_LLM_KEY,
  baseURL: 'https://llm.smoo.ai/v1',
});

const resp = await client.chat.completions.create({
  model: 'claude-haiku-4-5',
  messages: [{ role: 'user', content: 'ping' }],
});
console.log(resp.choices[0].message.content);
Full model catalog

Every frontier model, one invoice

11 direct providers — no aggregator markup on primary routes. Bring the model your team already knows and pick by capability, benchmark, and price — every model is exposed directly through llm.smoo.ai.

Full catalog by provider

Every model each of our 11 direct providers publishes, routed through llm.smoo.ai. Prices are per million tokens in USD.

Last refreshed 2026-06-01

OpenAI

Workhorse utility tier + frontier GPT-5 when you need it

Pricing source ↗
ModelIDInput / MTokOutput / MTok
GPT-5.5 Pro
Frontier reasoning tier — GA 2026-04-24
VisionMultimodal
gpt-5.5-pro$30.00$180.00
GPT-5.5
Current OpenAI flagship — GA 2026-04-24
VisionMultimodalSWE-bench 82.6%
gpt-5.5$5.00$30.00
GPT-5.4
Mid-frontier 5.4 — between gpt-5 and gpt-5.5
VisionMultimodal
gpt-5.4$2.50$15.00
GPT-5.4 mini
Cheaper smart-tier 5.4 sibling
gpt-5.4-mini$0.75$4.50
GPT-5.4 nano
Ultra-cheap 5.4 nano
gpt-5.4-nano$0.20$1.25
GPT-5.4 Pro
GPT-5.4 Pro reasoning tier
VisionMultimodal
gpt-5.4-pro$30.00$180.00
GPT-5.2
GPT-5.2 — mid-tier between 5.1 and 5.4
VisionMultimodalSWE-bench 80%GPQA 92.4%
gpt-5.2$1.75$14.00
GPT-5.2 Codex
GPT-5.2 with Codex-coding training
VisionMultimodal
gpt-5.2-codex$1.75$14.00
GPT-5.2 Pro
GPT-5.2 Pro reasoning tier
VisionMultimodal
gpt-5.2-pro$21.00$168.00
GPT-5.1
GPT-5.1 — refined GPT-5 family entry
VisionMultimodal
gpt-5.1$1.25$10.00
GPT-5.1 Codex
GPT-5.1 with Codex-coding training
VisionMultimodal
gpt-5.1-codex$1.25$10.00
GPT-5
Frontier reasoning + tool use
VisionMultimodalSWE-bench 74.9%
gpt-5$2.50$10.00
GPT-5 Pro
GPT-5 Pro reasoning tier
VisionMultimodalGPQA 89.4%
gpt-5-pro$15.00$120.00
GPT-5 Codex
GPT-5 with Codex-coding training
VisionMultimodal
gpt-5-codex$1.25$10.00
GPT-5 mini
Cheap moderation + cost-floor utility
gpt-5-mini$0.50$2.00
GPT-5 nano
Cheapest GPT-5 variant
gpt-5-nano$0.20$1.25
GPT-4.1
1M-context instruction following
VisionMultimodal
gpt-4.1$2.00$8.00
GPT-4.1 mini
Cheap long-context extraction
gpt-4.1-mini$0.40$1.60
GPT-4.1 nano
Cost-floor 1M-context classification
gpt-4.1-nano$0.10$0.40
GPT-4o
Multimodal (vision + audio) legacy
VisionMultimodal
gpt-4o$2.50$10.00
GPT-4o mini
Multimodal at near-embedding cost
gpt-4o-mini$0.15$0.60
o4-mini
Cheap reasoning-trace-visible o-series
o4-mini$1.10$4.40
o3
o-series reasoning — visible chain-of-thought
VisionMultimodal
o3$2.00$8.00
o3-mini
Cheaper o3 sibling
o3-mini$1.10$4.40
o3-pro
o3 Pro — extended reasoning tier
VisionMultimodal
o3-pro$20.00$80.00

Anthropic

Safety-tuned reasoning — strict refusal lineage + prompt caching

Pricing source ↗
ModelIDInput / MTokOutput / MTok
Claude Opus 4.8
Current Anthropic flagship — 1M ctx, ~4× less likely to slip flaws than 4.7 (GA 2026-05-28)
VisionMultimodalAA Index 61
claude-opus-4-8$5.00$25.00
Claude Opus 4.7
Prior flagship — SWE-bench Pro 64.3%, GA 2026-04-16
VisionMultimodal
claude-opus-4-7$5.00$25.00
Claude Opus 4.6
Prior frontier — kept for pinned prompts
VisionMultimodalSWE-bench 80.8%GPQA 90.5%
claude-opus-4-6$15.00$75.00
Claude Sonnet 4.6
1M-context balanced workhorse
VisionMultimodalSWE-bench 79.6%GPQA 89.3%
claude-sonnet-4-6$3.00$15.00
Claude Sonnet 4.5
Stable predecessor Sonnet
VisionMultimodal
claude-sonnet-4-5$3.00$15.00
Claude Haiku 4.5
597ms TTFT — safety-tuned utility tier
claude-haiku-4-5$1.00$5.00

Google

1M-context recall + dialable thinking budgets

Pricing source ↗
ModelIDInput / MTokOutput / MTok
Gemini 3.5 Flash
Current Google flagship Flash — GA 2026-05-19, 76.2% Terminal-Bench 2.1
gemini-3.5-flash$1.50$9.00
Gemini 2.5 Pro
Frontier reasoning + 1M multimodal
gemini-2.5-pro$1.25$10.00
Gemini 2.5 Flash
IFEval leader in cheap Gemini tier — 1M context for summarization + planning
gemini-2.5-flash$0.30$2.50
Gemini 2.5 Flash-Lite
Cost-floor utility tier (Google)
gemini-2.5-flash-lite$0.10$0.40
Gemini 2.0 Flash
Legacy low-latency tier
gemini-2.0-flash$0.10$0.40
Gemini 2.0 Flash-Lite
Ultra-cheap 2.x utility-tier sibling
gemini-2.0-flash-lite
Gemini 3 Flash (preview)
Next-gen Flash — 3/3 PASS on CS escalation E2E
gemini-3-flash-preview
Gemini 3.1 Flash-Lite
GA Flash-Lite — 2.1s TTFT latency champion, voice-pipeline candidate (promoted from preview 2026-05-29)
gemini-3.1-flash-lite
Gemini 3.1 Flash-Lite (preview)
Preview alias retained for pinned callers — use stable above for new code
gemini-3.1-flash-lite-preview
Gemini 3 Pro (preview)
Next-gen Pro — preview pricing TBD
gemini-3-pro-preview
Gemini 3.1 Pro (preview)
Next-gen Pro refresh — preview pricing TBD
GPQA 94.3%
gemini-3.1-pro-preview
gemini-flash-latest (alias)
Always-current stable Flash
gemini-flash-latest
gemini-flash-lite-latest (alias)
Always-current stable Flash-Lite
gemini-flash-lite-latest
gemini-pro-latest (alias)
Always-current stable Pro
gemini-pro-latest
Gemini Embedding 002
First natively multimodal embedding — text + images + video + audio, Matryoshka 3072/1536/768 dims (GA 2026-04-23)
Embeddings
gemini-embedding-002
Gemini Embedding 001
3072-dim text embeddings — kept for index compatibility
Embeddings
gemini-embedding-001$0.15

Groq

Open-weight models on sub-second LPU inference

Pricing source ↗
ModelIDInput / MTokOutput / MTok
GPT-OSS 120B
Open-weight GPT — smart/judge tier; single-turn validated (no parallel tool calls)
groq-gpt-oss-120b$0.15$0.60
GPT-OSS 20B
Cheap open-weight GPT — fast/voice/eval tier (reasoning_effort: low for sub-second TTFT)
groq-gpt-oss-20b$0.10$0.30
Qwen3.6 27B (Preview)
Tool-calling / agentic tier — supports parallel tool calls (gpt-oss cannot); Preview, no SLA
Agentic
groq-qwen3.6-27b$0.80$3.00
GPT-OSS Safeguard 20B
Safety-tuned open-weight GPT
groq-gpt-oss-safeguard-20b$0.10$0.30
Groq Compound (agentic)
Multi-tool agentic system — web search + code exec built in
groq-compound
Groq Compound Mini (agentic)
Single-tool agentic — ~3× lower latency than full Compound
groq-compound-mini

DeepSeek

Frontier reasoning at rock-bottom per-token cost

Pricing source ↗
ModelIDInput / MTokOutput / MTok
DeepSeek V4-Flash
1M context, dual Thinking/Non-Thinking modes
CodingReasoningAgenticSWE-bench 79%
deepseek-v4-flash$0.14$0.28
DeepSeek V4-Pro
Pro-tier V4 — 75% intro discount through 2026-05-31
CodingReasoningAgenticSWE-bench 79.4%AA Index 52
deepseek-v4-pro$0.43$0.87
deepseek-chat (legacy alias → V4-Flash)
Legacy alias — routes to V4-Flash; retiring 2026-07-24
CodingReasoning
deepseek-chat$0.14$0.28
deepseek-reasoner (legacy alias → V4-Pro)
Legacy alias — routes to V4-Pro; retiring 2026-07-24
ReasoningThinking
deepseek-reasoner$0.43$0.87
DeepSeek V3.2 (aggregator)
Aggregator-routed V3.2 — emergency failover only
CodingReasoning
deepseek-v3.2$0.27$1.10
DeepSeek R1 (aggregator)
Aggregator-routed R1 reasoner — emergency failover only
ReasoningThinking
deepseek-r1$0.55$2.19

Moonshot

Kimi family — purpose-trained for agentic loops

Pricing source ↗
ModelIDInput / MTokOutput / MTok
Kimi K2.6
Current Kimi flagship — ties GPT-5.5 on SWE-Bench Pro, GA 2026-04-20
CodingReasoningAgenticSWE-bench 80.2%AA Index 54
kimi-k2.6-direct$0.95$4.00
Kimi K2-Thinking
Deepest reasoner in the Kimi line
CodingReasoningThinkingAgentic
kimi-k2-thinking-direct$0.60$2.50
Kimi K2.5
Prior general-purpose Kimi
CodingReasoningAgentic
kimi-k2.5-direct$0.60$2.50
Kimi K2-Thinking (aggregator)
Aggregator-routed K2-Thinking — emergency failover only
CodingReasoningThinkingAgentic
kimi-k2-thinking$0.60$2.50
Kimi K2.5 (aggregator)
Aggregator-routed K2.5 — emergency failover only
CodingReasoningAgentic
kimi-k2.5$0.60$2.50

Alibaba DashScope

Qwen family — 1M context at aggressive pricing

Pricing source ↗
ModelIDInput / MTokOutput / MTok
Qwen 3.7 Max
Current Qwen flagship — agent-first, 200 tok/s, SWE-Pro/Terminal-Bench tier winner (GA 2026-05-20)
ReasoningAgenticSWE-bench 80.4%
qwen-3.7-max-direct$2.50$7.50
Qwen 3.6 Plus
Generalist Qwen flagship — GA 2026-04-02, 1M context
qwen-3.6-plus-direct$0.33$1.95
Qwen3-Coder-Flash
Bench-winning coder — 16/16 aider-polyglot PASS
CodingAgenticTools
qwen3-coder-flash-direct$0.30$1.50
Qwen3-Coder-Plus
PR-review tuned for large diffs
CodingAgenticTools
qwen3-coder-plus-direct$1.00$5.00
Qwen3-235B-Thinking-2507
Cheapest thinking-mode reasoning
qwen3-235b-a22b-thinking-2507$0.13$0.60
Qwen3-Coder-Plus (aggregator)
Aggregator-routed Coder-Plus — emergency failover only
CodingAgenticTools
qwen3-coder-plus$1.00$5.00
Qwen3-Coder-Flash (aggregator)
Aggregator-routed Coder-Flash — emergency failover only
CodingAgenticTools
qwen3-coder-flash$0.30$1.50

Z.ai (Zhipu)

GLM family — SOTA on SWE-bench Pro

Pricing source ↗
ModelIDInput / MTokOutput / MTok
GLM 5.1
58.4% SWE-Pro — coder-forward (GA 2026-04-07)
CodingReasoningAgenticAA Index 51
glm-5.1-direct$0.60$2.20
GLM 5
Faster GLM (78 tok/s vs 5.1's 54) — GA 2026-02-11
CodingReasoningAgentic
glm-5-direct$0.60$1.92
GLM 5.1 (aggregator)
Aggregator-routed GLM 5.1 — emergency failover only
CodingReasoningAgenticAA Index 51
glm-5.1$0.60$2.20

MiniMax

Cheapest frontier-class coder + reviewer

Pricing source ↗
ModelIDInput / MTokOutput / MTok
MiniMax M2.7
Current MiniMax flagship — same price as M2
CodingAgenticReviewSWE-bench 78%
minimax-m2.7-direct$0.30$1.20
MiniMax M2.7 Highspeed
~100 tps throughput-optimized variant
CodingAgenticReview
minimax-m2.7-highspeed-direct$0.60$2.40
MiniMax M2
Frontier-class reviewer at $0.30 input
CodingAgenticReview
minimax-m2-direct$0.30$1.20
MiniMax M2.7 (aggregator)
Aggregator-routed M2.7 — emergency failover only
CodingAgenticReviewSWE-bench 78%
minimax-m2.7$0.30$1.20
MiniMax M2.5 (aggregator)
Aggregator-routed M2.5 — emergency failover only
CodingAgenticReview
minimax-m2.5$0.30$1.20

Xiaomi MiMo

Long-context (1M) models with an ultra-cheap flash tier

Pricing source ↗
ModelIDInput / MTokOutput / MTok
MiMo V2.5 Pro
Flagship 1M-context reasoning + coding
VisionMultimodal
mimo-v2.5-pro$0.20$0.80
MiMo V2.5
Cheaper 1M-context generalist
VisionMultimodal
mimo-v2.5$0.08$0.80
MiMo V2 Pro
Prior flagship — auto-routes to V2.5 from 2026-06-01
mimo-v2-pro$0.20$0.80
MiMo V2 Flash
Ultra-cheap 256K flash tier ($0.01/M input)
mimo-v2-flash$0.01$0.80
MiMo V2 Omni
Multimodal (text + vision + audio) — pricing TBD
mimo-v2-omni
MiMo V2 TTS
Text-to-speech — MiMo audio endpoint, not the chat gateway
mimo-v2-tts
MiMo V2.5 TTS
Text-to-speech — MiMo audio endpoint, not the chat gateway
mimo-v2.5-tts
MiMo V2.5 TTS Voiceclone
Voice-cloning TTS — MiMo audio endpoint, not the chat gateway
mimo-v2.5-tts-voiceclone
MiMo V2.5 TTS Voicedesign
Voice-design TTS — MiMo audio endpoint, not the chat gateway
mimo-v2.5-tts-voicedesign

ElevenLabs

TTS for the voice pipeline

Pricing source ↗
ModelIDInput / MTokOutput / MTok
Eleven Multilingual v2
High-fidelity multilingual TTS
Speech
elevenlabs-tts

Pricing is indicative — vendors change rates without notice. Routing + fallbacks auto-adjust against each provider's live pricing via LiteLLM. See API reference for the authoritative model list your key can hit right now.

Built for compliance

LLM data lives in an isolated database schema, invisible to the public REST API. RLS policies enforce that org members only see their org's keys + spend. No data leakage paths to design around.

Schema-isolated by design

Spend logs and key metadata live in a separate Postgres schema not exposed to PostgREST. The anon API key cannot reach LLM data — at all.

Org-scoped access

Row-level security: every read of a key or spend log enforces "your user is a member of this org" at the database layer. Defense in depth.

Drop us in — keep your code

Already using the OpenAI SDK? Point its base URL at https://llm.smoo.ai/v1 and you're done. No rewrite, no abstraction layer.

Start free