OpenAI compatible API · Attested · Public status

LiteLLM Alternative — Self-Host and Verify It

A LiteLLM alternative that's self-hostable AND verifiable. Hardware-attested gateway proves the no-logging guarantee.

Verify gateway
Onebase URL to migrate
100sof models and routes
0prompt or output logs. Always.
LiteLLM alternative

LiteLLM lets you self-host. TrustedRouter lets you self-host and prove it.

LiteLLM is a great open-source proxy: one OpenAI-compatible API across 100+ models, runs in your own infra. The gap is verification — once it's deployed, nobody outside your ops team can confirm what the running proxy actually does with a prompt.

TrustedRouter closes that gap. The gateway runs in hardware enclaves and signs the exact binary it's running, so the no-logging guarantee is cryptographically checkable — by you, your auditors, or your customers.

Try the playground How verification works

Same OpenAI-compatible shapePython
client = OpenAI(
    base_url="https://api-azure.trustedrouter.com/v1",
    api_key="sk-tr-v1-..."
)
# Drop-in for any LiteLLM proxy integration.
# Self-host TR too — your built image hash is the
# hash your enclave reports, so attestation holds.
Self-host

Run it in your own VPC.

Like LiteLLM, the full stack is open source and self-hostable. Unlike LiteLLM, the deployment is attestable end to end.

Verifiable

Prove the no-log claim.

Build the image, deploy to a confidential VM, and the attestation reports your hash. Your security team verifies instead of trusting your runbook.

Hosted option

Or skip the ops entirely.

Don't want to run a proxy? Use the hosted attested gateway at api.trustedrouter.com — same verification, zero infra.

LiteLLMTrustedRouter
Open sourceYesYes
Self-hostYesYes
Hosted optionLiteLLM CloudAttested hosted gateway
Verifiable runtimeNo — trust your deployYes — hardware attestation
No-log guaranteeConfigurableStructural + verifiable in source
Best fitTeams that want a self-hosted proxyTeams that must prove what the proxy does
When to choose TR over LiteLLM

When "trust our deployment" isn't enough.

If your security review, your customers, or your regulator needs evidence — not assurances — that prompts aren't logged, a self-hosted proxy alone doesn't get you there. Attestation does.

Read the full argument: “Attestation is All You Need”.

Live catalog evidence

Current routes, prices, privacy, and measured performance.

Catalog facts come from the routes currently configured in TrustedRouter. Performance uses the same cached metadata snapshot as the public leaderboard. Prompts and outputs are not part of these measurements.

392public models
49providers
1270configured routes
250ZDR routes
8provider E2EE routes
887recent availability samples
Model Providers Context Input Output Privacy Measured route
Anthropic: Claude Opus 4.8anthropic/claude-opus-4.8
3 routes
1,000,000 $5.25/1M $26.25/1M varies 5 cited scores 1598 ms TTFT anthropic · 100.00% available · n=5
OpenAI: GPT-5.5openai/gpt-5.5
4 routes
1,050,000 $5.25/1M $31.5/1M ZDR 3 cited scores Warming up
Google: Gemini 3.5 Flashgoogle/gemini-3.5-flash
+1
7 routes
1,048,576 $1.575/1M $9.45/1M ZDR measured google-ai-studio · 0.00% available · n=14
MoonshotAI: Kimi K2.7 Codemoonshotai/kimi-k2.7-code
+8
19 routes
262,144 $0.735/1M to $0.9975/1M $3.675/1M to $4.2/1M ZDR 5 cited scores measured inceptron · 0.00% available · n=14
Z.ai: GLM 5.2z-ai/glm-5.2
+22
45 routes
1,048,576 $0.714/1M to $1.575/1M $1.575/1M to $5.5125/1M E2EE 4 cited scores measured engy · 0.00% available · n=73
MiniMax: MiniMax M3minimax/minimax-m3
+8
21 routes
1,048,576 $0.2835/1M to $0.63/1M $1.155/1M to $2.52/1M ZDR 4 cited scores 2056 ms TTFT wafer · 100.00% available · n=21
AnthropicPolicy varies 12 models 1807 ms p50 · n=24
GMI CloudPolicy varies 53 models 2549 ms p50 · n=12
OpenAIZDR on prepaid 33 models 1337 ms p50 · n=26
Atlas CloudPolicy varies 73 models measured · n=22
Google AI StudioPolicy varies 11 models measured · n=24
Google Vertex AIZDR on prepaid 9 models measured · n=24
Lightning AIPolicy varies 17 models 1471 ms p50 · n=20
KimiPolicy varies 11 models 1386 ms p50 · n=19

Browse every modelReview provider policiesOpen the full leaderboardSnapshot 2026-08-05T02:34:40Z

Workspace access

Sign in

Choose a sign in method to access your TrustedRouter workspace.

By signing in you agree to the terms of service and privacy policy.