LiteLLM Alternative — Self-Host and Verify It
A LiteLLM alternative that's self-hostable AND verifiable. Hardware-attested gateway proves the no-logging guarantee.
LiteLLM lets you self-host. TrustedRouter lets you self-host and prove it.
LiteLLM is a great open-source proxy: one OpenAI-compatible API across 100+ models, runs in your own infra. The gap is verification — once it's deployed, nobody outside your ops team can confirm what the running proxy actually does with a prompt.
TrustedRouter closes that gap. The gateway runs in hardware enclaves and signs the exact binary it's running, so the no-logging guarantee is cryptographically checkable — by you, your auditors, or your customers.
client = OpenAI(
base_url="https://api-azure.trustedrouter.com/v1",
api_key="sk-tr-v1-..."
)
# Drop-in for any LiteLLM proxy integration.
# Self-host TR too — your built image hash is the
# hash your enclave reports, so attestation holds.
Run it in your own VPC.
Like LiteLLM, the full stack is open source and self-hostable. Unlike LiteLLM, the deployment is attestable end to end.
Prove the no-log claim.
Build the image, deploy to a confidential VM, and the attestation reports your hash. Your security team verifies instead of trusting your runbook.
Or skip the ops entirely.
Don't want to run a proxy? Use the hosted attested gateway at api.trustedrouter.com — same verification, zero infra.
When "trust our deployment" isn't enough.
If your security review, your customers, or your regulator needs evidence — not assurances — that prompts aren't logged, a self-hosted proxy alone doesn't get you there. Attestation does.
Read the full argument: “Attestation is All You Need”.
Current routes, prices, privacy, and measured performance.
Catalog facts come from the routes currently configured in TrustedRouter. Performance uses the same cached metadata snapshot as the public leaderboard. Prompts and outputs are not part of these measurements.
| Model | Providers | Context | Input | Output | Privacy | Measured route |
|---|---|---|---|---|---|---|
Anthropic: Claude Opus 4.8anthropic/claude-opus-4.8 |
3 routes | 1,000,000 | $5.25/1M | $26.25/1M | varies 5 cited scores | 1598 ms TTFT anthropic · 100.00% available · n=5 |
OpenAI: GPT-5.5openai/gpt-5.5 |
4 routes | 1,050,000 | $5.25/1M | $31.5/1M | ZDR 3 cited scores | Warming up |
Google: Gemini 3.5 Flashgoogle/gemini-3.5-flash |
7 routes | 1,048,576 | $1.575/1M | $9.45/1M | ZDR | measured google-ai-studio · 0.00% available · n=14 |
MoonshotAI: Kimi K2.7 Codemoonshotai/kimi-k2.7-code |
19 routes | 262,144 | $0.735/1M to $0.9975/1M | $3.675/1M to $4.2/1M | ZDR 5 cited scores | measured inceptron · 0.00% available · n=14 |
Z.ai: GLM 5.2z-ai/glm-5.2 |
45 routes | 1,048,576 | $0.714/1M to $1.575/1M | $1.575/1M to $5.5125/1M | E2EE 4 cited scores | measured engy · 0.00% available · n=73 |
MiniMax: MiniMax M3minimax/minimax-m3 |
21 routes | 1,048,576 | $0.2835/1M to $0.63/1M | $1.155/1M to $2.52/1M | ZDR 4 cited scores | 2056 ms TTFT wafer · 100.00% available · n=21 |
Browse every modelReview provider policiesOpen the full leaderboardSnapshot 2026-08-05T02:34:40Z