Free to start
Meta: Llama 3.3 70B Instruct Performance
Try Llama 3.3 70B Instruct on us. Starter credit covers your first requests, then one key reaches all 10 provider routes with automatic failover.
meta-llama/llama-3.3-70b-instruct
open weights
Performance
Provider diversity
10 routes.
More routes give the auto router more room to fail over around provider 429 and 5xx responses.
Streaming
Gateway overhead is measured separately.
Public status separates TLS/health overhead from full model latency so slow LLMs do not inflate the router metric.
Status
Metadata rollups.
Status samples store latency, outcome, provider, model, route, cost, and region metadata only.
View public status or inspect provider routes.