Discovered servers

Drag the ⠿ handle or use ▲▼ to set priority (1 = preferred for proxy routing & failover).
+ Add a server manually
0
Proxied requests
0
Succeeded
0
Failed

Top servers (by requests)

Top models (by requests)

Request log

Every proxied request and the server it was routed to.
TimeModelRouted toClient→ServerStreamStatusLatencyTry

Benchmark results

Run benchmarks from the Servers tab. Tokens/sec measured from a streamed completion.
TimeServerModelTokens/secTTFTTotalTokensResult

Settings

Account

Signed in as . This admin account was created on first run.

Proxy API key

Require an API key on the proxy endpoints (/api/* and /v1/*). Off by default.