Measure Pricing and Performance

Use this guide to compare cost and speed across routes, understand the metrics Phaseo displays, and design a workload study before you move production traffic.

Start with the decision

Choose the metric that matches the user experience you are protecting.

Workload	Start with	Why
Chat, copilots, and voice	Gateway TTFT	Users notice how quickly useful output begins.
Long answers and code generation	Output speed	Sustained generation speed dominates longer responses.
Tools and structured workflows	Gateway E2E	Routing, retries, and orchestration affect the complete result.
Batch or offline work	Cost and effective throughput	A slower start may be acceptable when total throughput and spend matter more.

No single score proves that a model is the best choice for every workload.

Compare pricing

Provider price sheets use different units: per token, per million tokens, per image, per second, per minute, or per request. Phaseo keeps the underlying unit and normalizes comparable prices for catalog views and the pricing calculator. For text models, compare input, cached input, cache write, reasoning, and output meters separately when they are present. For media models, keep the native billing unit visible; a per-second video price should not be presented as though it were a token price.

Catalog pricing is evidence for estimating a request, not a quote for every possible payload. Provider tiers, regional offers, batch pricing, cache behavior, and request-specific meters can change the final amount.

Use the pricing calculator for a representative payload, then confirm the charged amount in Gateway usage after a test request.

Understand the performance metrics

Phaseo records operational timing for requests routed through the Gateway.

Metric	Definition
Gateway TTFT	Gateway request start to the first content-bearing generated output.
Provider TTFT	Selected provider dispatch to the first content-bearing generated output.
Provider duration	Selected provider dispatch to the terminal response.
Gateway E2E	Gateway request start to completion.
Phaseo overhead	`max(0, Gateway E2E - provider duration)`.
Effective throughput	All output tokens divided by full provider duration.
Output speed	Output tokens after the first divided by provider time after TTFT.
TPOT / ITL	Request-level average time per token after the first output.

TTFT, output speed, TPOT, and ITL require a streaming response with a content-bearing first output. Metadata-only stream frames do not count. Non-streaming responses can still contribute provider duration, Gateway E2E, and effective throughput without an invented TTFT. Phaseo overhead isolates time outside the selected provider call. It can include Gateway processing, routing work, retries, and network effects. It is not a fixed platform constant and should be read as a distribution over a defined window.

Read operational data correctly

Performance pages summarize live Gateway traffic. They are observational measurements, not controlled benchmark runs and not intrinsic properties of a model. Results can move because of:

provider and route selection
Cloudflare execution location and network path
provider queueing or regional load
prompt and output length
streaming versus non-streaming behavior
retries, cancellations, and tool calls
model or provider updates during the selected window

Public charts can expose percentiles such as P50, P90, P95, and P99. For latency, lower is better. For throughput, higher is better, so a lower throughput percentile describes the slow tail. Always record the selected time window, route, region, sample filters, and percentile beside a result. Do not compare two screenshots with different windows as though they were the same study.

Run a reproducible workload study

Use public telemetry to narrow the candidates, then validate the finalists with your own prompt mix.

Choose two or three routable models from the default GET /v1/models response.
Create a sanitized prompt set that represents short, typical, and long requests.
Fix the endpoint, region, streaming mode, provider constraints, and concurrency.
Run repeated requests for each prompt instead of relying on one sample.
Capture request ID, selected provider, success or error, output tokens, Gateway TTFT, provider duration, Gateway E2E, Phaseo overhead, and cost.
Compare distributions and failure modes, then keep the raw results with the test configuration.

Example result schema:

{
  "study_id": "support-summary-v1",
  "model": "<verified-model-id>",
  "endpoint": "responses",
  "stream": true,
  "region": "<execution-region>",
  "request_id": "req_...",
  "gateway_ttft_ms": 0,
  "provider_duration_ms": 0,
  "gateway_e2e_ms": 0,
  "phaseo_overhead_ms": 0,
  "output_tokens": 0,
  "cost_usd": 0,
  "status": "completed"
}

The zero values are placeholders. Publish measured values only with the workload definition, sample count, time window, and permission to disclose the data.

What Phaseo does not claim

Catalog presence does not mean a model is routable. Use the default active availability filter.
Public operational telemetry does not guarantee future latency or uptime.
A benchmark score does not establish production quality for your prompt mix.
An illustrative UI profile is not a live model measurement.
A customer quote, logo, or workload result should not be published without permission and supporting evidence.

Next steps

Check reliability and status

Check incidents, current model routability, metric definitions, and failure triage.

Compare models

Compare pricing, metadata, and available performance signals side by side.

Inspect model routes

Inspect provider routes, capabilities, availability state, and pricing for one model.

Review benchmark methodology

Understand how benchmark sources and scores are normalized separately from Gateway telemetry.

Overview

Models & Routing

Features

Integrations

Workspace & Access

Reliability & Operations

Platform & Research

Migration Guides

Community

Measure Pricing and Performance

Start with the decision

Compare pricing

Understand the performance metrics

Read operational data correctly

Run a reproducible workload study

What Phaseo does not claim

Next steps

Check reliability and status

Compare models

Inspect model routes

Review benchmark methodology

​Start with the decision

​Compare pricing

​Understand the performance metrics

​Read operational data correctly

​Run a reproducible workload study

​What Phaseo does not claim

​Next steps

Check reliability and status

Compare models

Inspect model routes

Review benchmark methodology

Start with the decision

Compare pricing

Understand the performance metrics

Read operational data correctly

Run a reproducible workload study

What Phaseo does not claim

Next steps