What is the fastest AI API?

There is no single fastest AI API. As of September 08, 2026, 3 different providers hold the lead across 4 measured regions: Asia (Tokyo) — fireworks (22 ms), Europe (Germany) — google (98 ms), South America (São Paulo) — openrouter (58 ms), US (Central) — google (40 ms). The fastest API for you is the one closest to your users, not the one that wins a benchmark run from a single location.

Which AI API is fastest in each region?

RegionFastest APIp50 TTFB p95UptimeSamples
Asia (Tokyo)fireworks22 ms70 ms100%288
Europe (Germany)google98 ms202 ms100%288
South America (São Paulo)openrouter58 ms95 ms100%287
US (Central)google40 ms105 ms100%287

Edge latency (time-to-first-byte), last 24 hours, measured directly against each provider’s API host. Full ranking per region →

Why is there no single fastest AI API?

The same provider is not equally fast everywhere. sambanova responds in 24 ms from Asia (Tokyo) but 396 ms from Europe (Germany) — a 16.9× difference for the identical API, driven by where the request originates.

ProviderFastestfrom SlowestfromSpread
sambanova24 msAsia (Tokyo)396 msEurope (Germany)16.9×
fireworks22 msAsia (Tokyo)252 msSouth America (São Paulo)11.4×
upstage58 msAsia (Tokyo)599 msSouth America (São Paulo)10.3×
glm92 msAsia (Tokyo)552 msSouth America (São Paulo)6.0×
aleph-alpha99 msEurope (Germany)539 msAsia (Tokyo)5.5×
nscale99 msEurope (Germany)499 msAsia (Tokyo)5.1×
nebius100 msEurope (Germany)497 msAsia (Tokyo)5.0×
qwen152 msAsia (Tokyo)699 msSouth America (São Paulo)4.6×
siliconflow44 msUS (Central)201 msEurope (Germany)4.6×
novita75 msUS (Central)297 msEurope (Germany)4.0×

Providers measured in all 4 regions, ranked by how much their latency varies by origin. This is the part a single-location benchmark cannot show.

How should I use this?

Pick the provider that is fastest from where your traffic originates, not the one that tops a global list. If you serve users in several regions, the tables above will often point at different providers for each — that is a real result, not noise. Edge latency is the floor: it is what you pay before the model generates a single token, on every request, and no amount of prompt tuning removes it.

Is this time to first token or time to first byte?

Every figure on this page is time to first byte (TTFB), also called edge latency: DNS, TCP, TLS and the first response byte, measured without calling a model. It is the floor you pay on every request. Time to first token (TTFT) — how long a real streamed completion takes to emit its first token — additionally includes queueing and the model’s prefill, so it depends far more on which model you call than on the provider.

Both are measured here and never averaged together. Measured TTFT per provider and region, with the model named on every row and the network share of TTFT broken out, is on the time to first token page.

Compare two specific providers

Each pair below has its own page with latency per region, observed uptime and the worst region for each provider — the head-to-head form of the tables above.

Where does this data come from?

Independent probes in 4 regions measure 45 AI inference APIs every five minutes and publish the result automatically. No provider pays for placement and nothing is ranked by commission. The full method, including its limitations, is on the methodology page; the underlying numbers are available as JSON under CC BY 4.0.