Is the baseten API down? Live status, latency & uptime by region
Last verified October 21, 2026 · rebuilt about every 30 minutes
Is the baseten API down right now? Reachable from all 4 regions
Last successful probe Oct 21, 17:46 UTC · every 5 minutes from 4 region(s) · status feed checked Oct 21, 17:17 UTC
Every probe from every region reached the baseten API successfully in the last 72 hours. Measured from outside baseten’s own network, independently of its status page; full log: measured AI API incidents .
Real requests: not measured for baseten — only the API host is probed here, so errors limited to specific models are invisible to these probes. That is exactly what a status page tends to report, hence the line below.
baseten’s status page lists no open incident (checked Oct 21, 17:17 UTC); its 4 entries from the last 72 hours are listed below.
As of October 21, 2026, the baseten AI API responds in 47 ms p50 (edge, time-to-first-byte) from US (Central) — its fastest measured region — with 100% uptime. Slowest is Europe (Germany) at 199 ms p50.
Endpoint response (TTFB), 24 h
47 ms
Typical (p50) from US (Central), the fastest region
Uptime, 24 h
100%
1,153 probes across 4 region(s)
Failed probes, 72 h
0
of 3,459 probes, all regions
Reported by baseten, 72 h
4
on status.baseten.co
Was baseten down in the last 3 days?
No. All 3,459 probes from 4 region(s) reached the baseten API in the last 72 hours. baseten’s own status page reported 4 incident(s) in the same window, listed below.
Earlier days with baseten incidents: Oct 20 (status page) · Oct 9 (status page) · Oct 6 (status page) · Sep 29 (status page) · Sep 24 (status page) · Sep 21 (status page) · Sep 20 (status page) · Sep 15 (status page)
Show this live in your README: — embed code
What baseten’s own status page reported
Self-reported by baseten, checked Oct 21, 17:17 UTC; not verified by our probes. Errors on individual models are visible only from inside the provider.
Is baseten getting faster or slower?
Endpoint response (TTFB) · milliseconds · lower is faster
Last 72 hours · UTC · newest time on the right · current hour is incomplete.
Each line shows a region’s typical response per hour (p50), using the same scale. A gap means no successful timed probe in that hour.
typical response per hour (p50) all probes succeeded some failed (under half) half or more failed no probes recorded
baseten — hourly p50 edge latency (ms) and probe outcomes per region, last 72 hours Endpoint response time in milliseconds. Lower is faster. Each region uses the same vertical scale from 0 to 400 ms. Lines show hourly p50 values; gaps have no successful timed probes. Outcome counts are listed after this chart. Oct 19 Oct 20 Oct 21 now Oct 18, 18:00 UTC
Europe (Germany): typical 201 ms (p50 TTFB)
US (Central): typical 48 ms (p50 TTFB)
Asia (Tokyo): typical 166 ms (p50 TTFB)
South America (São Paulo): typical 161 ms (p50 TTFB) Oct 18, 19:00 UTC
Europe (Germany): typical 200 ms (p50 TTFB)
US (Central): typical 47 ms (p50 TTFB)
Asia (Tokyo): typical 171 ms (p50 TTFB)
South America (São Paulo): typical 159 ms (p50 TTFB) Oct 18, 20:00 UTC
Europe (Germany): typical 199 ms (p50 TTFB)
US (Central): typical 49 ms (p50 TTFB)
Asia (Tokyo): typical 161 ms (p50 TTFB)
South America (São Paulo): typical 158 ms (p50 TTFB) Oct 18, 21:00 UTC
Europe (Germany): typical 200 ms (p50 TTFB)
US (Central): typical 44 ms (p50 TTFB)
Asia (Tokyo): typical 168 ms (p50 TTFB)
South America (São Paulo): typical 157 ms (p50 TTFB) Oct 18, 22:00 UTC
Europe (Germany): typical 198 ms (p50 TTFB)
US (Central): typical 45 ms (p50 TTFB)
Asia (Tokyo): typical 176 ms (p50 TTFB)
South America (São Paulo): typical 156 ms (p50 TTFB) Oct 18, 23:00 UTC
Europe (Germany): typical 203 ms (p50 TTFB)
US (Central): typical 43 ms (p50 TTFB)
Asia (Tokyo): typical 172 ms (p50 TTFB)
South America (São Paulo): typical 152 ms (p50 TTFB) Oct 19, 00:00 UTC
Europe (Germany): typical 200 ms (p50 TTFB)
US (Central): typical 48 ms (p50 TTFB)
Asia (Tokyo): typical 167 ms (p50 TTFB)
South America (São Paulo): typical 149 ms (p50 TTFB) Oct 19, 01:00 UTC
Europe (Germany): typical 203 ms (p50 TTFB)
US (Central): typical 46 ms (p50 TTFB)
Asia (Tokyo): typical 157 ms (p50 TTFB)
South America (São Paulo): typical 153 ms (p50 TTFB) Oct 19, 02:00 UTC
Europe (Germany): typical 200 ms (p50 TTFB)
US (Central): typical 47 ms (p50 TTFB)
Asia (Tokyo): typical 179 ms (p50 TTFB)
South America (São Paulo): typical 153 ms (p50 TTFB) Oct 19, 03:00 UTC
Europe (Germany): typical 200 ms (p50 TTFB)
US (Central): typical 47 ms (p50 TTFB)
Asia (Tokyo): typical 176 ms (p50 TTFB)
South America (São Paulo): typical 153 ms (p50 TTFB) Oct 19, 04:00 UTC
Europe (Germany): typical 203 ms (p50 TTFB)
US (Central): typical 47 ms (p50 TTFB)
Asia (Tokyo): typical 172 ms (p50 TTFB)
South America (São Paulo): typical 153 ms (p50 TTFB) Oct 19, 05:00 UTC
Europe (Germany): typical 201 ms (p50 TTFB)
US (Central): typical 49 ms (p50 TTFB)
Asia (Tokyo): typical 181 ms (p50 TTFB)
South America (São Paulo): typical 156 ms (p50 TTFB) Oct 19, 06:00 UTC
Europe (Germany): typical 199 ms (p50 TTFB)
US (Central): typical 48 ms (p50 TTFB)
Asia (Tokyo): typical 174 ms (p50 TTFB)
South America (São Paulo): typical 158 ms (p50 TTFB) Oct 19, 07:00 UTC
Europe (Germany): typical 201 ms (p50 TTFB)
US (Central): typical 47 ms (p50 TTFB)
Asia (Tokyo): typical 166 ms (p50 TTFB)
South America (São Paulo): typical 149 ms (p50 TTFB) Oct 19, 08:00 UTC
Europe (Germany): typical 198 ms (p50 TTFB)
US (Central): typical 46 ms (p50 TTFB)
Asia (Tokyo): typical 161 ms (p50 TTFB)
South America (São Paulo): typical 158 ms (p50 TTFB) Oct 19, 09:00 UTC
Europe (Germany): typical 202 ms (p50 TTFB)
US (Central): typical 46 ms (p50 TTFB)
Asia (Tokyo): typical 171 ms (p50 TTFB)
South America (São Paulo): typical 157 ms (p50 TTFB) Oct 19, 10:00 UTC
Europe (Germany): typical 200 ms (p50 TTFB)
US (Central): typical 50 ms (p50 TTFB)
Asia (Tokyo): typical 170 ms (p50 TTFB)
South America (São Paulo): typical 151 ms (p50 TTFB) Oct 19, 11:00 UTC
Europe (Germany): typical 199 ms (p50 TTFB)
US (Central): typical 49 ms (p50 TTFB)
Asia (Tokyo): typical 162 ms (p50 TTFB)
South America (São Paulo): typical 155 ms (p50 TTFB) Oct 19, 12:00 UTC
Europe (Germany): typical 199 ms (p50 TTFB)
US (Central): typical 49 ms (p50 TTFB)
Asia (Tokyo): typical 172 ms (p50 TTFB)
South America (São Paulo): typical 152 ms (p50 TTFB) Oct 19, 13:00 UTC
Europe (Germany): typical 195 ms (p50 TTFB)
US (Central): typical 48 ms (p50 TTFB)
Asia (Tokyo): typical 166 ms (p50 TTFB)
South America (São Paulo): typical 158 ms (p50 TTFB) Oct 19, 14:00 UTC
Europe (Germany): typical 199 ms (p50 TTFB)
US (Central): typical 46 ms (p50 TTFB)
Asia (Tokyo): typical 167 ms (p50 TTFB)
South America (São Paulo): typical 153 ms (p50 TTFB) Oct 19, 15:00 UTC
Europe (Germany): typical 198 ms (p50 TTFB)
US (Central): typical 46 ms (p50 TTFB)
Asia (Tokyo): typical 171 ms (p50 TTFB)
South America (São Paulo): typical 159 ms (p50 TTFB) Oct 19, 16:00 UTC
Europe (Germany): typical 201 ms (p50 TTFB)
US (Central): typical 48 ms (p50 TTFB)
Asia (Tokyo): typical 167 ms (p50 TTFB)
South America (São Paulo): typical 159 ms (p50 TTFB) Oct 19, 17:00 UTC
Europe (Germany): typical 197 ms (p50 TTFB)
US (Central): typical 47 ms (p50 TTFB)
Asia (Tokyo): typical 171 ms (p50 TTFB)
South America (São Paulo): typical 153 ms (p50 TTFB) Oct 19, 18:00 UTC
Europe (Germany): typical 197 ms (p50 TTFB)
US (Central): typical 47 ms (p50 TTFB)
Asia (Tokyo): typical 165 ms (p50 TTFB)
South America (São Paulo): typical 157 ms (p50 TTFB) Oct 19, 19:00 UTC
Europe (Germany): typical 294 ms (p50 TTFB)
US (Central): typical 52 ms (p50 TTFB)
Asia (Tokyo): typical 166 ms (p50 TTFB)
South America (São Paulo): typical 156 ms (p50 TTFB) Oct 19, 20:00 UTC
Europe (Germany): typical 194 ms (p50 TTFB)
US (Central): typical 47 ms (p50 TTFB)
Asia (Tokyo): typical 176 ms (p50 TTFB)
South America (São Paulo): typical 152 ms (p50 TTFB) Oct 19, 21:00 UTC
Europe (Germany): typical 200 ms (p50 TTFB)
US (Central): typical 48 ms (p50 TTFB)
Asia (Tokyo): typical 168 ms (p50 TTFB)
South America (São Paulo): typical 158 ms (p50 TTFB) Oct 19, 22:00 UTC
Europe (Germany): typical 201 ms (p50 TTFB)
US (Central): typical 45 ms (p50 TTFB)
Asia (Tokyo): typical 180 ms (p50 TTFB)
South America (São Paulo): typical 151 ms (p50 TTFB) Oct 19, 23:00 UTC
Europe (Germany): typical 203 ms (p50 TTFB)
US (Central): typical 48 ms (p50 TTFB)
Asia (Tokyo): typical 177 ms (p50 TTFB)
South America (São Paulo): typical 155 ms (p50 TTFB) Oct 20, 00:00 UTC
Europe (Germany): typical 199 ms (p50 TTFB)
US (Central): typical 45 ms (p50 TTFB)
Asia (Tokyo): typical 170 ms (p50 TTFB)
South America (São Paulo): typical 153 ms (p50 TTFB) Oct 20, 01:00 UTC
Europe (Germany): typical 206 ms (p50 TTFB)
US (Central): typical 42 ms (p50 TTFB)
Asia (Tokyo): typical 166 ms (p50 TTFB)
South America (São Paulo): typical 151 ms (p50 TTFB) Oct 20, 02:00 UTC
Europe (Germany): typical 201 ms (p50 TTFB)
US (Central): typical 48 ms (p50 TTFB)
Asia (Tokyo): typical 172 ms (p50 TTFB)
South America (São Paulo): typical 152 ms (p50 TTFB) Oct 20, 03:00 UTC
Europe (Germany): typical 198 ms (p50 TTFB)
US (Central): typical 43 ms (p50 TTFB)
Asia (Tokyo): typical 174 ms (p50 TTFB)
South America (São Paulo): typical 150 ms (p50 TTFB) Oct 20, 04:00 UTC
Europe (Germany): typical 198 ms (p50 TTFB)
US (Central): typical 45 ms (p50 TTFB)
Asia (Tokyo): typical 170 ms (p50 TTFB)
South America (São Paulo): typical 152 ms (p50 TTFB) Oct 20, 05:00 UTC
Europe (Germany): typical 202 ms (p50 TTFB)
US (Central): typical 46 ms (p50 TTFB)
Asia (Tokyo): typical 169 ms (p50 TTFB)
South America (São Paulo): typical 149 ms (p50 TTFB) Oct 20, 06:00 UTC
Europe (Germany): typical 200 ms (p50 TTFB)
US (Central): typical 47 ms (p50 TTFB)
Asia (Tokyo): typical 173 ms (p50 TTFB)
South America (São Paulo): typical 152 ms (p50 TTFB) Oct 20, 07:00 UTC
Europe (Germany): typical 207 ms (p50 TTFB)
US (Central): typical 43 ms (p50 TTFB)
Asia (Tokyo): typical 169 ms (p50 TTFB)
South America (São Paulo): typical 158 ms (p50 TTFB) Oct 20, 08:00 UTC
Europe (Germany): typical 197 ms (p50 TTFB)
US (Central): typical 47 ms (p50 TTFB)
Asia (Tokyo): typical 161 ms (p50 TTFB)
South America (São Paulo): typical 159 ms (p50 TTFB) Oct 20, 09:00 UTC
Europe (Germany): typical 198 ms (p50 TTFB)
US (Central): typical 47 ms (p50 TTFB)
Asia (Tokyo): typical 154 ms (p50 TTFB)
South America (São Paulo): typical 156 ms (p50 TTFB) Oct 20, 10:00 UTC
Europe (Germany): typical 198 ms (p50 TTFB)
US (Central): typical 48 ms (p50 TTFB)
Asia (Tokyo): typical 170 ms (p50 TTFB)
South America (São Paulo): typical 157 ms (p50 TTFB) Oct 20, 11:00 UTC
Europe (Germany): typical 199 ms (p50 TTFB)
US (Central): typical 47 ms (p50 TTFB)
Asia (Tokyo): typical 156 ms (p50 TTFB)
South America (São Paulo): typical 155 ms (p50 TTFB) Oct 20, 12:00 UTC
Europe (Germany): typical 200 ms (p50 TTFB)
US (Central): typical 47 ms (p50 TTFB)
Asia (Tokyo): typical 172 ms (p50 TTFB)
South America (São Paulo): typical 151 ms (p50 TTFB) Oct 20, 13:00 UTC
Europe (Germany): typical 202 ms (p50 TTFB)
US (Central): typical 48 ms (p50 TTFB)
Asia (Tokyo): typical 166 ms (p50 TTFB)
South America (São Paulo): typical 156 ms (p50 TTFB) Oct 20, 14:00 UTC
Europe (Germany): typical 199 ms (p50 TTFB)
US (Central): typical 51 ms (p50 TTFB)
Asia (Tokyo): typical 166 ms (p50 TTFB)
South America (São Paulo): typical 158 ms (p50 TTFB) Oct 20, 15:00 UTC
Europe (Germany): typical 202 ms (p50 TTFB)
US (Central): typical 48 ms (p50 TTFB)
Asia (Tokyo): typical 164 ms (p50 TTFB)
South America (São Paulo): typical 160 ms (p50 TTFB) Oct 20, 16:00 UTC
Europe (Germany): typical 195 ms (p50 TTFB)
US (Central): typical 48 ms (p50 TTFB)
Asia (Tokyo): typical 162 ms (p50 TTFB)
South America (São Paulo): typical 162 ms (p50 TTFB) Oct 20, 17:00 UTC
Europe (Germany): typical 204 ms (p50 TTFB)
US (Central): typical 49 ms (p50 TTFB)
Asia (Tokyo): typical 174 ms (p50 TTFB)
South America (São Paulo): typical 164 ms (p50 TTFB) Oct 20, 18:00 UTC
Europe (Germany): typical 202 ms (p50 TTFB)
US (Central): typical 49 ms (p50 TTFB)
Asia (Tokyo): typical 176 ms (p50 TTFB)
South America (São Paulo): typical 164 ms (p50 TTFB) Oct 20, 19:00 UTC
Europe (Germany): typical 194 ms (p50 TTFB)
US (Central): typical 52 ms (p50 TTFB)
Asia (Tokyo): typical 176 ms (p50 TTFB)
South America (São Paulo): typical 157 ms (p50 TTFB) Oct 20, 20:00 UTC
Europe (Germany): typical 200 ms (p50 TTFB)
US (Central): typical 49 ms (p50 TTFB)
Asia (Tokyo): typical 172 ms (p50 TTFB)
South America (São Paulo): typical 154 ms (p50 TTFB) Oct 20, 21:00 UTC
Europe (Germany): typical 200 ms (p50 TTFB)
US (Central): typical 46 ms (p50 TTFB)
Asia (Tokyo): typical 176 ms (p50 TTFB)
South America (São Paulo): typical 158 ms (p50 TTFB) Oct 20, 22:00 UTC
Europe (Germany): typical 198 ms (p50 TTFB)
US (Central): typical 44 ms (p50 TTFB)
Asia (Tokyo): typical 175 ms (p50 TTFB)
South America (São Paulo): typical 157 ms (p50 TTFB) Oct 20, 23:00 UTC
Europe (Germany): typical 201 ms (p50 TTFB)
US (Central): typical 50 ms (p50 TTFB)
Asia (Tokyo): typical 167 ms (p50 TTFB)
South America (São Paulo): typical 154 ms (p50 TTFB) Oct 21, 00:00 UTC
Europe (Germany): typical 200 ms (p50 TTFB)
US (Central): typical 47 ms (p50 TTFB)
Asia (Tokyo): typical 165 ms (p50 TTFB)
South America (São Paulo): typical 160 ms (p50 TTFB) Oct 21, 01:00 UTC
Europe (Germany): typical 199 ms (p50 TTFB)
US (Central): typical 45 ms (p50 TTFB)
Asia (Tokyo): typical 176 ms (p50 TTFB)
South America (São Paulo): typical 157 ms (p50 TTFB) Oct 21, 02:00 UTC
Europe (Germany): typical 198 ms (p50 TTFB)
US (Central): typical 45 ms (p50 TTFB)
Asia (Tokyo): typical 165 ms (p50 TTFB)
South America (São Paulo): typical 157 ms (p50 TTFB) Oct 21, 03:00 UTC
Europe (Germany): typical 197 ms (p50 TTFB)
US (Central): typical 48 ms (p50 TTFB)
Asia (Tokyo): typical 168 ms (p50 TTFB)
South America (São Paulo): typical 152 ms (p50 TTFB) Oct 21, 04:00 UTC
Europe (Germany): typical 199 ms (p50 TTFB)
US (Central): typical 45 ms (p50 TTFB)
Asia (Tokyo): typical 165 ms (p50 TTFB)
South America (São Paulo): typical 155 ms (p50 TTFB) Oct 21, 05:00 UTC
Europe (Germany): typical 199 ms (p50 TTFB)
US (Central): typical 46 ms (p50 TTFB)
Asia (Tokyo): typical 165 ms (p50 TTFB)
South America (São Paulo): typical 154 ms (p50 TTFB) Oct 21, 06:00 UTC
Europe (Germany): typical 199 ms (p50 TTFB)
US (Central): typical 50 ms (p50 TTFB)
Asia (Tokyo): typical 175 ms (p50 TTFB)
South America (São Paulo): typical 158 ms (p50 TTFB) Oct 21, 07:00 UTC
Europe (Germany): typical 198 ms (p50 TTFB)
US (Central): typical 47 ms (p50 TTFB)
Asia (Tokyo): typical 174 ms (p50 TTFB)
South America (São Paulo): typical 153 ms (p50 TTFB) Oct 21, 08:00 UTC
Europe (Germany): typical 199 ms (p50 TTFB)
US (Central): typical 46 ms (p50 TTFB)
Asia (Tokyo): typical 173 ms (p50 TTFB)
South America (São Paulo): typical 154 ms (p50 TTFB) Oct 21, 09:00 UTC
Europe (Germany): typical 201 ms (p50 TTFB)
US (Central): typical 49 ms (p50 TTFB)
Asia (Tokyo): typical 162 ms (p50 TTFB)
South America (São Paulo): typical 152 ms (p50 TTFB) Oct 21, 10:00 UTC
Europe (Germany): typical 196 ms (p50 TTFB)
US (Central): typical 48 ms (p50 TTFB)
Asia (Tokyo): typical 162 ms (p50 TTFB)
South America (São Paulo): typical 157 ms (p50 TTFB) Oct 21, 11:00 UTC
Europe (Germany): typical 200 ms (p50 TTFB)
US (Central): typical 46 ms (p50 TTFB)
Asia (Tokyo): typical 157 ms (p50 TTFB)
South America (São Paulo): typical 157 ms (p50 TTFB) Oct 21, 12:00 UTC
Europe (Germany): typical 203 ms (p50 TTFB)
US (Central): typical 48 ms (p50 TTFB)
Asia (Tokyo): typical 171 ms (p50 TTFB)
South America (São Paulo): typical 151 ms (p50 TTFB) Oct 21, 13:00 UTC
Europe (Germany): typical 199 ms (p50 TTFB)
US (Central): typical 48 ms (p50 TTFB)
Asia (Tokyo): typical 168 ms (p50 TTFB)
South America (São Paulo): typical 151 ms (p50 TTFB) Oct 21, 14:00 UTC
Europe (Germany): typical 202 ms (p50 TTFB)
US (Central): typical 45 ms (p50 TTFB)
Asia (Tokyo): typical 166 ms (p50 TTFB)
South America (São Paulo): typical 158 ms (p50 TTFB) Oct 21, 15:00 UTC
Europe (Germany): typical 199 ms (p50 TTFB)
US (Central): typical 48 ms (p50 TTFB)
Asia (Tokyo): typical 174 ms (p50 TTFB)
South America (São Paulo): typical 153 ms (p50 TTFB) Oct 21, 16:00 UTC
Europe (Germany): typical 201 ms (p50 TTFB)
US (Central): typical 47 ms (p50 TTFB)
Asia (Tokyo): typical 178 ms (p50 TTFB)
South America (São Paulo): typical 158 ms (p50 TTFB) Oct 21, 17:00 UTC
Europe (Germany): typical 201 ms (p50 TTFB)
US (Central): typical 48 ms (p50 TTFB)
Asia (Tokyo): typical 176 ms (p50 TTFB)
South America (São Paulo): typical 157 ms (p50 TTFB) 400 0 Oct 18, 18:00 – Oct 21, 17:00 UTC: all 864 probes succeeded 400 0 Oct 18, 18:00 – Oct 21, 17:00 UTC: all 862 probes succeeded 400 0 Oct 18, 18:00 – Oct 21, 17:00 UTC: all 862 probes succeeded 400 0 Oct 18, 18:00 – Oct 21, 17:00 UTC: all 862 probes succeeded Europe (Germany) latest 201 · median 200 ms US (Central) latest 48 · median 47 ms Asia (Tokyo) latest 176 · median 170 ms South America (São Paulo) latest 157 · median 156 ms Probe counts by region Europe (Germany) : 0 failed / 864 endpoint probesUS (Central) : 0 failed / 862 endpoint probesAsia (Tokyo) : 0 failed / 862 endpoint probesSouth America (São Paulo) : 0 failed / 862 endpoint probes
Chart details The strip shows endpoint probe outcomes, not model-request success. Adjacent hours with all successes or no data are joined. Hover an hour for its recorded values.
Latest is the most recent hourly p50 with data. Median is the median of hourly p50 values over these 72 hours. The “slower than usual” label means latest is at least 25% above that median; it is a relative change, not a fixed speed rating.
How fast is the baseten API from each region?
Endpoint response (TTFB) · last 24 hours · milliseconds (ms) · lower is faster.
How to read these metrics Endpoint response (TTFB) Network connection and the first response byte, without model inference.
Typical · p50 50% of successful timed samples finish within this time.
Slower · p95 95% of successful timed samples finish within this time.
Region Typical (p50 TTFB) Slower (p95) Uptime Asia (Tokyo) 169 ms 195 ms 100% Europe (Germany) 199 ms 303 ms 100% South America (São Paulo) 155 ms 171 ms 100% US (Central) 47 ms 60 ms 100%
Measured from US (Central), baseten responds in 47 ms; from Europe (Germany) the same API takes 199 ms — 4.3× longer for an identical request. That difference is the network path, not the model, and it applies to every call you make.
What is actually being measured here?
A probe in each region opens a real connection to baseten’s own API host every five
minutes and times DNS resolution, the TCP handshake, the TLS handshake and the first byte of the
response. Nothing is routed through a gateway or aggregator, so these figures describe
baseten’s infrastructure rather than a reseller’s. Uptime counts a probe as failed only when the
service genuinely fails — a 401 from an unauthenticated probe means the endpoint answered
correctly and is counted as up.
What this page does not tell you
These are edge latency numbers: the time before the model begins generating. They
say nothing about answer quality, throughput, price, or how long a full completion takes — those
depend on the model you call. Edge latency matters because it is unavoidable: it is paid on every
request, before a single token exists, and no prompt engineering removes it. Where an API key is
available, inference time-to-first-token is measured separately and shown on the region pages with the
model named next to the figure. Likewise, an unauthenticated probe cannot see errors that hit only some
models or some accounts — the kind a status page usually reports — which is why baseten’s
own reports are shown next to the measurements rather than folded into them.