AI Latency Tracker · Fastest AI API · Time to first token · Uptime · Incidents · Alerts · Price vs latency · Adoption · Reports Methodology · Deprecations · Migrations · Glossary · Data · Changelog
groq — AI API latency & reliability by region
Last verified September 07, 2026
As of September 07, 2026, the groq AI API responds in 118 ms p50 (edge, time-to-first-byte) from US (Central) — its fastest measured region — with 100% uptime. Slowest is Europe (Germany) at 297 ms p50.
Is groq down right now? Reachable from all 4 regions, requests to openai/gpt-oss-120b succeeding
Last successful probe Sep 7, 02:17 UTC · every 5 minutes from 4 region(s) · status feed checked Sep 7, 02:17 UTC
Every probe from every region reached the groq API successfully in the last 72 hours. Measured from outside groq’s own network, independently of its status page; full log: measured AI API incidents .
Real requests to openai/gpt-oss-120b: 288 of 288 succeeded in the last 24 hours from 4 region(s); none failed in the last 72 hours. A one-token completion is sent on the same schedule as the host probe; 5xx, 529 and timeouts count as failures, problems with our own key or quota are excluded.
Groq’s status page lists no open incident (checked Sep 7, 02:17 UTC).
Edge latency, 24 h
118 ms
p50 from US (Central), the fastest region
Uptime, 24 h
100%
1,152 probes across 4 region(s)
Failed probes, 72 h
0
of 3,456 probes, all regions
Failed requests, 24 h
0
of 288 to openai/gpt-oss-120b
Reported by Groq, 72 h
0
on groqstatus.com
Was groq down in the last 3 days?
No. All 3,456 probes from 4 region(s) reached the groq API in the last 72 hours.
What Groq’s own status page reported
Nothing. Groq’s status page lists no incident in the last 72 hours (checked Sep 7, 02:17 UTC).
Is groq getting faster or slower?
hourly p50 latency all probes succeeded some probes failed half or more failed no data
groq — hourly p50 edge latency (ms) and probe outcomes per region, last 72 hours Sep 5 Sep 6 now Sep 4, 03:00 UTC
Europe (Germany): 393 ms · model requests 3/3 ok
US (Central): 138 ms · model requests 3/3 ok
Asia (Tokyo): 131 ms · model requests 3/3 ok
South America (São Paulo): 218 ms · model requests 3/3 ok Sep 4, 04:00 UTC
Europe (Germany): 294 ms · model requests 3/3 ok
US (Central): 121 ms · model requests 3/3 ok
Asia (Tokyo): 157 ms · model requests 3/3 ok
South America (São Paulo): 227 ms · model requests 3/3 ok Sep 4, 05:00 UTC
Europe (Germany): 298 ms · model requests 3/3 ok
US (Central): 106 ms · model requests 3/3 ok
Asia (Tokyo): 148 ms · model requests 3/3 ok
South America (São Paulo): 235 ms · model requests 3/3 ok Sep 4, 06:00 UTC
Europe (Germany): 290 ms · model requests 3/3 ok
US (Central): 125 ms · model requests 3/3 ok
Asia (Tokyo): 141 ms · model requests 3/3 ok
South America (São Paulo): 228 ms · model requests 3/3 ok Sep 4, 07:00 UTC
Europe (Germany): 297 ms · model requests 3/3 ok
US (Central): 130 ms · model requests 3/3 ok
Asia (Tokyo): 156 ms · model requests 3/3 ok
South America (São Paulo): 226 ms · model requests 3/3 ok Sep 4, 08:00 UTC
Europe (Germany): 297 ms · model requests 3/3 ok
US (Central): 117 ms · model requests 3/3 ok
Asia (Tokyo): 158 ms · model requests 3/3 ok
South America (São Paulo): 232 ms · model requests 3/3 ok Sep 4, 09:00 UTC
Europe (Germany): 299 ms · model requests 3/3 ok
US (Central): 130 ms · model requests 3/3 ok
Asia (Tokyo): 139 ms · model requests 3/3 ok
South America (São Paulo): 235 ms · model requests 3/3 ok Sep 4, 10:00 UTC
Europe (Germany): 300 ms · model requests 3/3 ok
US (Central): 107 ms · model requests 3/3 ok
Asia (Tokyo): 138 ms · model requests 3/3 ok
South America (São Paulo): 227 ms · model requests 3/3 ok Sep 4, 11:00 UTC
Europe (Germany): 300 ms · model requests 3/3 ok
US (Central): 136 ms · model requests 3/3 ok
Asia (Tokyo): 151 ms · model requests 3/3 ok
South America (São Paulo): 232 ms · model requests 3/3 ok Sep 4, 12:00 UTC
Europe (Germany): 298 ms · model requests 3/3 ok
US (Central): 148 ms · model requests 3/3 ok
Asia (Tokyo): 157 ms · model requests 3/3 ok
South America (São Paulo): 249 ms · model requests 3/3 ok Sep 4, 13:00 UTC
Europe (Germany): 298 ms · model requests 3/3 ok
US (Central): 140 ms · model requests 3/3 ok
Asia (Tokyo): 151 ms · model requests 3/3 ok
South America (São Paulo): 240 ms · model requests 3/3 ok Sep 4, 14:00 UTC
Europe (Germany): 298 ms · model requests 3/3 ok
US (Central): 140 ms · model requests 3/3 ok
Asia (Tokyo): 150 ms · model requests 3/3 ok
South America (São Paulo): 238 ms · model requests 3/3 ok Sep 4, 15:00 UTC
Europe (Germany): 296 ms · model requests 3/3 ok
US (Central): 113 ms · model requests 3/3 ok
Asia (Tokyo): 156 ms · model requests 3/3 ok
South America (São Paulo): 240 ms · model requests 3/3 ok Sep 4, 16:00 UTC
Europe (Germany): 300 ms · model requests 3/3 ok
US (Central): 104 ms · model requests 3/3 ok
Asia (Tokyo): 148 ms · model requests 3/3 ok
South America (São Paulo): 244 ms · model requests 3/3 ok Sep 4, 17:00 UTC
Europe (Germany): 302 ms · model requests 3/3 ok
US (Central): 140 ms · model requests 3/3 ok
Asia (Tokyo): 164 ms · model requests 3/3 ok
South America (São Paulo): 237 ms · model requests 3/3 ok Sep 4, 18:00 UTC
Europe (Germany): 299 ms · model requests 3/3 ok
US (Central): 130 ms · model requests 3/3 ok
Asia (Tokyo): 137 ms · model requests 3/3 ok
South America (São Paulo): 234 ms · model requests 3/3 ok Sep 4, 19:00 UTC
Europe (Germany): 297 ms · model requests 3/3 ok
US (Central): 132 ms · model requests 3/3 ok
Asia (Tokyo): 132 ms · model requests 3/3 ok
South America (São Paulo): 236 ms · model requests 3/3 ok Sep 4, 20:00 UTC
Europe (Germany): 296 ms · model requests 3/3 ok
US (Central): 122 ms · model requests 3/3 ok
Asia (Tokyo): 142 ms · model requests 3/3 ok
South America (São Paulo): 242 ms · model requests 3/3 ok Sep 4, 21:00 UTC
Europe (Germany): 299 ms · model requests 3/3 ok
US (Central): 127 ms · model requests 3/3 ok
Asia (Tokyo): 131 ms · model requests 3/3 ok
South America (São Paulo): 228 ms · model requests 3/3 ok Sep 4, 22:00 UTC
Europe (Germany): 302 ms · model requests 3/3 ok
US (Central): 118 ms · model requests 3/3 ok
Asia (Tokyo): 145 ms · model requests 3/3 ok
South America (São Paulo): 231 ms · model requests 3/3 ok Sep 4, 23:00 UTC
Europe (Germany): 293 ms · model requests 3/3 ok
US (Central): 112 ms · model requests 3/3 ok
Asia (Tokyo): 133 ms · model requests 3/3 ok
South America (São Paulo): 257 ms · model requests 3/3 ok Sep 5, 00:00 UTC
Europe (Germany): 298 ms · model requests 3/3 ok
US (Central): 100 ms · model requests 3/3 ok
Asia (Tokyo): 151 ms · model requests 3/3 ok
South America (São Paulo): 241 ms · model requests 3/3 ok Sep 5, 01:00 UTC
Europe (Germany): 299 ms · model requests 3/3 ok
US (Central): 101 ms · model requests 3/3 ok
Asia (Tokyo): 150 ms · model requests 3/3 ok
South America (São Paulo): 236 ms · model requests 3/3 ok Sep 5, 02:00 UTC
Europe (Germany): 298 ms · model requests 3/3 ok
US (Central): 117 ms · model requests 3/3 ok
Asia (Tokyo): 137 ms · model requests 3/3 ok
South America (São Paulo): 252 ms · model requests 3/3 ok Sep 5, 03:00 UTC
Europe (Germany): 291 ms · model requests 3/3 ok
US (Central): 108 ms · model requests 3/3 ok
Asia (Tokyo): 137 ms · model requests 3/3 ok
South America (São Paulo): 230 ms · model requests 3/3 ok Sep 5, 04:00 UTC
Europe (Germany): 300 ms · model requests 3/3 ok
US (Central): 124 ms · model requests 3/3 ok
Asia (Tokyo): 159 ms · model requests 3/3 ok
South America (São Paulo): 238 ms · model requests 3/3 ok Sep 5, 05:00 UTC
Europe (Germany): 304 ms · model requests 3/3 ok
US (Central): 117 ms · model requests 3/3 ok
Asia (Tokyo): 148 ms · model requests 3/3 ok
South America (São Paulo): 233 ms · model requests 3/3 ok Sep 5, 06:00 UTC
Europe (Germany): 297 ms · model requests 3/3 ok
US (Central): 108 ms · model requests 3/3 ok
Asia (Tokyo): 139 ms · model requests 3/3 ok
South America (São Paulo): 228 ms · model requests 3/3 ok Sep 5, 07:00 UTC
Europe (Germany): 300 ms · model requests 3/3 ok
US (Central): 104 ms · model requests 3/3 ok
Asia (Tokyo): 148 ms · model requests 3/3 ok
South America (São Paulo): 240 ms · model requests 3/3 ok Sep 5, 08:00 UTC
Europe (Germany): 297 ms · model requests 3/3 ok
US (Central): 97 ms · model requests 3/3 ok
Asia (Tokyo): 131 ms · model requests 3/3 ok
South America (São Paulo): 220 ms · model requests 3/3 ok Sep 5, 09:00 UTC
Europe (Germany): 302 ms · model requests 3/3 ok
US (Central): 105 ms · model requests 3/3 ok
Asia (Tokyo): 145 ms · model requests 3/3 ok
South America (São Paulo): 237 ms · model requests 3/3 ok Sep 5, 10:00 UTC
Europe (Germany): 296 ms · model requests 3/3 ok
US (Central): 99 ms · model requests 3/3 ok
Asia (Tokyo): 132 ms · model requests 3/3 ok
South America (São Paulo): 234 ms · model requests 3/3 ok Sep 5, 11:00 UTC
Europe (Germany): 299 ms · model requests 3/3 ok
US (Central): 112 ms · model requests 3/3 ok
Asia (Tokyo): 140 ms · model requests 3/3 ok
South America (São Paulo): 239 ms · model requests 3/3 ok Sep 5, 12:00 UTC
Europe (Germany): 298 ms · model requests 3/3 ok
US (Central): 115 ms · model requests 3/3 ok
Asia (Tokyo): 120 ms · model requests 3/3 ok
South America (São Paulo): 218 ms · model requests 3/3 ok Sep 5, 13:00 UTC
Europe (Germany): 300 ms · model requests 3/3 ok
US (Central): 110 ms · model requests 3/3 ok
Asia (Tokyo): 148 ms · model requests 3/3 ok
South America (São Paulo): 218 ms · model requests 3/3 ok Sep 5, 14:00 UTC
Europe (Germany): 294 ms · model requests 3/3 ok
US (Central): 134 ms · model requests 3/3 ok
Asia (Tokyo): 158 ms · model requests 3/3 ok
South America (São Paulo): 232 ms · model requests 3/3 ok Sep 5, 15:00 UTC
Europe (Germany): 299 ms · model requests 3/3 ok
US (Central): 106 ms · model requests 3/3 ok
Asia (Tokyo): 157 ms · model requests 3/3 ok
South America (São Paulo): 229 ms · model requests 3/3 ok Sep 5, 16:00 UTC
Europe (Germany): 297 ms · model requests 3/3 ok
US (Central): 115 ms · model requests 3/3 ok
Asia (Tokyo): 139 ms · model requests 3/3 ok
South America (São Paulo): 232 ms · model requests 3/3 ok Sep 5, 17:00 UTC
Europe (Germany): 294 ms · model requests 3/3 ok
US (Central): 115 ms · model requests 3/3 ok
Asia (Tokyo): 142 ms · model requests 3/3 ok
South America (São Paulo): 236 ms · model requests 3/3 ok Sep 5, 18:00 UTC
Europe (Germany): 299 ms · model requests 3/3 ok
US (Central): 133 ms · model requests 3/3 ok
Asia (Tokyo): 154 ms · model requests 3/3 ok
South America (São Paulo): 239 ms · model requests 3/3 ok Sep 5, 19:00 UTC
Europe (Germany): 298 ms · model requests 3/3 ok
US (Central): 133 ms · model requests 3/3 ok
Asia (Tokyo): 159 ms · model requests 3/3 ok
South America (São Paulo): 238 ms · model requests 3/3 ok Sep 5, 20:00 UTC
Europe (Germany): 298 ms · model requests 3/3 ok
US (Central): 122 ms · model requests 3/3 ok
Asia (Tokyo): 154 ms · model requests 3/3 ok
South America (São Paulo): 226 ms · model requests 3/3 ok Sep 5, 21:00 UTC
Europe (Germany): 297 ms · model requests 3/3 ok
US (Central): 122 ms · model requests 3/3 ok
Asia (Tokyo): 137 ms · model requests 3/3 ok
South America (São Paulo): 237 ms · model requests 3/3 ok Sep 5, 22:00 UTC
Europe (Germany): 291 ms · model requests 3/3 ok
US (Central): 139 ms · model requests 3/3 ok
Asia (Tokyo): 148 ms · model requests 3/3 ok
South America (São Paulo): 234 ms · model requests 3/3 ok Sep 5, 23:00 UTC
Europe (Germany): 302 ms · model requests 3/3 ok
US (Central): 125 ms · model requests 3/3 ok
Asia (Tokyo): 149 ms · model requests 3/3 ok
South America (São Paulo): 238 ms · model requests 3/3 ok Sep 6, 00:00 UTC
Europe (Germany): 394 ms · model requests 3/3 ok
US (Central): 137 ms · model requests 3/3 ok
Asia (Tokyo): 143 ms · model requests 3/3 ok
South America (São Paulo): 232 ms · model requests 3/3 ok Sep 6, 01:00 UTC
Europe (Germany): 298 ms · model requests 3/3 ok
US (Central): 122 ms · model requests 3/3 ok
Asia (Tokyo): 152 ms · model requests 3/3 ok
South America (São Paulo): 238 ms · model requests 3/3 ok Sep 6, 02:00 UTC
Europe (Germany): 296 ms · model requests 3/3 ok
US (Central): 117 ms · model requests 3/3 ok
Asia (Tokyo): 134 ms · model requests 3/3 ok
South America (São Paulo): 229 ms · model requests 3/3 ok Sep 6, 03:00 UTC
Europe (Germany): 298 ms · model requests 3/3 ok
US (Central): 138 ms · model requests 3/3 ok
Asia (Tokyo): 154 ms · model requests 3/3 ok
South America (São Paulo): 229 ms · model requests 3/3 ok Sep 6, 04:00 UTC
Europe (Germany): 296 ms · model requests 3/3 ok
US (Central): 120 ms · model requests 3/3 ok
Asia (Tokyo): 161 ms · model requests 3/3 ok
South America (São Paulo): 238 ms · model requests 3/3 ok Sep 6, 05:00 UTC
Europe (Germany): 289 ms · model requests 3/3 ok
US (Central): 121 ms · model requests 3/3 ok
Asia (Tokyo): 136 ms · model requests 3/3 ok
South America (São Paulo): 225 ms · model requests 3/3 ok Sep 6, 06:00 UTC
Europe (Germany): 297 ms · model requests 3/3 ok
US (Central): 106 ms · model requests 3/3 ok
Asia (Tokyo): 130 ms · model requests 3/3 ok
South America (São Paulo): 230 ms · model requests 3/3 ok Sep 6, 07:00 UTC
Europe (Germany): 294 ms · model requests 3/3 ok
US (Central): 121 ms · model requests 3/3 ok
Asia (Tokyo): 146 ms · model requests 3/3 ok
South America (São Paulo): 246 ms · model requests 3/3 ok Sep 6, 08:00 UTC
Europe (Germany): 298 ms · model requests 3/3 ok
US (Central): 104 ms · model requests 3/3 ok
Asia (Tokyo): 148 ms · model requests 3/3 ok
South America (São Paulo): 218 ms · model requests 3/3 ok Sep 6, 09:00 UTC
Europe (Germany): 300 ms · model requests 3/3 ok
US (Central): 103 ms · model requests 3/3 ok
Asia (Tokyo): 131 ms · model requests 3/3 ok
South America (São Paulo): 223 ms · model requests 3/3 ok Sep 6, 10:00 UTC
Europe (Germany): 299 ms · model requests 3/3 ok
US (Central): 142 ms · model requests 3/3 ok
Asia (Tokyo): 151 ms · model requests 3/3 ok
South America (São Paulo): 224 ms · model requests 3/3 ok Sep 6, 11:00 UTC
Europe (Germany): 298 ms · model requests 3/3 ok
US (Central): 126 ms · model requests 3/3 ok
Asia (Tokyo): 138 ms · model requests 3/3 ok
South America (São Paulo): 235 ms · model requests 3/3 ok Sep 6, 12:00 UTC
Europe (Germany): 295 ms · model requests 3/3 ok
US (Central): 118 ms · model requests 3/3 ok
Asia (Tokyo): 153 ms · model requests 3/3 ok
South America (São Paulo): 242 ms · model requests 3/3 ok Sep 6, 13:00 UTC
Europe (Germany): 296 ms · model requests 3/3 ok
US (Central): 111 ms · model requests 3/3 ok
Asia (Tokyo): 149 ms · model requests 3/3 ok
South America (São Paulo): 226 ms · model requests 3/3 ok Sep 6, 14:00 UTC
Europe (Germany): 300 ms · model requests 3/3 ok
US (Central): 126 ms · model requests 3/3 ok
Asia (Tokyo): 154 ms · model requests 3/3 ok
South America (São Paulo): 230 ms · model requests 3/3 ok Sep 6, 15:00 UTC
Europe (Germany): 298 ms · model requests 3/3 ok
US (Central): 119 ms · model requests 3/3 ok
Asia (Tokyo): 167 ms · model requests 3/3 ok
South America (São Paulo): 222 ms · model requests 3/3 ok Sep 6, 16:00 UTC
Europe (Germany): 296 ms · model requests 3/3 ok
US (Central): 112 ms · model requests 3/3 ok
Asia (Tokyo): 148 ms · model requests 3/3 ok
South America (São Paulo): 242 ms · model requests 3/3 ok Sep 6, 17:00 UTC
Europe (Germany): 296 ms · model requests 3/3 ok
US (Central): 132 ms · model requests 3/3 ok
Asia (Tokyo): 169 ms · model requests 3/3 ok
South America (São Paulo): 228 ms · model requests 3/3 ok Sep 6, 18:00 UTC
Europe (Germany): 299 ms · model requests 3/3 ok
US (Central): 141 ms · model requests 3/3 ok
Asia (Tokyo): 132 ms · model requests 3/3 ok
South America (São Paulo): 238 ms · model requests 3/3 ok Sep 6, 19:00 UTC
Europe (Germany): 299 ms · model requests 3/3 ok
US (Central): 132 ms · model requests 3/3 ok
Asia (Tokyo): 144 ms · model requests 3/3 ok
South America (São Paulo): 247 ms · model requests 3/3 ok Sep 6, 20:00 UTC
Europe (Germany): 294 ms · model requests 3/3 ok
US (Central): 109 ms · model requests 3/3 ok
Asia (Tokyo): 149 ms · model requests 3/3 ok
South America (São Paulo): 242 ms · model requests 3/3 ok Sep 6, 21:00 UTC
Europe (Germany): 297 ms · model requests 3/3 ok
US (Central): 127 ms · model requests 3/3 ok
Asia (Tokyo): 138 ms · model requests 3/3 ok
South America (São Paulo): 233 ms · model requests 3/3 ok Sep 6, 22:00 UTC
Europe (Germany): 298 ms · model requests 3/3 ok
US (Central): 107 ms · model requests 3/3 ok
Asia (Tokyo): 141 ms · model requests 3/3 ok
South America (São Paulo): 229 ms · model requests 3/3 ok Sep 6, 23:00 UTC
Europe (Germany): 299 ms · model requests 3/3 ok
US (Central): 118 ms · model requests 3/3 ok
Asia (Tokyo): 152 ms · model requests 3/3 ok
South America (São Paulo): 243 ms · model requests 3/3 ok Sep 7, 00:00 UTC
Europe (Germany): 298 ms · model requests 3/3 ok
US (Central): 134 ms · model requests 3/3 ok
Asia (Tokyo): 144 ms · model requests 3/3 ok
South America (São Paulo): 244 ms · model requests 3/3 ok Sep 7, 01:00 UTC
Europe (Germany): 209 ms · model requests 3/3 ok
US (Central): 105 ms · model requests 3/3 ok
Asia (Tokyo): 160 ms · model requests 3/3 ok
South America (São Paulo): 234 ms · model requests 3/3 ok Sep 7, 02:00 UTC
Europe (Germany): 303 ms · model requests 1/1 ok
US (Central): 124 ms · model requests 1/1 ok
Asia (Tokyo): 160 ms · model requests 1/1 ok
South America (São Paulo): 235 ms · model requests 1/1 ok 500 0 Sep 4, 03:00 – Sep 7, 02:00 UTC: all 857 probes succeeded host Sep 4, 03:00 – Sep 7, 02:00 UTC: all 214 probes succeeded model 500 0 Sep 4, 03:00 – Sep 7, 02:00 UTC: all 856 probes succeeded host Sep 4, 03:00 – Sep 7, 02:00 UTC: all 214 probes succeeded model 500 0 Sep 4, 03:00 – Sep 7, 02:00 UTC: all 855 probes succeeded host Sep 4, 03:00 – Sep 7, 02:00 UTC: all 214 probes succeeded model 500 0 Sep 4, 03:00 – Sep 7, 02:00 UTC: all 855 probes succeeded host Sep 4, 03:00 – Sep 7, 02:00 UTC: all 214 probes succeeded model Europe (Germany) now 303 ms · typical 298 ms US (Central) now 124 ms · typical 120 ms Asia (Tokyo) now 160 ms · typical 148 ms South America (São Paulo) now 235 ms · typical 234 ms One panel per region: the line is the hourly p50 edge latency (shared scale, ms), the strips beneath it are the outcome of that hour’s host probes and, below them, of the real requests to openai/gpt-oss-120b. Hover any hour for the numbers. Flat is good; a rising line means the endpoint is slowing down from that origin, a gap means no probe succeeded in that hour.
How fast is the groq API from each region?
Region p50 TTFB p95 Uptime Asia (Tokyo) 144 ms 198 ms 100% Europe (Germany) 297 ms 406 ms 100% South America (São Paulo) 230 ms 294 ms 100% US (Central) 118 ms 190 ms 100%
Measured from US (Central), groq responds in 118 ms; from Europe (Germany) the same API takes 297 ms — 2.5× longer for an identical request. That difference is the network path, not the model, and it applies to every call you make.
What is actually being measured here?
A probe in each region opens a real connection to groq’s own API host every five
minutes and times DNS resolution, the TCP handshake, the TLS handshake and the first byte of the
response. Nothing is routed through a gateway or aggregator, so these figures describe
groq’s infrastructure rather than a reseller’s. Uptime counts a probe as failed only when the
service genuinely fails — a 401 from an unauthenticated probe means the endpoint answered
correctly and is counted as up.
What this page does not tell you
These are edge latency numbers: the time before the model begins generating. They
say nothing about answer quality, throughput, price, or how long a full completion takes — those
depend on the model you call. Edge latency matters because it is unavoidable: it is paid on every
request, before a single token exists, and no prompt engineering removes it. Where an API key is
available, inference time-to-first-token is measured separately and shown on the region pages with the
model named next to the figure. Likewise, an unauthenticated probe cannot see errors that hit only some
models or some accounts — the kind a status page usually reports — which is why Groq’s
own reports are shown next to the measurements rather than folded into them.
How does groq compare to other providers?
Independent, provider-neutral measurements. Updated automatically.
Method: distributed probes measure DNS→TCP→TLS→first-byte (edge latency) per region on a schedule.
Rankings are edge latency (TTFB); inference TTFT is shown separately where measured.
Think a number here is wrong? Tell us — contact@llmlatency.dev . llms.txt · API · RSS