Evidence
Speed database 4,373
Reported by the linked sources; not reproduced by LocalFit. Prompt and generation runs can be separate tests. “Derived” prefill comes from a measured latency. Rows that cannot be tied to one device, quant or model stay listed but never feed device cards.
| Model | Quant | Hardware | Backend | Prompt t/s | Gen t/s | TTFT | Test | Date | Source |
|---|---|---|---|---|---|---|---|---|---|
| Loading… | |||||||||