Evidence
Speed database 4,487
Reported by the linked sources; not reproduced by LocalFit. Placement (full GPU, multi-GPU, CPU experts, disk streaming) and the metric unit are kept: stream pieces/s and end-to-end rates are not tokenizer tokens/s. Only rows reconciled to one model, quant, device and backend can confirm a plan.
| Model | Quant | Hardware | Backend | Placement | Prompt t/s | Gen t/s | TTFT | Date | Source |
|---|---|---|---|---|---|---|---|---|---|
| Loading… | |||||||||