LocalFit

Evidence

Speed database 4,487

Reported by the linked sources; not reproduced by LocalFit. Placement (full GPU, multi-GPU, CPU experts, disk streaming) and the metric unit are kept: stream pieces/s and end-to-end rates are not tokenizer tokens/s. Only rows reconciled to one model, quant, device and backend can confirm a plan.

ModelQuantHardwareBackendPlacementPrompt t/sGen t/sTTFTDateSource
Loading…