Files and memory at 8K context
| Quant | File | Files | + KV + runtime | Smallest fit | Source |
|---|---|---|---|---|---|
| Q8_0 unsloth/Step-3.7-Flash-GGUF | 195 GiB | 6 | unknown | over 192 GB GPU | HF files |
| BF16 unsloth/Step-3.7-Flash-GGUF | 367 GiB | 8 | unknown | over 192 GB GPU | HF files |
| MLX 4-bit mixed precision mlx-community/Step-3.7-Flash-4bit | 103 GiB | 22 | unknown | 192 GB Mac (cache unknown) | HF files |
| MLX 8-bit mixed precision mlx-community/Step-3.7-Flash-8bit | 195 GiB | 43 | unknown | 512 GB Mac (cache unknown) | HF files |
No verified file: Q4_K_M, Q5_K_M, FP16. Sizes are exact file bytes (text weights; projectors listed separately). “+” = recurrent state or other terms unknown. Smallest fit adds 0.5 GiB spare; Macs use 75% of memory.
Quality
Artificial Analysis Intelligence Index
Unknown
Arena text rating
Unknown
Scores describe the evaluated hosted variant, not each quantized file. AA and Arena are never averaged.
Reported speeds 0
No reported measurement yet. Submit one.