Editorial · dated 2026-10-17
Picks by memory
The highest AA-ranked verified 2026 model whose actual file + 8K KV cache + 1 GiB runtime + 0.5 GiB spare fits. Macs plan 75% of memory. Estimates, not runtime tests.
GPUs GGUF files
| Memory | Baseline pick | File | Weights | KV @8K | Accounted | Budget | Higher-ranked, conditional |
|---|---|---|---|---|---|---|---|
| 8 GB | K2-Horizon-7B | Q4_K_M | 5.21 GiB | 1.13 GiB | 7.33 GiB | 7.3 GiB of 8.0 GiB | none |
| 12 GB | K2-Horizon-7B | Q8_0 | 8.92 GiB | 1.13 GiB | 11.04 GiB | 11.0 GiB of 12.0 GiB | none |
| 16 GB | K2-Horizon-7B | Q8_0 | 8.92 GiB | 1.13 GiB | 11.04 GiB | 11.0 GiB of 16.0 GiB | none |
| 24 GB | Qwen3.8-27B | Q5_K_M | 19.49 GiB | 0.50 GiB | 20.99 GiB total unknown | 21.0 GiB+ of 24.0 GiB | none |
| 32 GB | Qwen3.8-27B | Q8_0 | 27.12 GiB | 0.50 GiB | 28.62 GiB total unknown | 28.6 GiB+ of 32.0 GiB | none |
| 48 GB | Qwen3.8-27B | Q8_0 | 27.12 GiB | 0.50 GiB | 28.62 GiB total unknown | 28.6 GiB+ of 48.0 GiB | none |
| 64 GB | Qwen3.8-27B | Q8_0 | 27.12 GiB | 0.50 GiB | 28.62 GiB total unknown | 28.6 GiB+ of 64.0 GiB | none |
| 96 GB | Qwen3.8-27B | Q8_0 | 27.12 GiB | 0.50 GiB | 28.62 GiB total unknown | 28.6 GiB+ of 96.0 GiB | none |
| 128 GB | Qwen3.8-27B | Q8_0 | 27.12 GiB | 0.50 GiB | 28.62 GiB total unknown | 28.6 GiB+ of 128 GiB | none |
| 192 GB | Qwen3.8-27B | Q8_0 | 27.12 GiB | 0.50 GiB | 28.62 GiB total unknown | 28.6 GiB+ of 192 GiB | Qwen3.8-Flash-Next cache/runtime unknown |
Macs MLX files
| Memory | Baseline pick | File | Weights | KV @8K | Accounted | Budget | Higher-ranked, conditional |
|---|---|---|---|---|---|---|---|
| 8 GB | Qwen3.5-4B | MLX 4-bit | 2.83 GiB | 0.25 GiB | 4.08 GiB total unknown | 4.1 GiB+ of 6.0 GiB | none |
| 16 GB | K2-Horizon-7B | MLX 8-bit | 8.91 GiB | 1.13 GiB | 11.03 GiB | 11.0 GiB of 12.0 GiB | none |
| 18 GB | K2-Horizon-7B | MLX 8-bit | 8.91 GiB | 1.13 GiB | 11.03 GiB | 11.0 GiB of 13.5 GiB | none |
| 24 GB | Qwen3.8-27B | MLX 4-bit | 14.95 GiB | 0.50 GiB | 16.45 GiB total unknown | 16.5 GiB+ of 18.0 GiB | none |
| 32 GB | Qwen3.8-27B | MLX 4-bit | 14.95 GiB | 0.50 GiB | 16.45 GiB total unknown | 16.5 GiB+ of 24.0 GiB | none |
| 36 GB | Qwen3.8-27B | MLX 4-bit | 14.95 GiB | 0.50 GiB | 16.45 GiB total unknown | 16.5 GiB+ of 27.0 GiB | none |
| 48 GB | Qwen3.8-27B | MLX 8-bit | 27.48 GiB | 0.50 GiB | 28.98 GiB total unknown | 29.0 GiB+ of 36.0 GiB | none |
| 64 GB | Qwen3.8-27B | MLX 8-bit | 27.48 GiB | 0.50 GiB | 28.98 GiB total unknown | 29.0 GiB+ of 48.0 GiB | none |
| 96 GB | Qwen3.8-27B | MLX 8-bit | 27.48 GiB | 0.50 GiB | 28.98 GiB total unknown | 29.0 GiB+ of 72.0 GiB | none |
| 128 GB | Qwen3.8-27B | MLX 8-bit | 27.48 GiB | 0.50 GiB | 28.98 GiB total unknown | 29.0 GiB+ of 96.0 GiB | none |
| 192 GB | Qwen3.8-27B | MLX 8-bit | 27.48 GiB | 0.50 GiB | 28.98 GiB total unknown | 29.0 GiB+ of 144 GiB | Qwen3.8-Flash-Next cache/runtime unknown |
| 256 GB | Qwen3.8-27B | MLX 8-bit | 27.48 GiB | 0.50 GiB | 28.98 GiB total unknown | 29.0 GiB+ of 192 GiB | GLM-5.3-Flash cache/runtime unknown |
| 512 GB | Qwen3.8-27B | MLX 8-bit | 27.48 GiB | 0.50 GiB | 28.98 GiB total unknown | 29.0 GiB+ of 384 GiB | GLM-5.3-Flash cache/runtime unknown |
Why the same model repeats
More memory buys precision and context, not a better-ranked model: no higher-ranked 2026 model with an established cache size fits until far larger budgets. Smaller models can be faster; check the speed metrics on each device page. “Total unknown” means a recurrent or fixed state term could not be sized and was not counted as zero. “Conditional” alternatives rank higher but their cache or runtime support is unknown.
Quantized quality is not reevaluated. AA configurations can differ from local files. Unknown cache candidates are shown separately rather than falsely certified.
Text-only baseline. No CPU offload, multi-device pooling, speculative model or vision projector allowance. These are conditional editorial shortlist picks, not guarantees. Mac tiers refer to capacity; select a real shipping configuration in gpus.json.