LocalFit

Editorial · dated 2026-10-17

Picks by memory

The highest AA-ranked verified 2026 model whose actual file + 8K KV cache + 1 GiB runtime + 0.5 GiB spare fits. Macs plan 75% of memory. Estimates, not runtime tests.

GPUs GGUF files

WeightsKV cacheRuntimeFree
MemoryBaseline pickFileWeightsKV @8KAccountedBudgetHigher-ranked, conditional
8 GBK2-Horizon-7BQ4_K_M5.21 GiB1.13 GiB7.33 GiB
7.3 GiB of 8.0 GiB
none
12 GBK2-Horizon-7BQ8_08.92 GiB1.13 GiB11.04 GiB
11.0 GiB of 12.0 GiB
none
16 GBK2-Horizon-7BQ8_08.92 GiB1.13 GiB11.04 GiB
11.0 GiB of 16.0 GiB
none
24 GBQwen3.8-27BQ5_K_M19.49 GiB0.50 GiB20.99 GiB
total unknown
21.0 GiB+ of 24.0 GiB
none
32 GBQwen3.8-27BQ8_027.12 GiB0.50 GiB28.62 GiB
total unknown
28.6 GiB+ of 32.0 GiB
none
48 GBQwen3.8-27BQ8_027.12 GiB0.50 GiB28.62 GiB
total unknown
28.6 GiB+ of 48.0 GiB
none
64 GBQwen3.8-27BQ8_027.12 GiB0.50 GiB28.62 GiB
total unknown
28.6 GiB+ of 64.0 GiB
none
96 GBQwen3.8-27BQ8_027.12 GiB0.50 GiB28.62 GiB
total unknown
28.6 GiB+ of 96.0 GiB
none
128 GBQwen3.8-27BQ8_027.12 GiB0.50 GiB28.62 GiB
total unknown
28.6 GiB+ of 128 GiB
none
192 GBQwen3.8-27BQ8_027.12 GiB0.50 GiB28.62 GiB
total unknown
28.6 GiB+ of 192 GiB
Qwen3.8-Flash-Next cache/runtime unknown

Macs MLX files

WeightsKV cacheRuntimeFree
MemoryBaseline pickFileWeightsKV @8KAccountedBudgetHigher-ranked, conditional
8 GBQwen3.5-4BMLX 4-bit2.83 GiB0.25 GiB4.08 GiB
total unknown
4.1 GiB+ of 6.0 GiB
none
16 GBK2-Horizon-7BMLX 8-bit8.91 GiB1.13 GiB11.03 GiB
11.0 GiB of 12.0 GiB
none
18 GBK2-Horizon-7BMLX 8-bit8.91 GiB1.13 GiB11.03 GiB
11.0 GiB of 13.5 GiB
none
24 GBQwen3.8-27BMLX 4-bit14.95 GiB0.50 GiB16.45 GiB
total unknown
16.5 GiB+ of 18.0 GiB
none
32 GBQwen3.8-27BMLX 4-bit14.95 GiB0.50 GiB16.45 GiB
total unknown
16.5 GiB+ of 24.0 GiB
none
36 GBQwen3.8-27BMLX 4-bit14.95 GiB0.50 GiB16.45 GiB
total unknown
16.5 GiB+ of 27.0 GiB
none
48 GBQwen3.8-27BMLX 8-bit27.48 GiB0.50 GiB28.98 GiB
total unknown
29.0 GiB+ of 36.0 GiB
none
64 GBQwen3.8-27BMLX 8-bit27.48 GiB0.50 GiB28.98 GiB
total unknown
29.0 GiB+ of 48.0 GiB
none
96 GBQwen3.8-27BMLX 8-bit27.48 GiB0.50 GiB28.98 GiB
total unknown
29.0 GiB+ of 72.0 GiB
none
128 GBQwen3.8-27BMLX 8-bit27.48 GiB0.50 GiB28.98 GiB
total unknown
29.0 GiB+ of 96.0 GiB
none
192 GBQwen3.8-27BMLX 8-bit27.48 GiB0.50 GiB28.98 GiB
total unknown
29.0 GiB+ of 144 GiB
Qwen3.8-Flash-Next cache/runtime unknown
256 GBQwen3.8-27BMLX 8-bit27.48 GiB0.50 GiB28.98 GiB
total unknown
29.0 GiB+ of 192 GiB
GLM-5.3-Flash cache/runtime unknown
512 GBQwen3.8-27BMLX 8-bit27.48 GiB0.50 GiB28.98 GiB
total unknown
29.0 GiB+ of 384 GiB
GLM-5.3-Flash cache/runtime unknown
Why the same model repeats

More memory buys precision and context, not a better-ranked model: no higher-ranked 2026 model with an established cache size fits until far larger budgets. Smaller models can be faster; check the speed metrics on each device page. “Total unknown” means a recurrent or fixed state term could not be sized and was not counted as zero. “Conditional” alternatives rank higher but their cache or runtime support is unknown.

Quantized quality is not reevaluated. AA configurations can differ from local files. Unknown cache candidates are shown separately rather than falsely certified.

Text-only baseline. No CPU offload, multi-device pooling, speculative model or vision projector allowance. These are conditional editorial shortlist picks, not guarantees. Mac tiers refer to capacity; select a real shipping configuration in gpus.json.