Files and memory at 8K context
| Quant | File | Files | + KV + runtime | Smallest fit | Source |
|---|---|---|---|---|---|
| Q4_K_M IFM/K2-Horizon-7B-GGUF | 5.21 GiB | 1 | 7.3 GiB | 8 GB GPU | HF files |
| Q5_K_M IFM/K2-Horizon-7B-GGUF | 6.02 GiB | 1 | 8.1 GiB | 12 GB GPU | HF files |
| Q8_0 IFM/K2-Horizon-7B-GGUF | 8.92 GiB | 1 | 11.0 GiB | 12 GB GPU | HF files |
| FP16 mradermacher/K2-Horizon-7B-GGUF | 16.77 GiB | 1 | 18.9 GiB | 20 GB GPU | HF files |
| MLX 4-bit mixed precision mlx-community/K2-Horizon-7B-4bit | 6.69 GiB | 2 | 8.8 GiB | 16 GB Mac | HF files |
| MLX 8-bit mlx-community/K2-Horizon-7B-8bit | 8.91 GiB | 2 | 11.0 GiB | 16 GB Mac | HF files |
Sizes are exact file bytes (text weights; projectors listed separately). “+” = recurrent state or other terms unknown. Smallest fit adds 0.5 GiB spare; Macs use 75% of memory.
Quality
Artificial Analysis Intelligence Index
20.6
Variant: K2 Horizon 7B · observed 2026-10-17 · source
Rank #33 of 75 researched 2026 models.
Arena text rating
Unknown
Scores describe the evaluated hosted variant, not each quantized file. AA and Arena are never averaged.
Reported speeds 0
No reported measurement yet. Submit one.
Community threads
- Vision? Hugging Face · 2026-10-11
- repo size is 18B and seems like 9B model not 7B Hugging Face · 2026-10-05
- https://www.reddit.com/r/LocalLLaMA/comments/1wha6sv/i_benchmarked_ifmk2horizon7b_on_16gb_vram/ Reddit · 2026-09-15
- https://www.reddit.com/r/LocalLLaMA/comments/1wg0vqz/the_new_k2_horizon_models_seem_like_an_absolute/ Reddit · 2026-09-14
Qualitative signals only; titles are not verified claims.