K2-Horizon-MoVA-36B-A4B
Files and memory at 8K context
| Quant | File | Files | + KV + runtime | Smallest fit | Source |
|---|---|---|---|---|---|
| Q4_K_M IFM/K2-Horizon-MoVA-36B-A4B-GGUF | 20.83 GiB | 1 | unknown | 24 GB GPU (cache unknown) | HF files |
| Q5_K_M IFM/K2-Horizon-MoVA-36B-A4B-GGUF | 24.62 GiB | 1 | unknown | 32 GB GPU (cache unknown) | HF files |
| Q8_0 IFM/K2-Horizon-MoVA-36B-A4B-GGUF | 37.10 GiB | 1 | unknown | 48 GB GPU (cache unknown) | HF files |
| MLX 4-bit mixed precision mlx-community/K2-Horizon-MoVA-36B-A4B-4bit | 24.59 GiB | 5 | unknown | 36 GB Mac (cache unknown) | HF files |
| MLX 8-bit mlx-community/K2-Horizon-MoVA-36B-A4B-8bit | 37.07 GiB | 8 | unknown | 64 GB Mac (cache unknown) | HF files |
No verified file: FP16. Sizes are exact file bytes (text weights; projectors listed separately). “+” = recurrent state or other terms unknown. Smallest fit adds 0.5 GiB spare; Macs use 75% of memory.
Quality
Artificial Analysis Intelligence Index
25.3
Variant: K2 Horizon MoVA 36B A4B · observed 2026-10-17 · source
Rank #22 of 75 researched 2026 models.
Arena text rating
Unknown
Scores describe the evaluated hosted variant, not each quantized file. AA and Arena are never averaged.
Reported speeds 2
| Hardware | Quant | Backend | Prompt t/s | Gen t/s | Date | Source |
|---|---|---|---|---|---|---|
| M4 Pro (20c GPU) 48 GB | MLX 4bit | MLX | 499 | 32.7 | 2026-10-03 | omlx.ai |
| M5 Pro (20c GPU) 64 GB | MLX 4bit | MLX | 1,223 | 31 | 2026-09-30 | omlx.ai |
Reported by the linked sources, not reproduced by LocalFit. All rows in the speed database
Community threads
- This model with vision support would rock! Hugging Face · 2026-10-02
- Chat template for propper tool calling with llama.cpp? Hugging Face · 2026-09-10
- https://www.reddit.com/r/LocalLLaMA/comments/1wg0vqz/the_new_k2_horizon_models_seem_like_an_absolute/ Reddit · 2026-09-14
Qualitative signals only; titles are not verified claims.