MiniCPM-V 4.7 35B-A3B
Files and memory at 8K context
| Quant | File | Files | + KV + runtime | Smallest fit | Source |
|---|---|---|---|---|---|
| Q4_K_M openbmb/MiniCPM-V-4.7-35B-A3B-gguf | 19.71 GiB | 1 | 20.9 GiB+ | 24 GB GPU | HF files |
| Q5_K_M openbmb/MiniCPM-V-4.7-35B-A3B-gguf | 23.03 GiB | 1 | 24.2 GiB+ | 32 GB GPU | HF files |
| Q8_0 openbmb/MiniCPM-V-4.7-35B-A3B-gguf | 34.37 GiB | 1 | 35.5 GiB+ | 48 GB GPU | HF files |
| FP16 openbmb/MiniCPM-V-4.7-35B-A3B-gguf | 64.61 GiB | 1 | 65.8 GiB+ | 80 GB GPU | HF files |
| MLX 4-bit mixed precision mlx-community/MiniCPM-V-4.7-35B-A3B-4bit | 21.91 GiB | 5 | 23.1 GiB+ | 32 GB Mac | HF files |
| MLX 8-bit mixed precision mlx-community/MiniCPM-V-4.7-35B-A3B-8bit | 37.10 GiB | 8 | 38.3 GiB+ | 64 GB Mac | HF files |
Sizes are exact file bytes (text weights; projectors listed separately). “+” = recurrent state or other terms unknown. Smallest fit adds 0.5 GiB spare; Macs use 75% of memory.
Quality
Artificial Analysis Intelligence Index
Unknown
Arena text rating
Unknown
Scores describe the evaluated hosted variant, not each quantized file. AA and Arena are never averaged.
Reported speeds 2
| Hardware | Quant | Backend | Prompt t/s | Gen t/s | Date | Source |
|---|---|---|---|---|---|---|
| M4 Pro (20c GPU) 64 GB | MLX 4bit | MLX | 807 | 38.4 | 2026-10-16 | omlx.ai |
| M4 Max (40c GPU) 64 GB | MLX 4bit | MLX | 1,924 | 85.3 | 2026-10-15 | omlx.ai |
Reported by the linked sources, not reproduced by LocalFit. All rows in the speed database
Community threads
- 🚀 37.5 t/s on RTX 2060 Super (8GB): Optimizing MiniCPM-V 4.7 35B-A3B with DSpark & CPU-MoE Hugging Face · 2026-10-15
- MiniCPM-V 4.7 vs Qwen3.6-35B-A3B in 5 physics simulation challenges Hugging Face · 2026-10-14
Qualitative signals only; titles are not verified claims.