MiniCPM-V-4.6
Where it runs 8K context · ≥ 5 t/s floor
| Setup | Best plan | Memory | Generate |
|---|---|---|---|
| 8 GB GPU + 32 GB RAM | FP16llama.cpp CUDAFull GPU | Fits* | ~105–151 t/s Estimated |
| 12 GB GPU + 32 GB RAM | FP16llama.cpp CUDAFull GPU | Fits* | ~176–188 t/s Estimated |
| 16 GB GPU + 64 GB RAM | FP16llama.cpp CUDAFull GPU | Fits* | ~364–445 t/s Estimated |
| 24 GB GPU + 64 GB RAM | FP16llama.cpp CUDAFull GPU | Fits* | ~368–461 t/s Estimated |
| 32 GB GPU + 128 GB RAM | FP16llama.cpp CUDAFull GPU | Fits* | ~578–922 t/s Estimated |
| 2× 24 GB GPUs + 128 GB RAM | FP16llama.cpp CUDAFull GPU | Fits* | ~336–434 t/s Estimated |
| 96 GB workstation GPU + 256 GB RAM | FP16llama.cpp CUDAFull GPU | Fits* | ~592–929 t/s Estimated |
| Mac, 24 GB | FP16llama.cpp MetalUnified memory | Fits* | ~124–148 t/s Estimated |
| Mac, 48 GB | FP16llama.cpp MetalUnified memory | Fits* | ~124–148 t/s Estimated |
| Mac, 128 GB | FP16llama.cpp MetalUnified memory | Fits* | ~201–307 t/s Estimated |
| Mac, 512 GB | FP16llama.cpp MetalUnified memory | Fits* | ~224–345 t/s Estimated |
| DGX Spark 128 GB | FP16llama.cpp CUDAUnified memory | Fits* | ~133–147 t/s Estimated |
| Ryzen AI Max+ 395, 128 GB | FP16llama.cpp VulkanUnified memory | Fits* | ~89–130 t/s Estimated |
| CPU only, 64 GB DDR5-5600 dual channel | Q4_K_Mllama.cpp CPUCPU only | Fits* | ~35–42 t/s Estimated extrapolated |
Same plan engine as the planner, with its default reserves and RAM. How plans are chosen.
Files exact Hugging Face bytes
| Artifact | Size | Files | Revision | Source |
|---|---|---|---|---|
| FP16 openbmb/MiniCPM-V-4.6-gguf | 1.41 GiB | 1 | afe9accb78 | HF files |
| Q8_0 openbmb/MiniCPM-V-4.6-gguf | 0.76 GiB | 1 | afe9accb78 | HF files |
| Q5_K_M openbmb/MiniCPM-V-4.6-gguf | 0.54 GiB | 1 | afe9accb78 | HF files |
| Q4_K_M openbmb/MiniCPM-V-4.6-gguf | 0.49 GiB | 1 | afe9accb78 | HF files |
| AWQ 4-bit openbmb/MiniCPM-V-4.6-AWQ | 1.74 GiB | 1 | dc74581a19 | HF files |
| GPTQ 4-bit openbmb/MiniCPM-V-4.6-GPTQ | 1.74 GiB | 1 | 6c2a8a8593 | HF files |
| Native safetensors BF16 openbmb/MiniCPM-V-4.6 | 2.42 GiB | 1 | 36f34a661a | HF files |
Not found in the representative quant search (not proven unavailable): MLX 8-bit, MLX 4-bit, EXL3. Complete selected file sets; projectors, MTP/draft and lookup files are listed separately and budgeted only by plans that use them. File bytes are not allocated memory.
Quality
| AA evaluated mode | Index | LiveCodeBench | Terminal-Bench 2.1 | GPQA | HLE | Source |
|---|---|---|---|---|---|---|
| MiniCPM-V 4.6 1.3B AA estimate | 5.7 | 7.0% | 0.0% | 30.5% | 5.0% | source |
Arena text rating
Unknown
Publisher-reported benchmarks
None extracted from the model card.
AA and Arena describe the hosted model in the stated mode, not each quantized file; scores are never inherited by base, pruned, abliterated or quantized variants and never averaged together.
How to run it
No model-specific recipe in the research. The planner binds the backend’s documented command template (llama.cpp, Ollama, LM Studio, MLX, vLLM) to your plan: open a plan’s details.
Recipes are source examples (settings are the publisher’s or author’s, not measured optima) and were not executed by LocalFit. A downloadable file does not prove your backend build supports the architecture.
Reported speeds 0
No reported measurement yet. Submit one.