NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 Specialist
nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16
Where it runs 8K context · ≥ 5 t/s floor
| Setup | Best plan | Memory | Generate |
|---|---|---|---|
| 8 GB GPU + 32 GB RAM | native F32/BF16vLLMGPU streams weights from RAM · 19 GiB in RAM | Fits* | ≤ 1.5 t/s Ceiling |
| 12 GB GPU + 32 GB RAM | native F32/BF16vLLMGPU streams weights from RAM · 15 GiB in RAM | Fits* | ≤ 1.9 t/s Ceiling |
| 16 GB GPU + 64 GB RAM | native F32/BF16vLLMGPU streams weights from RAM · 11 GiB in RAM | Fits* | ≤ 2.7 t/s Ceiling |
| 24 GB GPU + 64 GB RAM | native F32/BF16vLLMGPU streams weights from RAM · 3 GiB in RAM | Fits* | ≤ 10.0 t/s Ceiling |
| 32 GB GPU + 128 GB RAM | native F32/BF16vLLMFull GPU | Fits* | ≤ 68 t/s Ceiling |
| 2× 24 GB GPUs + 128 GB RAM | native F32/BF16vLLMTensor split across GPUs | Fits* | ≤ 71 t/s Ceiling |
| 96 GB workstation GPU + 256 GB RAM | native F32/BF16vLLMFull GPU | Fits* | ≤ 68 t/s Ceiling |
| Mac, 24 GB | Does not fit | ||
| Mac, 48 GB | Does not fit | ||
| Mac, 128 GB | Does not fit | ||
| Mac, 512 GB | Does not fit | ||
| DGX Spark 128 GB | native F32/BF16vLLMUnified memory | Fits* | ≤ 10 t/s Ceiling |
| Ryzen AI Max+ 395, 128 GB | native F32/BF16vLLMUnified memory | Fits* | ≤ 9.7 t/s Ceiling |
| CPU only, 64 GB DDR5-5600 dual channel | Does not fit | ||
Same plan engine as the planner, with its default reserves and RAM. How plans are chosen.
Files exact Hugging Face bytes
| Artifact | Size | Files | Revision | Source |
|---|---|---|---|---|
| Native safetensors mixed/custom native; ; stored tensor dtypes=F32/BF16 · F32/B nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 | 24.55 GiB | 7 | ca9543b126 | HF files |
Not found in the representative quant search (not proven unavailable): GGUF FP16, GGUF Q8_0, GGUF Q5_K_M, GGUF Q4_K_M, MLX 8-bit, MLX 4-bit, EXL3, AWQ, GPTQ. Complete selected file sets; projectors, MTP/draft and lookup files are listed separately and budgeted only by plans that use them. File bytes are not allocated memory.
Quality
| AA evaluated mode | Index | LiveCodeBench | Terminal-Bench 2.1 | GPQA | HLE | Source |
|---|---|---|---|---|---|---|
| NVIDIA Nemotron Nano 12B v2 VL (Reasoning) AA estimate | 7.5 | 41.0% | — | 57.2% | 5.5% | source |
| NVIDIA Nemotron Nano 12B v2 VL (Non-reasoning) AA estimate | 5.8 | 20.7% | — | 43.9% | 4.3% | source |
Arena text rating
Unknown
Publisher-reported benchmarks
None extracted from the model card.
AA and Arena describe the hosted model in the stated mode, not each quantized file; scores are never inherited by base, pruned, abliterated or quantized variants and never averaged together.
How to run it
No model-specific recipe in the research. The planner binds the backend’s documented command template (llama.cpp, Ollama, LM Studio, MLX, vLLM) to your plan: open a plan’s details.
Recipes are source examples (settings are the publisher’s or author’s, not measured optima) and were not executed by LocalFit. A downloadable file does not prove your backend build supports the architecture.
Reported speeds 0
No reported measurement yet. Submit one.