Ling-3.0-tiny
Files and memory at 8K context
| Quant | File | Files | + KV + runtime | Smallest fit | Source |
|---|---|---|---|---|---|
| Q4_K_M inclusionAI/Ling-3.0-tiny-GGUF | 4.49 GiB | 1 | unknown | 8 GB GPU (cache unknown) | HF files |
| Q5_K_M inclusionAI/Ling-3.0-tiny-GGUF | 5.25 GiB | 1 | unknown | 8 GB GPU (cache unknown) | HF files |
| Q8_0 inclusionAI/Ling-3.0-tiny-GGUF | 7.83 GiB | 1 | unknown | 12 GB GPU (cache unknown) | HF files |
| FP16 NANI-Nithin/Ling-3.0-tiny-GGUF | 14.72 GiB | 1 | unknown | 20 GB GPU (cache unknown) | HF files |
| MLX 4-bit rapid-mlx/Ling-3.0-tiny-MLX-4bit | 4.14 GiB | 1 | unknown | 8 GB Mac (cache unknown) | HF files |
No verified file: MLX 8-bit. Sizes are exact file bytes (text weights; projectors listed separately). “+” = recurrent state or other terms unknown. Smallest fit adds 0.5 GiB spare; Macs use 75% of memory.
Quality
Artificial Analysis Intelligence Index
11.1
Variant: Ling 3.0 Tiny · observed 2026-10-17 · source
Rank #57 of 75 researched 2026 models.
Arena text rating
Unknown
Scores describe the evaluated hosted variant, not each quantized file. AA and Arena are never averaged.
Reported speeds 1
| Hardware | Quant | Backend | Prompt t/s | Gen t/s | Date | Source |
|---|---|---|---|---|---|---|
| NVIDIA Jetson Orin Nano Super 8GB (8 GB unified LPDDR5) | IQ4_NL | llama.cpp CUDA | — | 33 | 2026-08-19 | r/LocalLLaMA |
Reported by the linked sources, not reproduced by LocalFit. All rows in the speed database
Community threads
- Best model for its size, people are not using due to absense of GGUFs. Hugging Face · 2026-08-30
- MTP support? Hugging Face · 2026-08-18
Qualitative signals only; titles are not verified claims.