Gemma 4 E4B (it)
Files and memory at 8K context
| Quant | File | Files | + KV + runtime | Smallest fit | Source |
|---|---|---|---|---|---|
| Q4_K_M unsloth/gemma-4-E4B-it-GGUF | 4.64 GiB | 1 | unknown | 8 GB GPU (cache unknown) | HF files |
| Q5_K_M unsloth/gemma-4-E4B-it-GGUF | 5.11 GiB | 1 | unknown | 8 GB GPU (cache unknown) | HF files |
| Q8_0 unsloth/gemma-4-E4B-it-GGUF | 7.63 GiB | 1 | unknown | 12 GB GPU (cache unknown) | HF files |
| MLX 4-bit mlx-community/gemma-4-E4B-it-4bit | 4.79 GiB | 1 | unknown | 16 GB Mac (cache unknown) | HF files |
| MLX 8-bit mlx-community/gemma-4-E4B-it-8bit | 8.27 GiB | 2 | unknown | 16 GB Mac (cache unknown) | HF files |
No verified file: FP16. Sizes are exact file bytes (text weights; projectors listed separately). “+” = recurrent state or other terms unknown. Smallest fit adds 0.5 GiB spare; Macs use 75% of memory.
Quality
Artificial Analysis Intelligence Index
8.9
Variant: Gemma 4 E4B (Reasoning) · observed 2026-10-17 · source
Rank #66 of 75 researched 2026 models.
Arena text rating
Unknown
Scores describe the evaluated hosted variant, not each quantized file. AA and Arena are never averaged.
Reported speeds 3
| Hardware | Quant | Backend | Prompt t/s | Gen t/s | Date | Source |
|---|---|---|---|---|---|---|
| MacBook Air M5, 32 GB | Q4_K_M | llama.cpp Metal | — | 36.7 | 2026-04-20 | r/LocalLLaMA |
| Steam Deck (AMD Custom GPU 0932 / RADV VANGOGH, Vulkan) | UD-Q4_K_XL | llama.cpp Vulkan | 164 | 17.8 | 2026-08-20 | llama.cpp #10879 |
| Steam Deck (AMD Custom GPU 0932 / RADV VANGOGH, Vulkan) | UD-Q4_K_XL | llama.cpp Vulkan | 161 | 17.8 | 2026-08-20 | llama.cpp #10879 |
Reported by the linked sources, not reproduced by LocalFit. All rows in the speed database
Community threads
- A DSpark draft model for Gemma-4-E4B-it (up to 4.7x speedup; higher acceptance than MTP on 4/9 benchmarks) Hugging Face · 2026-10-10
- [Exploration] Applying Native Dual-Regime & KV-Cache Handoff to this model variant? Hugging Face · 2026-09-21
- https://www.reddit.com/r/LocalLLaMA/comments/1x7g8cc/why_do_we_have_models_under_15b_so_rarely_anymore/ Reddit · 2026-10-16
Qualitative signals only; titles are not verified claims.