LocalFit

INTELLECT-3

PrimeIntellect/INTELLECT-3

ReleasedRelease date unknownSize106B MoE · 12B activeRoleAssistantLicensemitContext128K config max

Where it runs 8K context · ≥ 5 t/s floor

SetupBest planMemoryGenerate
8 GB GPU + 32 GB RAMDoes not fit
12 GB GPU + 32 GB RAMDoes not fit
16 GB GPU + 64 GB RAMDoes not fit
24 GB GPU + 64 GB RAMDoes not fit
32 GB GPU + 128 GB RAMDoes not fit
2× 24 GB GPUs + 128 GB RAMDoes not fit
96 GB workstation GPU + 256 GB RAMnative F32/BF16vLLMGPU streams weights from RAM · 106 GiB in RAMFits≤ 2.4 t/s Ceiling
Mac, 24 GBDoes not fit
Mac, 48 GBDoes not fit
Mac, 128 GBDoes not fit
Mac, 512 GBDoes not fit
DGX Spark 128 GBDoes not fit
Ryzen AI Max+ 395, 128 GBDoes not fit
CPU only, 64 GB DDR5-5600 dual channelDoes not fit

Same plan engine as the planner, with its default reserves and RAM. How plans are chosen.

Files exact Hugging Face bytes

ArtifactSizeFilesRevisionSource
Native safetensors mixed/custom native; ; stored tensor dtypes=F32/BF16 · F32/B
PrimeIntellect/INTELLECT-3
199 GiB48ff39d4a468HF files

Not found in the representative quant search (not proven unavailable): GGUF FP16, GGUF Q8_0, GGUF Q5_K_M, GGUF Q4_K_M, MLX 8-bit, MLX 4-bit, EXL3, AWQ, GPTQ. Complete selected file sets; projectors, MTP/draft and lookup files are listed separately and budgeted only by plans that use them. File bytes are not allocated memory.

Quality

AA evaluated modeIndexLiveCodeBenchTerminal-Bench 2.1GPQAHLESource
INTELLECT-3 (Based on GLM-4.5-Air) AA estimate10.639.7%—76.1%13.1%source

Arena text rating

1,356

CI 1348–1364 · 5,431 votes · published 2026-10-15 · dataset

Explicit name identity; exact hosted revision/local quant equivalence not verified

Publisher-reported benchmarks

None extracted from the model card.

AA and Arena describe the hosted model in the stated mode, not each quantized file; scores are never inherited by base, pruned, abliterated or quantized variants and never averaged together.

How to run it

No model-specific recipe in the research. The planner binds the backend’s documented command template (llama.cpp, Ollama, LM Studio, MLX, vLLM) to your plan: open a plan’s details.

Recipes are source examples (settings are the publisher’s or author’s, not measured optima) and were not executed by LocalFit. A downloadable file does not prove your backend build supports the architecture.

Reported speeds 0

No reported measurement yet. Submit one.