LocalFit

Qwen3.5-397B-A17B

Qwen/Qwen3.5-397B-A17B

Released2026-02-16Size397B · 17B activeArchitecturehybrid linear attnLicenseapache-2.0AA rank#31 of 75

Files and memory at 8K context

QuantFileFiles+ KV + runtimeSmallest fitSource
Q4_K_M
unsloth/Qwen3.5-397B-A17B-GGUF
227 GiB6229 GiB+over 192 GB GPUHF files
Q5_K_M
unsloth/Qwen3.5-397B-A17B-GGUF
273 GiB8275 GiB+over 192 GB GPUHF files
Q8_0
unsloth/Qwen3.5-397B-A17B-GGUF
393 GiB10394 GiB+over 192 GB GPUHF files
BF16
unsloth/Qwen3.5-397B-A17B-GGUF
739 GiB17740 GiB+over 192 GB GPUHF files
MLX 4-bit
mlx-community/Qwen3.5-397B-A17B-4bit
208 GiB46210 GiB+512 GB MacHF files
MLX 8-bit
mlx-community/Qwen3.5-397B-A17B-8bit
393 GiB91394 GiB+over 512 GB MacHF files

No verified file: FP16. Sizes are exact file bytes (text weights; projectors listed separately). “+” = recurrent state or other terms unknown. Smallest fit adds 0.5 GiB spare; Macs use 75% of memory.

Quality

Artificial Analysis Intelligence Index

21.4 AA estimate

Variant: Qwen3.5 397B A17B (Non-reasoning) · observed 2026-10-17 · source

Rank #31 of 75 researched 2026 models.

Arena text rating

1,438

95% CI 1435–1441 · 93,567 votes · published 2026-10-15 · dataset

Exact listed model name; hosted reasoning/quantization may differ from local checkpoint.

Scores describe the evaluated hosted variant, not each quantized file. AA and Arena are never averaged.

Reported speeds 0

No reported measurement yet. Submit one.