LocalFit

Qwen3.5-122B-A10B

Qwen/Qwen3.5-122B-A10B

Released2026-02-24Size122B · 10B activeArchitecturehybrid linear attnLicenseapache-2.0AA rank#37 of 75

Files and memory at 8K context

QuantFileFiles+ KV + runtimeSmallest fitSource
Q4_K_M
unsloth/Qwen3.5-122B-A10B-GGUF
71.28 GiB372.5 GiB+80 GB GPUHF files
Q5_K_M
unsloth/Qwen3.5-122B-A10B-GGUF
85.23 GiB386.4 GiB+96 GB GPUHF files
Q8_0
unsloth/Qwen3.5-122B-A10B-GGUF
121 GiB4122 GiB+128 GB GPUHF files
BF16
unsloth/Qwen3.5-122B-A10B-GGUF
228 GiB5229 GiB+over 192 GB GPUHF files
MLX 4-bit
mlx-community/Qwen3.5-122B-A10B-4bit
64.81 GiB1466.0 GiB+96 GB MacHF files
MLX 8-bit
mlx-community/Qwen3.5-122B-A10B-8bit
122 GiB25123 GiB+192 GB MacHF files

No verified file: FP16. Sizes are exact file bytes (text weights; projectors listed separately). “+” = recurrent state or other terms unknown. Smallest fit adds 0.5 GiB spare; Macs use 75% of memory.

Quality

Artificial Analysis Intelligence Index

17.7 AA estimate

Variant: Qwen3.5 122B A10B (Non-reasoning) · observed 2026-10-17 · source

Rank #37 of 75 researched 2026 models.

Arena text rating

1,417

95% CI 1413–1422 · 29,732 votes · published 2026-10-15 · dataset

Exact listed model name; hosted reasoning/quantization may differ from local checkpoint.

Scores describe the evaluated hosted variant, not each quantized file. AA and Arena are never averaged.

Reported speeds 10

HardwareQuantBackendPrompt t/sGen t/sDateSource
Apple M5 Max (40-core GPU), 128 GB unified memoryMLX 4-bitMLX1,64570.42026-10-14omlx.ai
Apple M4 Max (40-core GPU), 128 GB unified memoryMLX 4-bitMLX56059.12026-10-10omlx.ai
Apple M3 Ultra (60-core GPU), 96 GB unified memoryMLX 4-bitMLX70855.92026-09-18omlx.ai
Apple M3 Ultra (60-core GPU), 96 GB unified memoryMLX 4-bitMLX62747.62026-09-18omlx.ai
Apple M1 Ultra (64-core GPU), 128 GB unified memoryMLX 4-bitMLX34241.82026-09-15omlx.ai
Apple M2 Max (38-core GPU), 96 GB unified memoryMLX 4-bitMLX22541.32026-08-13omlx.ai
Apple M3 Max (40-core GPU), 128 GB unified memoryMLX 4-bitMLX47846.52026-08-05omlx.ai
Apple M2 Ultra (60-core GPU), 128 GB unified memoryMLX 4-bitMLX33252.42026-07-02omlx.ai
AMD Ryzen AI Max 395 (Radeon 8060S, gfx1151), 128 GBUD-Q6_K_XL (llama-bench: Q6_K, 106.04 GiB)llama.cpp ROCm26619.12026-05-25llama.cpp #23659
4x AMD GPUs described as "4x 9700" (likely Radeon AI PRO R9700 32 GB), 128 GB DDR4, ROCm 7.2.0 multi-deviceUD-Q6_K_XLllama.cpp ROCm230322026-04-30llama.cpp #20013

Reported by the linked sources, not reproduced by LocalFit. All rows in the speed database