LocalFit

Files and memory at 8K context

QuantFileFiles+ KV + runtimeSmallest fitSource
Q4_K_M
JamePeng2023/Step3-VL-10B-GGUF
4.68 GiB16.8 GiB8 GB GPUHF files
Q5_K_M
Vastined/Step3-VL-10B-GGUF
5.45 GiB17.6 GiB12 GB GPUHF files
Q8_0
JamePeng2023/Step3-VL-10B-GGUF
8.11 GiB110.2 GiB12 GB GPUHF files
FP16
seanbailey518/Step3-VL-10B-GGUF
15.26 GiB117.4 GiB20 GB GPUHF files

No verified file: MLX 4-bit, MLX 8-bit. Sizes are exact file bytes (text weights; projectors listed separately). “+” = recurrent state or other terms unknown. Smallest fit adds 0.5 GiB spare; Macs use 75% of memory.

Quality

Artificial Analysis Intelligence Index

7.7 AA estimate

Variant: Step3 VL 10B · observed 2026-10-17 · source

Rank #73 of 75 researched 2026 models.

Arena text rating

Unknown

Scores describe the evaluated hosted variant, not each quantized file. AA and Arena are never averaged.

Reported speeds 0

No reported measurement yet. Submit one.

Community threads

Qualitative signals only; titles are not verified claims.