LocalFit

Files and memory at 8K context

QuantFileFiles+ KV + runtimeSmallest fitSource
Q4_K_M
mykor/Tri-21B-Think-GGUF
11.72 GiB114.3 GiB16 GB GPUHF files
Q5_K_M
mykor/Tri-21B-Think-GGUF
13.72 GiB116.3 GiB20 GB GPUHF files
Q8_0
mykor/Tri-21B-Think-GGUF
20.52 GiB123.1 GiB24 GB GPUHF files
FP16
KnutJaegersberg/Tri-21B-Think-gguf
38.61 GiB141.2 GiB48 GB GPUHF files

No verified file: MLX 4-bit, MLX 8-bit. Sizes are exact file bytes (text weights; projectors listed separately). “+” = recurrent state or other terms unknown. Smallest fit adds 0.5 GiB spare; Macs use 75% of memory.

Quality

Artificial Analysis Intelligence Index

9.0 AA estimate

Variant: Tri-21B-Think · observed 2026-10-17 · source

Rank #65 of 75 researched 2026 models.

Arena text rating

Unknown

Scores describe the evaluated hosted variant, not each quantized file. AA and Arena are never averaged.

Reported speeds 0

No reported measurement yet. Submit one.

Community threads

Qualitative signals only; titles are not verified claims.