LocalFit

Inkling

thinkingmachines/Inkling

Released2026-07-15Size975B · 41B activeArchitecturesliding-window attnLicenseapache-2.0AA rank#24 of 75

Files and memory at 8K context

QuantFileFiles+ KV + runtimeSmallest fitSource
Q8_0
unsloth/inkling-GGUF
798 GiB19799 GiB+over 192 GB GPUHF files
BF16
unsloth/inkling-GGUF
1,764 GiB411,766 GiB+over 192 GB GPUHF files
MLX 4-bit mixed precision
mlx-community/Inkling-mlx-4bit
511 GiB98513 GiB+over 512 GB MacHF files

No verified file: Q4_K_M, Q5_K_M, FP16, MLX 8-bit. Sizes are exact file bytes (text weights; projectors listed separately). “+” = recurrent state or other terms unknown. Smallest fit adds 0.5 GiB spare; Macs use 75% of memory.

Quality

Artificial Analysis Intelligence Index

25.0

Variant: Inkling (Xhigh) · observed 2026-10-17 · source

Rank #24 of 75 researched 2026 models.

Arena text rating

1,441

95% CI 1437–1446 · 40,648 votes · published 2026-10-15 · dataset

Exact listed model name; hosted reasoning/quantization may differ from local checkpoint.

Scores describe the evaluated hosted variant, not each quantized file. AA and Arena are never averaged.

Reported speeds 0

No reported measurement yet. Submit one.