LongCat-Flash-Lite
Files and memory at 8K context
| Quant | File | Files | + KV + runtime | Smallest fit | Source |
|---|---|---|---|---|---|
| Q4_K_M InquiringMinds-AI/LongCat-Flash-Lite-GGUF | 37.47 GiB | 1 | unknown | 48 GB GPU (cache unknown) | HF files |
| Q5_K_M InquiringMinds-AI/LongCat-Flash-Lite-GGUF | 44.71 GiB | 1 | unknown | 48 GB GPU (cache unknown) | HF files |
| Q8_0 InquiringMinds-AI/LongCat-Flash-Lite-GGUF | 67.87 GiB | 1 | unknown | 80 GB GPU (cache unknown) | HF files |
| BF16 InquiringMinds-AI/LongCat-Flash-Lite-GGUF | 128 GiB | 1 | unknown | 192 GB GPU (cache unknown) | HF files |
| MLX 4-bit mixed precision mlx-community/LongCat-Flash-Lite-4bit | 35.93 GiB | 8 | unknown | 64 GB Mac (cache unknown) | HF files |
| MLX 8-bit mixed precision mlx-community/LongCat-Flash-Lite-8bit | 67.84 GiB | 20 | unknown | 96 GB Mac (cache unknown) | HF files |
No verified file: FP16. Sizes are exact file bytes (text weights; projectors listed separately). “+” = recurrent state or other terms unknown. Smallest fit adds 0.5 GiB spare; Macs use 75% of memory.
Quality
Artificial Analysis Intelligence Index
11.5 AA estimate
Variant: LongCat Flash Lite · observed 2026-10-17 · source
Rank #54 of 75 researched 2026 models.
Arena text rating
Unknown
Scores describe the evaluated hosted variant, not each quantized file. AA and Arena are never averaged.
Reported speeds 1
| Hardware | Quant | Backend | Prompt t/s | Gen t/s | Date | Source |
|---|---|---|---|---|---|---|
| Apple M4 Max (40-core GPU), 128 GB unified memory | MLX 4-bit | MLX | 1,132 | 108 | 2026-04-02 | omlx.ai |
Reported by the linked sources, not reproduced by LocalFit. All rows in the speed database