LocalFit

Hardware

GPUs & Macs 163

Vendor specs only; unpublished figures stay unknown. “Models that fit” counts 2026 models at 8K context with the default file format (GGUF for GPUs, MLX for Macs).

GeForce RTX 50 series 8

DeviceMemoryBandwidthModels that fit
RTX 50508 GB GDDR6320 GB/s20
RTX 50608 GB GDDR7448 GB/s20
RTX 5060 Ti (8 GB)8 GB GDDR7448 GB/s20
RTX 507012 GB GDDR7672 GB/s21
RTX 5060 Ti (16 GB)16 GB GDDR7448 GB/s23
RTX 5070 Ti16 GB GDDR7896 GB/s23
RTX 508016 GB GDDR7960 GB/s23
RTX 509032 GB GDDR71,792 GB/s36

GeForce RTX 40 series 11

DeviceMemoryBandwidthModels that fit
RTX 40608 GB GDDR6unknown20
RTX 4060 Ti (8 GB)8 GB GDDR6288 GB/s20
RTX 4070 (GDDR6)12 GB GDDR6unknown21
RTX 4070 (GDDR6X)12 GB GDDR6X504 GB/s21
RTX 4070 SUPER12 GB GDDR6Xunknown21
RTX 4070 Ti12 GB GDDR6X504 GB/s21
RTX 4060 Ti (16 GB)16 GB GDDR6288 GB/s23
RTX 4070 Ti SUPER16 GB GDDR6X672 GB/s23
RTX 408016 GB GDDR6X716.8 GB/s23
RTX 4080 SUPER16 GB GDDR6X736 GB/s23
RTX 409024 GB GDDR6X1,008 GB/s34

GeForce RTX 30 series 12

DeviceMemoryBandwidthModels that fit
RTX 3050 (6 GB)6 GB GDDR6unknown12
RTX 3050 (8 GB)8 GB GDDR6unknown20
RTX 3060 (8 GB)8 GB GDDR6unknown20
RTX 3060 Ti8 GB GDDR6unknown20
RTX 30708 GB GDDR6448 GB/s20
RTX 3070 Ti8 GB GDDR6X608 GB/s20
RTX 3080 (10 GB)10 GB GDDR6X760 GB/s21
RTX 3060 (12 GB)12 GB GDDR6360 GB/s21
RTX 3080 (12 GB)12 GB GDDR6Xunknown21
RTX 3080 Ti12 GB GDDR6X912 GB/s21
RTX 309024 GB GDDR6X936 GB/s34
RTX 3090 Ti24 GB GDDR6X1,008 GB/s34

NVIDIA workstation 9

DeviceMemoryBandwidthModels that fit
RTX PRO 4000 Blackwell24 GB GDDR7672 GB/s34
RTX PRO 4000 SFF Blackwell24 GB GDDR7432 GB/s34
RTX PRO 4500 Blackwell32 GB GDDR7896 GB/s36
RTX 6000 Ada Generation48 GB GDDR6960 GB/s39
RTX A600048 GB GDDR6768 GB/s39
RTX PRO 5000 Blackwell48 GB GDDR71,344 GB/s39
RTX PRO 5000 72GB Blackwell72 GB GDDR71,344 GB/s39
RTX PRO 6000 Blackwell Workstation Edition96 GB GDDR71,792 GB/s43
RTX PRO 6000 Max-Q Blackwell96 GB GDDR71,792 GB/s43

AMD Radeon 13

DeviceMemoryBandwidthModels that fit
Radeon RX 76008 GB GDDR6288 GB/s20
Radeon RX 90608 GB GDDR6288 GB/s20
Radeon RX 9060 XT 8GB8 GB GDDR6320 GB/s20
Radeon RX 7700 XT12 GB GDDR6432 GB/s21
Radeon RX 9070 GRE12 GB GDDR6432 GB/s21
Radeon RX 7600 XT16 GB GDDR6288 GB/s23
Radeon RX 7800 XT16 GB GDDR6624 GB/s23
Radeon RX 7900 GRE16 GB GDDR6576 GB/s23
Radeon RX 9060 XT (16 GB)16 GB GDDR6320 GB/s23
Radeon RX 907016 GB GDDR6640 GB/s23
Radeon RX 9070 XT16 GB GDDR6640 GB/s23
Radeon RX 7900 XT20 GB GDDR6800 GB/s28
Radeon RX 7900 XTX24 GB GDDR6960 GB/s34

AMD Radeon Pro / AI 5

DeviceMemoryBandwidthModels that fit
Radeon PRO W770016 GB GDDR6576 GB/s23
Radeon AI PRO R970032 GB GDDR6640 GB/s36
Radeon PRO W780032 GB GDDR6576 GB/s36
Radeon PRO W7800 48GB48 GB GDDR6864 GB/s39
Radeon PRO W790048 GB GDDR6864 GB/s39

Unified-memory PCs 2

DeviceMemoryBandwidthModels that fit
Ryzen AI Max+ 395 (128 GB, Radeon 8060S)128 GB LPDDR5X256 GB/s43
DGX Spark (128 GB)128 GB LPDDR5X273 GB/s43

Intel Arc 11

DeviceMemoryBandwidthModels that fit
Arc A3806 GB GDDR6186 GB/s12
Arc A5808 GB GDDR6512 GB/s20
Arc A7508 GB GDDR6512 GB/s20
Arc A770 8GB8 GB GDDR6512 GB/s20
Arc B57010 GB GDDR6380 GB/s21
Arc B58012 GB GDDR6456 GB/s21
Arc A770 16GB16 GB GDDR6560 GB/s23
Arc Pro B5016 GB GDDR6224 GB/s23
Arc Pro B6024 GB GDDR6456 GB/s34
Arc Pro B6532 GB GDDR6608 GB/s36
Arc Pro B7032 GB GDDR6608 GB/s36

Apple M1 4

DeviceMemoryBandwidthModels that fit
M1 (7-core GPU), 8 GB8 GB unifiedunknown12
M1 (8-core GPU), 8 GB8 GB unifiedunknown12
M1 (7-core GPU), 16 GB16 GB unifiedunknown19
M1 (8-core GPU), 16 GB16 GB unifiedunknown19

Apple M1 Pro 4

DeviceMemoryBandwidthModels that fit
M1 Pro (14-core GPU), 16 GB16 GB unified200 GB/s19
M1 Pro (16-core GPU), 16 GB16 GB unified200 GB/s19
M1 Pro (14-core GPU), 32 GB32 GB unified200 GB/s32
M1 Pro (16-core GPU), 32 GB32 GB unified200 GB/s32

Apple M1 Max 4

DeviceMemoryBandwidthModels that fit
M1 Max (24-core GPU), 32 GB32 GB unified400 GB/s32
M1 Max (32-core GPU), 32 GB32 GB unified400 GB/s32
M1 Max (24-core GPU), 64 GB64 GB unified400 GB/s35
M1 Max (32-core GPU), 64 GB64 GB unified400 GB/s35

Apple M1 Ultra 4

DeviceMemoryBandwidthModels that fit
M1 Ultra (48-core GPU), 64 GB64 GB unified800 GB/s35
M1 Ultra (64-core GPU), 64 GB64 GB unified800 GB/s35
M1 Ultra (48-core GPU), 128 GB128 GB unified800 GB/s40
M1 Ultra (64-core GPU), 128 GB128 GB unified800 GB/s40

Apple M2 6

DeviceMemoryBandwidthModels that fit
M2 (10-core GPU), 8 GB8 GB unified100 GB/s12
M2 (8-core GPU), 8 GB8 GB unified100 GB/s12
M2 (10-core GPU), 16 GB16 GB unified100 GB/s19
M2 (8-core GPU), 16 GB16 GB unified100 GB/s19
M2 (10-core GPU), 24 GB24 GB unified100 GB/s23
M2 (8-core GPU), 24 GB24 GB unified100 GB/s23

Apple M2 Pro 4

DeviceMemoryBandwidthModels that fit
M2 Pro (16-core GPU), 16 GB16 GB unified200 GB/s19
M2 Pro (19-core GPU), 16 GB16 GB unified200 GB/s19
M2 Pro (16-core GPU), 32 GB32 GB unified200 GB/s32
M2 Pro (19-core GPU), 32 GB32 GB unified200 GB/s32

Apple M2 Max 5

DeviceMemoryBandwidthModels that fit
M2 Max (30-core GPU), 32 GB32 GB unified400 GB/s32
M2 Max (38-core GPU), 32 GB32 GB unified400 GB/s32
M2 Max (30-core GPU), 64 GB64 GB unified400 GB/s35
M2 Max (38-core GPU), 64 GB64 GB unified400 GB/s35
M2 Max (38-core GPU), 96 GB96 GB unified400 GB/s39

Apple M2 Ultra 6

DeviceMemoryBandwidthModels that fit
M2 Ultra (60-core GPU), 64 GB64 GB unified800 GB/s35
M2 Ultra (76-core GPU), 64 GB64 GB unified800 GB/s35
M2 Ultra (60-core GPU), 128 GB128 GB unified800 GB/s40
M2 Ultra (76-core GPU), 128 GB128 GB unified800 GB/s40
M2 Ultra (60-core GPU), 192 GB192 GB unified800 GB/s42
M2 Ultra (76-core GPU), 192 GB192 GB unified800 GB/s42

Apple M3 6

DeviceMemoryBandwidthModels that fit
M3 (10-core GPU), 8 GB8 GB unified100 GB/s12
M3 (8-core GPU), 8 GB8 GB unified100 GB/s12
M3 (10-core GPU), 16 GB16 GB unified100 GB/s19
M3 (8-core GPU), 16 GB16 GB unified100 GB/s19
M3 (10-core GPU), 24 GB24 GB unified100 GB/s23
M3 (8-core GPU), 24 GB24 GB unified100 GB/s23

Apple M3 Pro 4

DeviceMemoryBandwidthModels that fit
M3 Pro (14-core GPU), 18 GB18 GB unified150 GB/s19
M3 Pro (18-core GPU), 18 GB18 GB unified150 GB/s19
M3 Pro (14-core GPU), 36 GB36 GB unified150 GB/s32
M3 Pro (18-core GPU), 36 GB36 GB unified150 GB/s32

Apple M3 Max 5

DeviceMemoryBandwidthModels that fit
M3 Max (30-core GPU), 36 GB36 GB unified300 GB/s32
M3 Max (40-core GPU), 48 GB48 GB unified400 GB/s32
M3 Max (40-core GPU), 64 GB64 GB unified400 GB/s35
M3 Max (30-core GPU), 96 GB96 GB unified300 GB/s39
M3 Max (40-core GPU), 128 GB128 GB unified400 GB/s40

Apple M3 Ultra 5

DeviceMemoryBandwidthModels that fit
M3 Ultra (60-core GPU), 96 GB96 GB unified819 GB/s39
M3 Ultra (80-core GPU), 96 GB96 GB unified819 GB/s39
M3 Ultra (60-core GPU), 256 GB256 GB unified819 GB/s43
M3 Ultra (80-core GPU), 256 GB256 GB unified819 GB/s43
M3 Ultra (80-core GPU), 512 GB512 GB unified819 GB/s46

Apple M4 6

DeviceMemoryBandwidthModels that fit
M4 (10-core GPU), 16 GB16 GB unified120 GB/s19
M4 (8-core GPU), 16 GB16 GB unified120 GB/s19
M4 (10-core GPU), 24 GB24 GB unified120 GB/s23
M4 (8-core GPU), 24 GB24 GB unified120 GB/s23
M4 (10-core GPU), 32 GB32 GB unified120 GB/s32
M4 (8-core GPU), 32 GB32 GB unified120 GB/s32

Apple M4 Pro 6

DeviceMemoryBandwidthModels that fit
M4 Pro (16-core GPU), 24 GB24 GB unified273 GB/s23
M4 Pro (20-core GPU), 24 GB24 GB unified273 GB/s23
M4 Pro (16-core GPU), 48 GB48 GB unified273 GB/s32
M4 Pro (20-core GPU), 48 GB48 GB unified273 GB/s32
M4 Pro (16-core GPU), 64 GB64 GB unified273 GB/s35
M4 Pro (20-core GPU), 64 GB64 GB unified273 GB/s35

Apple M4 Max 4

DeviceMemoryBandwidthModels that fit
M4 Max (32-core GPU), 36 GB36 GB unified410 GB/s32
M4 Max (40-core GPU), 48 GB48 GB unified546 GB/s32
M4 Max (40-core GPU), 64 GB64 GB unified546 GB/s35
M4 Max (40-core GPU), 128 GB128 GB unified546 GB/s40

Apple M5 6

DeviceMemoryBandwidthModels that fit
M5 (10-core GPU), 16 GB16 GB unified153 GB/s19
M5 (8-core GPU), 16 GB16 GB unified153 GB/s19
M5 (10-core GPU), 24 GB24 GB unified153 GB/s23
M5 (8-core GPU), 24 GB24 GB unified153 GB/s23
M5 (10-core GPU), 32 GB32 GB unified153 GB/s32
M5 (8-core GPU), 32 GB32 GB unified153 GB/s32

Apple M5 Pro 6

DeviceMemoryBandwidthModels that fit
M5 Pro (16-core GPU), 24 GB24 GB unified307 GB/s23
M5 Pro (20-core GPU), 24 GB24 GB unified307 GB/s23
M5 Pro (16-core GPU), 48 GB48 GB unified307 GB/s32
M5 Pro (20-core GPU), 48 GB48 GB unified307 GB/s32
M5 Pro (16-core GPU), 64 GB64 GB unified307 GB/s35
M5 Pro (20-core GPU), 64 GB64 GB unified307 GB/s35

Apple M5 Max 4

DeviceMemoryBandwidthModels that fit
M5 Max (32-core GPU), 36 GB36 GB unified460 GB/s32
M5 Max (40-core GPU), 48 GB48 GB unified614 GB/s32
M5 Max (40-core GPU), 64 GB64 GB unified614 GB/s35
M5 Max (40-core GPU), 128 GB128 GB unified614 GB/s40

Apple M5 Ultra 3

DeviceMemoryBandwidthModels that fit
M5 Ultra (64-core GPU), 96 GB96 GB unified1,200 GB/s39
M5 Ultra (80-core GPU), 256 GB256 GB unified1,200 GB/s43
M5 Ultra (80-core GPU), 512 GB Not shipping yet512 GB unified1,200 GB/s46