unsloth/GLM-4.7-GGUF
Text Generation • 358B • Updated
• 10.3k • 213
[models] CPU-Offload &/|| A6000x2
TPS can be as low as 1.0, seriously. its SLOW.
Note not deeply tested.
unsloth/DeepSeek-R1-0528-GGUF
Text Generation • 671B • Updated • 21.1k • 197Note Max Precision Capacity: Q8_K_XL
-
unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF
Image-Text-to-Text • 401B • Updated • 12.2k • 44 -
unsloth/MiniMax-M2.1-GGUF
Text Generation • 229B • Updated • 9.86k • 194 -
unsloth/Kimi-K2-Thinking-GGUF
1T • Updated • 3.04k • 114 -
unsloth/Kimi-K2.5-GGUF
1T • Updated • 87.3k • 236 -
unsloth/Qwen3.5-397B-A17B-GGUF
Image-Text-to-Text • 396B • Updated • 248k • 216 -
inclusionAI/Ring-2.5-1T
Text Generation • Updated • 18.5k • 235