RedHatAI/DeepSeek-R1-Distill-Llama-8B-FP8-dynamic
Text Generation • Updated • 124 • 5
DeepSeek-R1-Distill Quantized
-
-
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8
Text Generation • 71B • Updated • 170 • 2 -
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w4a16
Text Generation • 2B • Updated • 493 -
RedHatAI/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8
Text Generation • 8B • Updated • 3.21k • 2 -
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-FP8-dynamic
Text Generation • 2B • Updated • 151 -
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic
Text Generation • Updated • 268 • 3 -
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w4a16
Text Generation • 3B • Updated • 549 • 1 -
RedHatAI/DeepSeek-R1-Distill-Qwen-14B-quantized.w8a8
Text Generation • 15B • Updated • 2.58k • 2 -
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic
Text Generation • 33B • Updated • 1.34k • 10 -
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16
Text Generation • 6B • Updated • 437 • 5 -
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic
Text Generation • 71B • Updated • 2.96k • 10 -
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-FP8-dynamic
Text Generation • 8B • Updated • 323 • 1 -
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16
Text Generation • 2B • Updated • 138 • 2 -
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w8a8
Text Generation • 2B • Updated • 4.21k • 2 -
RedHatAI/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8
Text Generation • 8B • Updated • 3.34k • 5 -
RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8
Text Generation • Updated • 1.83k • 13 -
RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16
Text Generation • 11B • Updated • 713 • 6 -
RedHatAI/DeepSeek-R1-Distill-Qwen-1.5B-quantized.w4a16
Text Generation • 0.6B • Updated • 116 • 1