neuralmagic 's Collections Granite 3.1 Quantization
updated
RedHatAI/granite-3.1-2b-instruct-quantized.w4a16
Text Generation
• 0.5B • Updated
• 60
RedHatAI/granite-3.1-2b-instruct-quantized.w8a8
Text Generation
• 3B • Updated
• 9
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16
Text Generation
• 1B • Updated
• 861
• 1
RedHatAI/granite-3.1-8b-instruct-quantized.w8a8
Text Generation
• 8B • Updated
• 199
• 2
RedHatAI/granite-3.1-2b-instruct-FP8-dynamic
Text Generation
• 3B • Updated
• 6
RedHatAI/granite-3.1-8b-instruct-FP8-dynamic
Text Generation
• 8B • Updated
• 26
• 1
RedHatAI/granite-3.1-2b-base-quantized.w4a16
Text Generation
• 0.5B • Updated
• 34
RedHatAI/granite-3.1-2b-base-quantized.w8a8
Text Generation
• 3B • Updated
• 9
RedHatAI/granite-3.1-8b-base-FP8-dynamic
Text Generation
• 8B • Updated
• 1
RedHatAI/granite-3.1-2b-base-FP8-dynamic
Text Generation
• 3B • Updated
• 1
RedHatAI/granite-3.1-8b-base-quantized.w4a16
Text Generation
• 1B • Updated
• 18
• 1
RedHatAI/granite-3.1-8b-base-quantized.w8a8
Text Generation
• 8B • Updated
• 81