Lorbus/Qwen3.6-27B-int4-AutoRound
Image-Text-to-Text • 6B • Updated • 966k • 109
Edit Models filters
Model Tree
Apps
Inference Providers
Models
216
Active filters: w4a16
LordNeel/DeepSeek-V4-Flash-Acti-MTP-W4A16-FP8
Text Generation • 44B • Updated • 2.51k • 10
lyf/Qwen3.6-27B-heretic-v2-mtp-int4-AutoRound
Image-Text-to-Text • 3B • Updated • 3.34k • 7
0xSero/GLM-5.1-555B-W4A16
Text Generation • 78B • Updated • 927 • 8
webhie/Qwen3.6-27B-int4-AutoRound-Code
Image-Text-to-Text • 6B • Updated • 39.2k • 7
philbert440/Qwen3.6-40B-DeckardUncensored-OpusDistilled-HermesCalibrated-W4A16-AWQ
Image-Text-to-Text • 40B • Updated • 541 • 3
canada-quant/DeepSeek-V4-Flash-W4A16-FP8-MTP
Text Generation • 51B • Updated • 8.73k • 3
LeaderboardModel1/Qwen3.5-27B-Writer-V2-AutoRound-W4A16-RTN
Text Generation • 3B • Updated • 2
RedHatAI/Qwen2-VL-72B-Instruct-FP8-dynamic
Image-Text-to-Text • 73B • Updated • 20
RedHatAI/Mixtral-8x22B-v0.1-quantized.w4a16
141B • Updated • 34
RedHatAI/Mixtral-8x7B-v0.1-quantized.w4a16
47B • Updated • 158
RedHatAI/QwQ-32B-Preview-quantized.w4a16
33B • Updated • 16
RedHatAI/Llama-3.1-Nemotron-70B-Instruct-HF-quantized.w4a16
Text Generation • 71B • Updated • 15
RedHatAI/granite-3.1-8b-instruct-quantized.w4a16
Text Generation • 8B • Updated • 1.49k • 1
RedHatAI/granite-3.1-2b-instruct-quantized.w4a16
Text Generation • 3B • Updated • 64.3k
RedHatAI/DeepSeek-V2.5-1210-quantized.w4a16
Text Generation • 238B • Updated • 68
RedHatAI/DeepSeek-Coder-V2-Instruct-0724-quantized.w4a16
Text Generation • 238B • Updated • 75 • 1
RedHatAI/granite-3.1-2b-base-quantized.w4a16
Text Generation • 3B • Updated • 23
RedHatAI/granite-3.1-8b-base-quantized.w4a16
Text Generation • 8B • Updated • 80 • 1
RedHatAI/Qwen2-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text • 74B • Updated • 23
RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w4a16
Text Generation • 24B • Updated • 313 • 1
RedHatAI/Phi-3-vision-128k-instruct-W4A16-G128
Text Generation • 4B • Updated • 55 • 1
RedHatAI/whisper-large-v2-W4A16-G128
Automatic Speech Recognition • 2B • Updated • 38 • 1
RedHatAI/Pixtral-Large-Instruct-2411-hf-quantized.w4a16
Image-Text-to-Text • 125B • Updated • 35
RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16
Image-Text-to-Text • 8B • Updated • 22.2k • 8
RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w4a16
Image-Text-to-Text • 4B • Updated • 600 • 4
RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text • 74B • Updated • 1.07k • 8
RedHatAI/pixtral-12b-quantized.w4a16
Image-Text-to-Text • 13B • Updated • 111 • 1
nm-testing/whisper-large-v3.w4a16
Automatic Speech Recognition • 2B • Updated • 7 • 2
RedHatAI/whisper-large-v3-quantized.w4a16
Automatic Speech Recognition • 2B • Updated • 749 • 3