Inference Providers
Active filters: 2-bit
Text Generation
• 284B • Updated • 6.42M
• 292
huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF
284B • Updated • 356k
• 83
iggerask/DeepSeek-V4-Flash-2bit-GB10
Text Generation
• 5B • Updated • 1.18k
• 3
MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF
Text Generation
• 8B • Updated • 163k
• 103
MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF
Text Generation
• 8B • Updated • 158k
• 37
MaziyarPanahi/Qwen2.5-3B-RP-Mix-GGUF
Text Generation
• 3B • Updated • 219
• 1
MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF
Text Generation
• 71B • Updated • 147k
• 21
MaziyarPanahi/gemma-3-4b-it-GGUF
Text Generation
• 4B • Updated • 163k
• 19
MaziyarPanahi/Qwen3-14B-GGUF
Text Generation
• 15B • Updated • 250k
• 11
MaziyarPanahi/Qwen3-4B-Instruct-2507-GGUF
Text Generation
• 4B • Updated • 175k
• 3
spicyneuron/Qwen3.5-397B-A17B-MLX-2.6bit
Text Generation
• 396B • Updated • 53
• 1
Ex0bit/MiniMax-SLURPY-DQ-MLX
Text Generation
• 229B • Updated • 49
• 2
pearsonkyle/tmax-27b-imatrix-MTP-GGUF
Text Generation
• 27B • Updated • 3.01k
• 1
Ayushnangia/bloom3B-2bit-gptq
Text Generation
• Updated • 3
kaitchup/Llama-2-7b-gptq-2bit
Text Generation
• 7B • Updated • 11
• 1
nesty/sg-bart-large-4096-gptq-2bit
Arylwen/instruct-palmyra-20b-gptq-2
Text Generation
• Updated • 1
Text Generation
• 0.1B • Updated • 3
Sujan42024/dlite-v2-1_5b-2bitQuantization
Text Generation
• 2B • Updated • 2
kaitchup/Mistral-7B-v0.1-gptq-2bit
Text Generation
• 7B • Updated • 10
kaitchup/Llama-2-13b-hf-gptq-2bit
Text Generation
• 13B • Updated • 8
kaitchup/Llama-2-7b-hf-gptq-2bit
Text Generation
• 7B • Updated • 101
Text Generation
• 3B • Updated • 217
• 6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 469
• 6
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 279
• 4
MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF
Text Generation
• 7B • Updated • 442
• 5
MaziyarPanahi/NeuralPipe-7B-slerp-GGUF
Text Generation
• 7B • Updated • 104
• 3
MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF
Text Generation
• 7B • Updated • 60
• 2
MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 124
• 2
MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF
Text Generation
• 7B • Updated • 96
• 2