Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

25,842

Base only

Active filters: llama-cpp

TouchNight/Qwen2.5-14B_Uncencored-Q4_K_M-GGUF

Text Generation • 15B • Updated Sep 19, 2024 • 591 • 7

rippertnt/Qwen3-1.7B-Q4_K_M-GGUF

Text Generation • 2B • Updated Apr 28, 2025 • 2.6k • 4

ggml-org/bge-m3-Q8_0-GGUF

Sentence Similarity • 0.6B • Updated Oct 12, 2025 • 14.1k • 19

jinaai/jina-embeddings-v5-text-nano-classification

Text Classification • 0.2B • Updated Apr 15 • 9.19k • 19

LocoreMind/LocoOperator-4B

Text Generation • 4B • Updated Feb 24 • 268 • • 279

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 117k • 798

continuum-ai/qwen3-coder-30b-a3b-compacted-19b-256k

Text Generation • 20B • Updated Apr 11 • 2.62k • 16

prithivMLmods/Holo-3.1-9B-GGUF

Image-Text-to-Text • 9B • Updated Jun 2 • 2.85k • 14

ge525/Qwen3.8-9B-Distill-uncensored-heretic-Q4_K_M-GGUF

Text Generation • 9B • Updated Aug 23 • 16.1k • 31

prithivMLmods/OxCoder-9B-GGUF

Image-Text-to-Text • 9B • Updated Sep 8 • 5.77k • 14

TokenRhythm/NeoHorse-1-4B-GGUF

Text Generation • 4B • Updated Sep 10 • 20.4k • 49

Jab1718/qwen3.8-flash-coder-26gb-gguf

Text Generation • 43B • Updated Sep 11 • 12.5k • 31

geantendormi/K2-Horizon-7B-Uno-Uncensored-GGUF

Text Generation • 9B • Updated Sep 17 • 6.39k • 7

SC117/occamy-1.0-abliterated-FIT-GGUF

Image-Text-to-Text • 35B • Updated 18 days ago • 21k • 17

prithivMLmods/LightOnOCR-3-1B-GGUF

Image-Text-to-Text • 0.6B • Updated 13 days ago • 6.34k • 7

prithivMLmods/LiquidAI-LFM2.5-24B-A2B-GGUF

Text Generation • 24B • Updated 6 days ago • 529 • 2

prithivMLmods/flux-3-image-klein-prompt-upsampler-GGUF

Image-Text-to-Text • 9B • Updated 6 days ago • 2.51k • 2

abenzerps/Hy-Memory-30B-A3B-Quantized

Text Generation • 30B • Updated 5 days ago • 821 • 2

vinnipukh/Hy-Memory-30B-A3B-GGUF

Text Generation • 30B • Updated 4 days ago • 2.91k • 2

prithivMLmods/mario-html-v2-9B-GGUF

Image-Text-to-Text • 9B • Updated 5 days ago • 540 • 2

Hugggme/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Sep 18, 2024 • 329 • 25

hugging-quants/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 43.3k • 36

apto-as/Qwen2.5-Coder-1.5B-Instruct-Q5_K_M-GGUF

Text Generation • 2B • Updated Oct 16, 2024 • 1.65k • 1

HuggingFaceTB/SmolLM2-360M-Instruct-GGUF

0.4B • Updated Oct 31, 2024 • 17.9k • 58

benhaotang/Rombos-Coder-V2.5-Qwen-7b-GGUF_cline

8B • Updated Nov 15, 2024 • 262 • 11

Lucy-in-the-Sky/Qwen2.5-14B-Instruct-abliterated-v2-Q4_K_M-GGUF

Text Generation • 15B • Updated Dec 7, 2024 • 204 • 1

roleplaiapp/Phi-4-ReasoningRP-Q6_K-GGUF

Text Generation • 15B • Updated Jan 29, 2025 • 16 • 1

roleplaiapp/Phi-4-ReasoningRP-Q8_0-GGUF

Text Generation • 15B • Updated Jan 29, 2025 • 19 • 1

NikolayKozloff/LLMBG-Llama-3.1-8B-BG-Reasoning-v0.1-Q8_0-GGUF

Text Generation • 8B • Updated Feb 9, 2025 • 325 • 12

Human23/DeepSeek-R1-Distill-Llama-8B-abliterated-Q8_0-GGUF

8B • Updated Feb 15, 2025 • 264 • 1