Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

25,641

Base only

Active filters: llama-cpp

apto-as/Qwen2.5-Coder-14B-Instruct-Q5_K_M-GGUF

Text Generation • 15B • Updated Nov 24, 2024 • 675 • 2

ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF

Text Generation • 3B • Updated Nov 26, 2024 • 1.98k • 17

itlwas/Qwen2.5-3B-Instruct-Q4_K_M-GGUF

Text Generation • 3B • Updated Jan 5, 2025 • 184 • 1

itlwas/Dolphin3.0-Llama3.1-8B-Q4_K_M-GGUF

8B • Updated Jan 5, 2025 • 2.36k • 5

roleplaiapp/DeepSeek-R1-Distill-Qwen-14B-Q2_K-GGUF

Text Generation • 15B • Updated Jan 20, 2025 • 115 • 1

aiplatforms/mistral-24b-ru-uncensored-gguf

Text Generation • 24B • Updated May 7 • 982 • 10

aiplatforms/ru-girlfriend-roleplay-1.5b-gguf-q8

Text Generation • 2B • Updated May 7 • 630 • 5

Luisz21/gemma-3-1b-it-abliterated-Q8_0-GGUF

Text Generation • 1.0B • Updated Mar 13, 2025 • 510 • 1

C10X/gemma-3-finetuneSSD-Q8_0-GGUF

2B • Updated Apr 3, 2025 • 25 • 1

enacimie/Qwen3-4B-Q4_K_M-GGUF

Text Generation • 4B • Updated Dec 30, 2025 • 3.73k • 5

ggml-org/Nomic-Embed-Text-V2-GGUF

Sentence Similarity • 0.5B • Updated Apr 30, 2025 • 2.07k • 18

ldostadi/Foundation-Sec-8B-abliterated-Q4_K_M-GGUF

Text Generation • 8B • Updated May 15, 2025 • 143 • 3

FinancialSupport/Qwen3-8B-Q4_K_M-GGUF

8B • Updated Jul 7, 2025 • 1 • 1

NikolayKozloff/Hermes-4-14B-Q5_K_M-GGUF

15B • Updated Sep 2, 2025 • 128 • 2

NikolayKozloff/Hermes-4-14B-Q4_K_M-GGUF

15B • Updated Sep 2, 2025 • 402 • 2

Gideon531/Huihui-Qwen3-8B-abliterated-v2-Q5_0-GGUF

Text Generation • 8B • Updated Sep 3, 2025 • 63 • 1

ggml-org/Qwen3-Reranker-0.6B-Q8_0-GGUF

Text Ranking • 0.6B • Updated Oct 3, 2025 • 90.6k • 29

ijohn07/Qwen3-14B-Uncensored-Q4_K_M-GGUF

15B • Updated Oct 6, 2025 • 1.47k • 2

ErenAta00/CaptureTheFlag-CypherMindLLM-XRLAB-GGUF

Text Generation • 8B • Updated Nov 18, 2025 • 3.72k • 8

diegom1379/zombiesgrid-Q8_0-GGUF

4B • Updated Nov 13, 2025 • 6 • 1

t-tech/T-pro-it-2.1-GGUF

33B • Updated Dec 23, 2025 • 2.83k • 11

tp7030/Qwen3-Coder-30B-A3B-Instruct-FP8-Q6_K-GGUF

Text Generation • 31B • Updated Dec 26, 2025 • 143 • 8

jwest33/gemma-3-4b-null-space-abliterated-RP-writer-GGUF

4B • Updated Jan 9 • 1.74k • 2

AlfRjw/prompt-enhancer-gemma-3-270m-it-Q8_0-GGUF

Text Generation • 0.3B • Updated Jan 15 • 132 • 1

fdtn-ai/Foundation-Sec-8B-Reasoning-Q4_K_M-GGUF

Text Generation • 8B • Updated Feb 18 • 8.01k • 9

lainlives/Qwen3-Coder-30B-A3B-Instruct_Pruned_REAP-15B-A3B-SafeTensors-Q8_0-GGUF

16B • Updated Jan 31 • 102 • 2

jinaai/jina-embeddings-v5-text-small-classification

Text Classification • 0.6B • Updated Apr 15 • 3.96k • 7

jinaai/jina-embeddings-v5-text-nano-classification

Text Classification • 0.2B • Updated Apr 15 • 8.9k • 17

rizkysulaeman/Gemma3N-4B-Conv-MM-Img-Audio-Text-Code-Reasoning-Q8_0-GGUF

Any-to-Any • 7B • Updated Feb 19 • 177 • 3

jinaai/jina-embeddings-v5-text-nano-retrieval-GGUF

Sentence Similarity • 0.2B • Updated Feb 27 • 6.66k • 5