Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

45,389

Base only

Active filters: 4-bit

TheBloke/openbuddy-mixtral-7bx8-v16.3-32k-AWQ

Text Generation • 47B • Updated Jan 3, 2024 • 9 • 3

TheBloke/Thespis-Mistral-7B-Alpha-v0.7-GPTQ

Text Generation • 7B • Updated Jan 3, 2024 • 9 • 3

TheBloke/openbuddy-mixtral-7bx8-v16.3-32k-GPTQ

Text Generation • 47B • Updated Jan 3, 2024 • 10 • 2

msaavedra1234/TinyLlama-Alpaca-unsloth

Text Generation • 1B • Updated Jan 3, 2024 • 6

TheBloke/OpenCAI-7B-GPTQ

Text Generation • 7B • Updated Jan 3, 2024 • 9 • 2

TheBloke/OpenCAI-7B-AWQ

Text Generation • 7B • Updated Jan 3, 2024 • 4 • 1

TheBloke/OpenCAI-13B-AWQ

Text Generation • 13B • Updated Jan 3, 2024 • 7 • 2

TheBloke/OpenCAI-13B-GPTQ

Text Generation • 13B • Updated Jan 3, 2024 • 9 • 4

msaavedra1234/tinyllama_alpaca

Text Generation • 1B • Updated Jan 3, 2024 • 3

ahmed-ai/galen

Text Generation • 7B • Updated Dec 9, 2024 • 15

dmntrd/zephyr-7b-beta-rocio-2

Text Generation • 7B • Updated Jan 3, 2024 • 3

TheBloke/Unholy-v2-13B-GPTQ

Text Generation • 13B • Updated Jan 3, 2024 • 19 • 21

TheBloke/Unholy-v2-13B-AWQ

Text Generation • 13B • Updated Jan 3, 2024 • 11 • 7

ura-hcmut/MixSUra-AWQ

Text Generation • 47B • Updated Mar 27, 2024

DS-Archive/limarp-deepseek-67b-qlora

Updated Jan 8, 2024 • 2

yujiepan/Llama-2-7b-hf-awq-w4g128

Text Generation • 7B • Updated Jan 3, 2024 • 6

yujiepan/Llama-2-13b-hf-awq-w4g128

Text Generation • 13B • Updated Jan 3, 2024 • 5

TheBloke/Panda-7B-v0.1-GPTQ

Text Generation • 7B • Updated Jan 3, 2024 • 8 • 1

TheBloke/Panda-7B-v0.1-AWQ

Text Generation • 7B • Updated Jan 3, 2024 • 8 • 1

chekable/mistral-abstract-finetune-quantize

Text Generation • 7B • Updated Jan 3, 2024

appvoid/palmer-003-turbo

Text Generation • 1B • Updated Jan 4, 2024 • 7 • 1

DS-Archive/limarp-zloss-mixtral-8x7b-qlora

Updated Jan 5, 2024 • 9 • 2

TheBloke/FlatDolphinMaid-8x7B-AWQ

Text Generation • 47B • Updated Jan 4, 2024 • 10 • 3

TheBloke/FlatDolphinMaid-8x7B-GPTQ

Text Generation • 47B • Updated Jan 4, 2024 • 9 • 6

lewtun/zephyr-7b-sft-qlora

Updated Jan 4, 2024 • 5

mlx-community/CodeLlama-7b-Python-hf-4bit-mlx

Text Generation • Updated Jan 4, 2024 • 19

mlx-community/Mistral-7B-Instruct-v0.1-4bit-mlx

Text Generation • Updated Jan 4, 2024 • 38 • 1

TheBloke/WordWoven-13B-AWQ

Text Generation • 13B • Updated Jan 4, 2024 • 7 • 2

TheBloke/WordWoven-13B-GPTQ

Text Generation • 13B • Updated Jan 4, 2024 • 12 • 3

fazil1234/newGPTQ

Text Generation • 0.1B • Updated Jan 4, 2024 • 4