Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

57

Base only

Active filters: tensorrt-llm

Shoolife/Qwen3-1.7B-TensorRT-LLM-Checkpoint-FP16

Text Generation • Updated Mar 29 • 17

Shoolife/Qwen3-1.7B-TensorRT-LLM-Checkpoint-FP8

Text Generation • Updated Mar 29 • 22

Shoolife/Qwen3-1.7B-TensorRT-LLM-Checkpoint-NVFP4

Text Generation • Updated Mar 29 • 28

Shoolife/Qwen3-4B-TensorRT-LLM-Checkpoint-FP8

Text Generation • Updated Mar 29 • 19

Shoolife/Qwen3-4B-TensorRT-LLM-Checkpoint-NVFP4

Text Generation • Updated Mar 29 • 25

sbull-dell/gemma-4-26B-A4B-NVFP4

14B • Updated Apr 17 • 42

GumbiiDigital/DeepSeek-R1-Distill-Llama-8B-NVFP4

Text Generation • 5B • Updated Apr 23 • 32 • 1

SCIO911/Qwen3.5-9B-Claude-4.6-Opus-Reasoning-Distilled-NVFP4-MLP-FP8KV

Text Generation • 8B • Updated May 6 • 28

tss-deposium/gemma-4-E4B-text-only-nvfp4

Text Generation • 6B • Updated May 8 • 23

tss-deposium/PaddleOCR-VL-1.5-nvfp4

Image-Text-to-Text • 0.6B • Updated May 10 • 26

tss-deposium/PaddleOCR-VL-1.5-mxfp4

Image-Text-to-Text • 0.8B • Updated May 10 • 17

Reza2kn/mega-asr-nvfp4

Automatic Speech Recognition • Updated Sep 9 • 1

BareMetalAI/Qwen3-4B-W4A16-AWQ

Text Generation • 2B • Updated Jun 9 • 14

BareMetalAI/Qwen3-8B-W4A16-AWQ

Text Generation • 5B • Updated Jun 12 • 29

BareMetalAI/Llama-3.1-Nemotron-Nano-8B-W4A16-AWQ

Text Generation • 5B • Updated Jun 12 • 21

BareMetalAI/Mistral-7B-Instruct-v0.3-W4A16-AWQ

Text Generation • 4B • Updated Jun 12 • 37

xThr45hx/TensorRT-LLM-Windows-RTX40

xThr45hx/Josiefied-Qwen3-4B-TRT-LLM

Quatfit/Quatfit-Mini-FP8

Image-Text-to-Text • 8B • Updated Jul 12 • 15 • 1

abanerjee10/Qwen3-235B-A22B-NVFP4

Text Generation • 133B • Updated Jul 16

inference-optimization/DeepSeek-R1-Distill-Llama-8B-NVFP4

Text Generation • 5B • Updated Aug 14 • 45

kristianpaul/Qwen3.8-27B-NVFP4

Text Generation • 15B • Updated Aug 15 • 132 • 1

wyattearp/Qwen3.8-27B-Uncensored-NVFP4

Text Generation • 18B • Updated Aug 24 • 494

raoashish10/Qwen3-8B-NVFP4

Text Generation • 5B • Updated Sep 3 • 128

raoashish10/Qwen3-14B-NVFP4

Text Generation • 8B • Updated Sep 3 • 108

Xananthium/Qwen3.6-35B-A3B-Hauhau-Aggressive-FP8-W8A8-NVFP4-TRTLLM

Image-Text-to-Text • 36B • Updated 5 days ago • 59 • 1

kataguru/Riva-Translate-4B-Instruct-v2-FP8

Translation • 4B • Updated 20 days ago • 33