How to use from the
Use from the
Transformers library
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("nm-testing/Qwen3-32B-FP8-dynamic-QKV-Cache-FP8-Per-Head", device_map="auto")
Quick Links

Qwen3-32B-FP8-dynamic-QKV-Cache-FP8-Per-Head

Empty model card placeholder.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Collection including nm-testing/Qwen3-32B-FP8-dynamic-QKV-Cache-FP8-Per-Head