DeepSeek R1 Distill Qwen 1.5B for RK3588
This is a conversion from https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B to the RKLLM format for Rockchip devices. This runs on the NPU from the RK3588
W8A8 quantization used. RKLLM version used for conversion: 1.2.1
Main repo
See this for my full collection of converted LLMs for the RK3588's NPU:
https://huggingface.co/Pelochus/ezrkllm-collection
License
Same as the original LLM https://huggingface.co/deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
- Downloads last month
- 26
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support