Please update chat template

#4
by alexcardo - opened

How to enable CoT for this quant? Everything work perfectly for the NVFP4 quant. But for this quant I don't see the CoT

Edit: Solved the issue myself by loading the original chat template from Google

alexcardo changed discussion title from Reasoning is not woring at least with vLLM to Please update chat template
Intel org

could you kindly push a pr? so we could merge yours directly.

Intel org

done

Sign up or log in to comment