Instructions to use Salesforce/RetailSim-GRPO-4B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use Salesforce/RetailSim-GRPO-4B with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("google/gemma-3-4b-it") model = PeftModel.from_pretrained(base_model, "Salesforce/RetailSim-GRPO-4B") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -8,50 +8,11 @@ tags:
|
|
| 8 |
- vllm
|
| 9 |
---
|
| 10 |
|
| 11 |
-
# UserGRPO Model
|
| 12 |
|
| 13 |
-
UserGRPO
|
| 14 |
|
| 15 |
-
## Files
|
| 16 |
|
| 17 |
-
|
| 18 |
-
- `adapter_config.json`: PEFT adapter configuration
|
| 19 |
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
This adapter can be served with vLLM by loading the Gemma 3 base model and enabling the LoRA module from this repository.
|
| 23 |
-
|
| 24 |
-
```bash
|
| 25 |
-
PORT=8071
|
| 26 |
-
GPU=0
|
| 27 |
-
MODEL_ID=google/gemma-3-4b-it
|
| 28 |
-
SERVED_MODEL_NAME=gemma3_with_reasoning
|
| 29 |
-
ADAPTER_REPO=sscollab2/gemma3_checkpoint_step100
|
| 30 |
-
|
| 31 |
-
CUDA_VISIBLE_DEVICES="$GPU" vllm serve "$MODEL_ID" \
|
| 32 |
-
--host 0.0.0.0 \
|
| 33 |
-
--port "$PORT" \
|
| 34 |
-
--tensor-parallel-size 1 \
|
| 35 |
-
--gpu-memory-utilization 0.90 \
|
| 36 |
-
--max-model-len 32768 \
|
| 37 |
-
--served-model-name gemma3_base \
|
| 38 |
-
--enable-lora \
|
| 39 |
-
--lora-modules "${SERVED_MODEL_NAME}=${ADAPTER_REPO}" \
|
| 40 |
-
--max-lora-rank 16 \
|
| 41 |
-
--enable-auto-tool-choice \
|
| 42 |
-
--tool-call-parser hermes \
|
| 43 |
-
--limit-mm-per-prompt '{"image":10,"audio":0}'
|
| 44 |
-
```
|
| 45 |
-
|
| 46 |
-
Once the server is ready, call the LoRA-served model name:
|
| 47 |
-
|
| 48 |
-
```bash
|
| 49 |
-
curl http://127.0.0.1:8071/v1/chat/completions \
|
| 50 |
-
-H "Content-Type: application/json" \
|
| 51 |
-
-d '{
|
| 52 |
-
"model": "gemma3_with_reasoning",
|
| 53 |
-
"messages": [
|
| 54 |
-
{"role": "user", "content": "Hello!"}
|
| 55 |
-
]
|
| 56 |
-
}'
|
| 57 |
-
```
|
|
|
|
| 8 |
- vllm
|
| 9 |
---
|
| 10 |
|
| 11 |
+
# UserGRPO Model for Retail Simulations
|
| 12 |
|
| 13 |
+
UserGRPO checkpoint based on Gemma-3 for agent simulations in [SalesSim](https://arxiv.org/html/2605.08334v1). This model has been trained to adhere to persona specifications in dialogue-based retail simulations, as specified by preferences and dealbreakers.
|
| 14 |
|
|
|
|
| 15 |
|
| 16 |
+
## License
|
|
|
|
| 17 |
|
| 18 |
+
CC-BY-NC 4.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|