yadapruk commited on
Commit
4932dc3
·
verified ·
1 Parent(s): 17f387d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -43
README.md CHANGED
@@ -8,50 +8,11 @@ tags:
8
  - vllm
9
  ---
10
 
11
- # UserGRPO Model
12
 
13
- UserGRPO model from https://arxiv.org/html/2605.08334v1
14
 
15
- ## Files
16
 
17
- - `adapter_model.safetensors`: LoRA adapter weights
18
- - `adapter_config.json`: PEFT adapter configuration
19
 
20
- ## Serving with vLLM
21
-
22
- This adapter can be served with vLLM by loading the Gemma 3 base model and enabling the LoRA module from this repository.
23
-
24
- ```bash
25
- PORT=8071
26
- GPU=0
27
- MODEL_ID=google/gemma-3-4b-it
28
- SERVED_MODEL_NAME=gemma3_with_reasoning
29
- ADAPTER_REPO=sscollab2/gemma3_checkpoint_step100
30
-
31
- CUDA_VISIBLE_DEVICES="$GPU" vllm serve "$MODEL_ID" \
32
- --host 0.0.0.0 \
33
- --port "$PORT" \
34
- --tensor-parallel-size 1 \
35
- --gpu-memory-utilization 0.90 \
36
- --max-model-len 32768 \
37
- --served-model-name gemma3_base \
38
- --enable-lora \
39
- --lora-modules "${SERVED_MODEL_NAME}=${ADAPTER_REPO}" \
40
- --max-lora-rank 16 \
41
- --enable-auto-tool-choice \
42
- --tool-call-parser hermes \
43
- --limit-mm-per-prompt '{"image":10,"audio":0}'
44
- ```
45
-
46
- Once the server is ready, call the LoRA-served model name:
47
-
48
- ```bash
49
- curl http://127.0.0.1:8071/v1/chat/completions \
50
- -H "Content-Type: application/json" \
51
- -d '{
52
- "model": "gemma3_with_reasoning",
53
- "messages": [
54
- {"role": "user", "content": "Hello!"}
55
- ]
56
- }'
57
- ```
 
8
  - vllm
9
  ---
10
 
11
+ # UserGRPO Model for Retail Simulations
12
 
13
+ UserGRPO checkpoint based on Gemma-3 for agent simulations in [SalesSim](https://arxiv.org/html/2605.08334v1). This model has been trained to adhere to persona specifications in dialogue-based retail simulations, as specified by preferences and dealbreakers.
14
 
 
15
 
16
+ ## License
 
17
 
18
+ CC-BY-NC 4.0