larryvrh commited on
Commit
0991470
·
verified ·
1 Parent(s): b604dd5

README: low_vram switch + VRAM notes (ComfyUI node v1.2.2, issue #4)

Browse files
Files changed (1) hide show
  1. README.md +9 -2
README.md CHANGED
@@ -62,6 +62,11 @@ at 4 steps and it breaks.
62
  **and the pruned/curve variants** (`pruned_int8`, `pruned_fp8`); the ComfyUI
63
  node auto-detects a pruned base and re-injects the time-conditioning at run
64
  time, so one LoRA covers every base.
 
 
 
 
 
65
 
66
  ## Weights
67
 
@@ -111,7 +116,9 @@ python generate.py \
111
  - **Resolution / duration**: width/height are multiples of 32; the short edge is
112
  typically 768. Frame count is at 24 fps and snaps to the model's 17·k+5 grid
113
  (124 ≈ 5 s). Validated range ~124–362 frames (~5–15 s).
114
- - **VRAM**: the base model is large (~33 B); an 80 GB GPU is comfortable
115
- (`--offload-adaln` in the standalone script trades ~13 GB of VRAM for CPU RAM).
 
 
116
  - **Audio**: 32 kHz stereo, aligned to the video; the two streams ride different
117
  flow schedules and are integrated each on its own clock.
 
62
  **and the pruned/curve variants** (`pruned_int8`, `pruned_fp8`); the ComfyUI
63
  node auto-detects a pruned base and re-injects the time-conditioning at run
64
  time, so one LoRA covers every base.
65
+ - **`low_vram`** (node switch): off by default (applies the LoRA at run time —
66
+ sharpest, some extra peak VRAM). Turn it **on** if you run out of memory: it
67
+ merges the LoRA into the weights for the lowest peak VRAM, at the cost of a
68
+ **softer result on quantized (`int8` / `fp8` / pruned) bases**. Lowering the
69
+ resolution or frame count also helps.
70
 
71
  ## Weights
72
 
 
116
  - **Resolution / duration**: width/height are multiples of 32; the short edge is
117
  typically 768. Frame count is at 24 fps and snaps to the model's 17·k+5 grid
118
  (124 ≈ 5 s). Validated range ~124–362 frames (~5–15 s).
119
+ - **VRAM**: the base model is large (~33 B); an 80 GB GPU is comfortable at the
120
+ largest resolutions. The ComfyUI node streams the base and adds a `low_vram`
121
+ switch (see above), so it runs on much smaller GPUs. In the standalone script,
122
+ `--offload-adaln` trades ~13 GB of VRAM for CPU RAM.
123
  - **Audio**: 32 kHz stereo, aligned to the video; the two streams ride different
124
  flow schedules and are integrated each on its own clock.