TmaKiss commited on
Commit
33194dd
·
verified ·
1 Parent(s): 724fd6b

Add model card

Browse files
Files changed (1) hide show
  1. README.md +62 -0
README.md ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: prl-1.0
4
+ license_link: https://github.com/zju3dv/UniVerse/blob/main/LICENSE
5
+ tags:
6
+ - video-diffusion
7
+ - image-restoration
8
+ - 3d-reconstruction
9
+ - nerf
10
+ ---
11
+
12
+ # UniVerse checkpoints
13
+
14
+ Weights of the video diffusion model of **UniVerse: Unleashing the Scene Prior of Video Diffusion Models for Robust Radiance
15
+ Field Reconstruction** (ICCV 2025).
16
+
17
+ [Code](https://github.com/zju3dv/UniVerse) | [Paper](https://arxiv.org/abs/2510.01669) |
18
+ [Project Page](https://jin-cao-tma.github.io/UniVerse.github.io/)
19
+
20
+ | File | Model | Resolution | Training | sha256 |
21
+ |---|---|---|---|---|
22
+ | `universe_512.ckpt` | UniVerse-512 | 320 x 512 | stage 1, 14,520 iterations | `7c86adcd48bb32054d62e4bb47831014b5e9c481f2cea028dfb429e08547bdea` |
23
+
24
+ The file is a weights-only PyTorch Lightning checkpoint (fp32, 10.4 GB) that contains the whole model,
25
+ including the VAE and the OpenCLIP ViT-H/14 encoders.
26
+
27
+ ## Usage
28
+
29
+ In the [GitHub repository](https://github.com/zju3dv/UniVerse), `inference.py` downloads the
30
+ checkpoint into `checkpoints/` on first use:
31
+
32
+ ```bash
33
+ python inference.py --image_dir data/demo/images --out_dir output/demo
34
+ ```
35
+
36
+ or download it manually:
37
+
38
+ ```bash
39
+ hf download TmaKiss/UniVerse universe_512.ckpt --local-dir checkpoints
40
+ ```
41
+
42
+ ## Terms
43
+
44
+ The models are fine-tuned from ViewCrafter's `ViewCrafter_25_sparse` (Apache-2.0), contain the OpenCLIP
45
+ ViT-H/14 weights trained on LAION-2B (MIT), and were trained on
46
+ [DL3DV-10K](https://github.com/DL3DV-10K/Dataset), which is released for non-commercial use
47
+ (CC BY-NC 4.0). The UniVerse release is distributed under the ZJU3DV Project Registration License
48
+ (PRL) v1.0, see the repository's [LICENSE](https://github.com/zju3dv/UniVerse/blob/main/LICENSE).
49
+
50
+ ## Citation
51
+
52
+ ```bibtex
53
+ @misc{cao2025universeunleashingsceneprior,
54
+ title={UniVerse: Unleashing the Scene Prior of Video Diffusion Models for Robust Radiance Field Reconstruction},
55
+ author={Jin Cao and Hongrui Wu and Ziyong Feng and Hujun Bao and Xiaowei Zhou and Sida Peng},
56
+ year={2025},
57
+ eprint={2510.01669},
58
+ archivePrefix={arXiv},
59
+ primaryClass={cs.CV},
60
+ url={https://arxiv.org/abs/2510.01669},
61
+ }
62
+ ```