Instructions to use mlx-community/ACE-Step1.5-MLX-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/ACE-Step1.5-MLX-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir ACE-Step1.5-MLX-4bit mlx-community/ACE-Step1.5-MLX-4bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
Upload folder using huggingface_hub
Browse files
README.md
CHANGED
|
@@ -13,11 +13,9 @@ base_model: ACE-Step/ACE-Step1.5
|
|
| 13 |
|
| 14 |
4-bit quantized MLX weights for [ACE-Step/ACE-Step1.5](https://huggingface.co/ACE-Step/ACE-Step1.5).
|
| 15 |
|
| 16 |
-
Converted and quantized using [mlx-audio](https://github.com/Blaizzy/mlx-audio).
|
| 17 |
-
|
| 18 |
- Decoder and encoder quantized to 4-bit (group_size=64)
|
| 19 |
- VAE, tokenizer, and detokenizer kept in full precision
|
| 20 |
-
- **2.2GB** main model
|
| 21 |
|
| 22 |
## Usage
|
| 23 |
|
|
@@ -34,6 +32,24 @@ for result in model.generate(
|
|
| 34 |
sample_rate = result.sample_rate
|
| 35 |
```
|
| 36 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 37 |
The model uses a 5Hz Language Model planner by default (`use_lm=True`) which generates
|
| 38 |
-
a song blueprint before running the diffusion transformer.
|
| 39 |
-
turbo model to produce music.
|
|
|
|
| 13 |
|
| 14 |
4-bit quantized MLX weights for [ACE-Step/ACE-Step1.5](https://huggingface.co/ACE-Step/ACE-Step1.5).
|
| 15 |
|
|
|
|
|
|
|
| 16 |
- Decoder and encoder quantized to 4-bit (group_size=64)
|
| 17 |
- VAE, tokenizer, and detokenizer kept in full precision
|
| 18 |
+
- **2.2GB** main model + 0.7GB VAE + 2.4GB text encoder
|
| 19 |
|
| 20 |
## Usage
|
| 21 |
|
|
|
|
| 32 |
sample_rate = result.sample_rate
|
| 33 |
```
|
| 34 |
|
| 35 |
+
## With Vocals
|
| 36 |
+
|
| 37 |
+
```python
|
| 38 |
+
for result in model.generate(
|
| 39 |
+
text="English pop song with clear female vocals, catchy melody",
|
| 40 |
+
lyrics="""[verse]
|
| 41 |
+
Dance with me tonight
|
| 42 |
+
Under the neon lights
|
| 43 |
+
|
| 44 |
+
[chorus]
|
| 45 |
+
We're alive, we're on fire
|
| 46 |
+
Dancing higher and higher
|
| 47 |
+
""",
|
| 48 |
+
duration=60.0,
|
| 49 |
+
vocal_language="en",
|
| 50 |
+
):
|
| 51 |
+
...
|
| 52 |
+
```
|
| 53 |
+
|
| 54 |
The model uses a 5Hz Language Model planner by default (`use_lm=True`) which generates
|
| 55 |
+
a song blueprint before running the diffusion transformer.
|
|
|