Instructions to use SulphurAI/Sulphur-2-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use SulphurAI/Sulphur-2-base with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("SulphurAI/Sulphur-2-base", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - llama-cpp-python
How to use SulphurAI/Sulphur-2-base with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="SulphurAI/Sulphur-2-base", filename="prompt_enhancer/mmproj-BF16.gguf", )
llm.create_chat_completion( messages = "\"A young man walking on the street\"" )
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- llama.cpp
How to use SulphurAI/Sulphur-2-base with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf SulphurAI/Sulphur-2-base:BF16 # Run inference directly in the terminal: llama-cli -hf SulphurAI/Sulphur-2-base:BF16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf SulphurAI/Sulphur-2-base:BF16 # Run inference directly in the terminal: llama-cli -hf SulphurAI/Sulphur-2-base:BF16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf SulphurAI/Sulphur-2-base:BF16 # Run inference directly in the terminal: ./llama-cli -hf SulphurAI/Sulphur-2-base:BF16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf SulphurAI/Sulphur-2-base:BF16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf SulphurAI/Sulphur-2-base:BF16
Use Docker
docker model run hf.co/SulphurAI/Sulphur-2-base:BF16
- LM Studio
- Jan
- Ollama
How to use SulphurAI/Sulphur-2-base with Ollama:
ollama run hf.co/SulphurAI/Sulphur-2-base:BF16
- Unsloth Studio new
How to use SulphurAI/Sulphur-2-base with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for SulphurAI/Sulphur-2-base to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for SulphurAI/Sulphur-2-base to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for SulphurAI/Sulphur-2-base to start chatting
- Pi new
How to use SulphurAI/Sulphur-2-base with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf SulphurAI/Sulphur-2-base:BF16
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "SulphurAI/Sulphur-2-base:BF16" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use SulphurAI/Sulphur-2-base with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama-server -hf SulphurAI/Sulphur-2-base:BF16
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default SulphurAI/Sulphur-2-base:BF16
Run Hermes
hermes
- Docker Model Runner
How to use SulphurAI/Sulphur-2-base with Docker Model Runner:
docker model run hf.co/SulphurAI/Sulphur-2-base:BF16
- Lemonade
How to use SulphurAI/Sulphur-2-base with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull SulphurAI/Sulphur-2-base:BF16
Run and chat with the model
lemonade run user.Sulphur-2-base-BF16
List all available models
lemonade list
workflows
First of all, I would like to thank the author for their selfless contribution. Could you please provide the workflow for this model? Thank you.
bro theres literally a workflows folder
bro theres literally a workflows folder
I know that, but as a beginner, I don't quite understand where the model needs to be replaced.
I know that, but as a beginner, I don't quite understand where the model needs to be replaced.
author said on reddit tomorrow same time will be updated repo
I know that, but as a beginner, I don't quite understand where the model needs to be replaced.
author said on reddit tomorrow same time will be updated repo
okay, sir
I'm really hoping for a new t2v workflow. I've already added in ltxv chunk feedforward with other nodes to make it run effortlessly on 16gb vram no matter the length. But would like a workflow from the creator.
bro theres literally a workflows folder
There is, and it's worthless.
It contains multiple errors in the workflow that require fixed before use and still produces the single worst output quality results I've ever seen in a WF. I didn't even know it was possible to have such low quality outputs from LTX 2.3.
The creator has stated they will fix the WFs Soon(TM) but days have passed and a basic WF hasn't been updated at all nor any meaningful update. In fact, two of the WFs are literally blank pages and the other two have the same issues. Exceptionally poor support for something so basic and easy to update can really harm a project's image, even though the model actually seems relatively good. Speaking honestly, the project should have been delayed by a few days to provide a better release. However, what's done is done. Hopefully the creator actually does update their info soon, including providing details about some of the model's serious quirks and usage guidelines on how to avoid them to get it to function correctly and less Russian Roulette. However, right now a timely update isn't looking too promising.
bro theres literally a workflows folder
There is, and it's worthless.
It contains multiple errors in the workflow that require fixed before use and still produces the single worst output quality results I've ever seen in a WF. I didn't even know it was possible to have such low quality outputs from LTX 2.3.
The creator has stated they will fix the WFs Soon(TM) but days have passed and a basic WF hasn't been updated at all nor any meaningful update. In fact, two of the WFs are literally blank pages and the other two have the same issues. Exceptionally poor support for something so basic and easy to update can really harm a project's image, even though the model actually seems relatively good. Speaking honestly, the project should have been delayed by a few days to provide a better release. However, what's done is done. Hopefully the creator actually does update their info soon, including providing details about some of the model's serious quirks and usage guidelines on how to avoid them to get it to function correctly and less Russian Roulette. However, right now a timely update isn't looking too promising.
I was able to get it working (the fp8 mixed version) by disabling sulphur_lora_rank_768. Not sure what this lora does, or whether I should be using it with the fp8 mixed workflow but yeah, it produces gibberish when I use it.
bro theres literally a workflows folder
There is, and it's worthless.
It contains multiple errors in the workflow that require fixed before use and still produces the single worst output quality results I've ever seen in a WF. I didn't even know it was possible to have such low quality outputs from LTX 2.3.
The creator has stated they will fix the WFs Soon(TM) but days have passed and a basic WF hasn't been updated at all nor any meaningful update. In fact, two of the WFs are literally blank pages and the other two have the same issues. Exceptionally poor support for something so basic and easy to update can really harm a project's image, even though the model actually seems relatively good. Speaking honestly, the project should have been delayed by a few days to provide a better release. However, what's done is done. Hopefully the creator actually does update their info soon, including providing details about some of the model's serious quirks and usage guidelines on how to avoid them to get it to function correctly and less Russian Roulette. However, right now a timely update isn't looking too promising.
I was able to get it working (the fp8 mixed version) by disabling sulphur_lora_rank_768. Not sure what this lora does, or whether I should be using it with the fp8 mixed workflow but yeah, it produces gibberish when I use it.
It's to be used on normal lrx2.3 model. It "injects" the sulphur model into it as a lora