A collection of GGUF for Illustrious models just to help low memory people and do some experiences:

If you have a specific modelt hat you want the conversion, you can ask that I'll try to do it

===================================================================================

You get	I get
- A one-time credit of $5 when they sign up with your link and adds $10 for the first time - Instant access to Runpod's GPU resources	- A one-time credit of $5 when a user signs up with your link and adds $10 for the first time - Credits on referred user spend during their first 6 months. (5% Serverless and 3% Pods)

GGUF

Model size

6B params

Architecture

lumina2

Hardware compatibility

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support