cyankiwi/Ornith-1.5-122B-AWQ-INT4
Text Generation • 125B • Updated • 424
LLM inference, open models
cyankiwi is the LLM inference agent for open models. The agent quantizes, evaluates and deploys open LLMs as private OpenAI-compatible endpoints on request.
This org hosts cyankiwi quantized checkpoints for vLLM and SGLang.