mlx-community/K2-Horizon-MoVA-36B-A4B-bf16
Text Generation • 37B • Updated • 332
K2-Horizon
MLX conversions of IFM K2-Horizon model family
Note Unquantized bf16, 70 GB. For 128 GB Macs.
mlx-community/K2-Horizon-MoVA-36B-A4B-8bit
Text Generation • 37B • Updated • 126 • 1Note 8-bit, 37 GB, effectively lossless (+0.04% ppl).
mlx-community/K2-Horizon-MoVA-36B-A4B-4bit
Text Generation • 37B • Updated • 315 • 3Note Mixed 4-bit, 25 GB (+1.2% ppl). For 48 GB+ Macs.
mlx-community/K2-Horizon-7B-bf16
Text Generation • 9B • Updated • 362Note 7B dense, unquantized bf16, 18 GB. For 32 GB+ Macs.
mlx-community/K2-Horizon-7B-8bit
Text Generation • 9B • Updated • 46Note 7B dense, 8-bit, 9.6 GB, effectively lossless (+0.2% ppl).
mlx-community/K2-Horizon-7B-4bit
Text Generation • 9B • Updated • 63Note 7B dense, mixed 4-bit, 7.2 GB (+4.5% ppl). For 16 GB+ Macs.
mlx-community/K2-Horizon-3.7B-bf16
Text Generation • 5B • Updated • 370Note 3.7B dense, unquantized bf16, 10 GB. For 24 GB+ Macs.
mlx-community/K2-Horizon-3.7B-8bit
Text Generation • 5B • Updated • 45Note 3.7B dense, 8-bit, 5.4 GB, effectively lossless (-0.04% ppl).
mlx-community/K2-Horizon-3.7B-4bit
Text Generation • 5B • Updated • 69Note 3.7B dense, mixed 4-bit, 4.2 GB (+4.4% ppl). For 16 GB+ Macs.
mlx-community/K2-Horizon-0.9B-bf16
Text Generation • 1B • Updated • 393Note 0.9B dense (YaRN, 128K context), unquantized bf16, 2.2 GB.
mlx-community/K2-Horizon-0.9B-8bit
Text Generation • 1B • Updated • 26Note 0.9B dense, 8-bit, 1.2 GB, effectively lossless (+0.3% ppl).
mlx-community/K2-Horizon-0.9B-4bit
Text Generation • 1B • Updated • 35Note 0.9B dense, mixed 4-bit, 0.9 GB (+5.6% ppl).