BoyBarley_X
Fine-tuned from BoyBarley-v32 (494M params) via Knowledge Distillation on 50,000 samples.
Training
| Config | Value |
|---|---|
| Base model | BoyBarley/BoyBarley-v32 |
| Dataset | 50,000 samples |
| Categories | SQL, Logic, Math, Reasoning |
| Epochs | 3 |
| Learning rate | 1e-5 |
| Precision | BF16 |
| Best val loss | 0.0672 |
Benchmark vs v32
| Task | v32 | BoyBarley_X |
|---|---|---|
| SQL basic | β | β More consistent |
| SQL aggregate | β οΈ | β οΈ Partial |
| Math basic | β οΈ | β Improved |
| Probability | β | β Correct |
| Syllogism | β οΈ | β Improved |
| Trick questions | β οΈ | β Improved |
| Fibonacci/Pattern | β | β Still weak |
| Multi-step math | β | β Still weak |
Next: BoyBarley_X2
- Chain-of-thought dataset for math and logic
- Fibonacci and sequence training data
- Compound percentage problems
- Target: 100k samples
- Downloads last month
- 3
Inference Providers NEW
This model isn't deployed by any Inference Provider. π Ask for provider support
Model tree for BoyBarley/BoyBarley_X
Base model
BoyBarley/BoyBarley-v32