Mamba2-1.3B-pre-linear-p20
Checkpoint from the len-gen-regularization length-generalization
experiments.
Loads with stock transformers:
from transformers import AutoModelForCausalLM, AutoTokenizer
tok = AutoTokenizer.from_pretrained("vapavlo/Mamba2-1.3B-pre-linear-p20")
model = AutoModelForCausalLM.from_pretrained("vapavlo/Mamba2-1.3B-pre-linear-p20")
- Downloads last month
- 7
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support