PEFT
TensorBoard
Safetensors
gemma
alignment-handbook
trl
sft
Generated from Trainer
4-bit precision
bitsandbytes
Instructions to use llama-duo/gemma7b-coding-gpt4o-100k with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use llama-duo/gemma7b-coding-gpt4o-100k with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("google/gemma-7b") model = PeftModel.from_pretrained(base_model, "llama-duo/gemma7b-coding-gpt4o-100k") - Notebooks
- Google Colab
- Kaggle
| { | |
| "epoch": 9.989373007438894, | |
| "total_flos": 7.255013733871649e+18, | |
| "train_loss": 0.5076825852977469, | |
| "train_runtime": 24662.4426, | |
| "train_samples": 92048, | |
| "train_samples_per_second": 6.102, | |
| "train_steps_per_second": 0.191 | |
| } |