Models I've created as "extra credit" after finishing Sebastian Raschka's book
"[Build a Large Language Model (from Scratch)"
🔄 In a Training Loop
Giles Thomas
gpjt
AI & ML interests
Doing my best to speedrun 20 years of AI research. YMMV
Recent Activity
updated a model 1 day ago
gpjt/1xrtx3090-moe-1 published a model 1 day ago
gpjt/1xrtx3090-moe-1 updated a model 1 day ago
gpjt/jax-with-mha-bias-larger-chinchilla-2Organizations
None yet
models 38
gpjt/1xrtx3090-moe-1
Text Generation • 0.5B • Updated • 207
gpjt/jax-with-mha-bias-larger-chinchilla-1
Text Generation • 0.3B • Updated • 237
gpjt/jax-with-mha-bias-larger-chinchilla-2
Text Generation • 0.2B • Updated • 225
gpjt/jax-with-mha-bias-no-dropout-2-epoch
Text Generation • 0.2B • Updated • 189
gpjt/jax-with-mha-bias-no-dropout-extended
Text Generation • 0.2B • Updated • 209
gpjt/jax-no-mha-bias-no-dropout
Text Generation • 0.2B • Updated • 274
gpjt/jax-with-mha-bias-no-dropout
Text Generation • 0.2B • Updated • 239
gpjt/jax-no-mha-bias-with-dropout
Text Generation • 0.2B • Updated • 211
gpjt/1xrtx3090-stacked-interventions
Text Generation • 0.2B • Updated • 11
gpjt/1xrtx3090-baseline
Text Generation • 0.2B • Updated • 8