gpjt/1xrtx3090-moe-1
Text Generation • 0.5B • Updated • 219
🔄 In a Training Loop
Giles Thomas
gpjt
AI & ML interests
Doing my best to speedrun 20 years of AI research. YMMV
Recent Activity
updated a model 4 days ago
gpjt/1xrtx3090-moe-1 published a model 4 days ago
gpjt/1xrtx3090-moe-1 updated a model 4 days ago
gpjt/jax-with-mha-bias-larger-chinchilla-2Organizations
None yet
gpjt/jax-with-mha-bias-larger-chinchilla-1
Text Generation • 0.3B • Updated • 249
gpjt/jax-with-mha-bias-larger-chinchilla-2
Text Generation • 0.2B • Updated • 235
gpjt/jax-with-mha-bias-no-dropout-2-epoch
Text Generation • 0.2B • Updated • 201
gpjt/jax-with-mha-bias-no-dropout-extended
Text Generation • 0.2B • Updated • 218
gpjt/jax-no-mha-bias-no-dropout
Text Generation • 0.2B • Updated • 285
gpjt/jax-with-mha-bias-no-dropout
Text Generation • 0.2B • Updated • 249
gpjt/jax-no-mha-bias-with-dropout
Text Generation • 0.2B • Updated • 221
gpjt/1xrtx3090-stacked-interventions
Text Generation • 0.2B • Updated • 11
gpjt/1xrtx3090-baseline
Text Generation • 0.2B • Updated • 8
gpjt/8xa100m40-stacked-interventions-3
Text Generation • 0.2B • Updated • 10
gpjt/8xa100m40-stacked-interventions-2
Text Generation • 0.2B • Updated • 10
gpjt/8xa100m40-stacked-interventions-1
Text Generation • 0.2B • Updated • 11
gpjt/8xa100m40-baseline-8
Text Generation • 0.2B • Updated • 13
gpjt/8xa100m40-baseline-7
Text Generation • 0.2B • Updated • 11
gpjt/8xa100m40-baseline-6
Text Generation • 0.2B • Updated • 12
gpjt/8xa100m40-baseline-4
Text Generation • 0.2B • Updated • 10
gpjt/8xa100m40-baseline-5
Text Generation • 0.2B • Updated • 12
gpjt/8xa100m40-baseline-3
Text Generation • 0.2B • Updated • 11
gpjt/8xa100m40-baseline-2
Text Generation • 0.2B • Updated • 11
gpjt/8xa100m80-no-amp
Text Generation • 0.2B • Updated • 16
gpjt/8xa100m40-weight-decay-cerebras
Text Generation • 0.2B • Updated • 10
gpjt/8xa100m40-weight-decay-gpt2
Text Generation • 0.2B • Updated • 10
gpjt/8xa100m40-qkv-bias
Text Generation • 0.2B • Updated • 11
gpjt/8xa100m40-schedule-learning-rate
Text Generation • 0.2B • Updated • 11
gpjt/8xa100m40-remove-dropout
Text Generation • 0.2B • Updated • 10
gpjt/8xa100m40-baseline
Text Generation • 0.2B • Updated • 14
gpjt/1xrtx3090m24-fineweb-edu-2x
Text Generation • 0.2B • Updated • 9
gpjt/1xrtx3090m24-fineweb-edu
Text Generation • 0.2B • Updated • 11
gpjt/1xrtx3090m24-fineweb
Text Generation • 0.2B • Updated • 9