Models I've created as "extra credit" after finishing Sebastian Raschka's book
"[Build a Large Language Model (from Scratch)"
🔄 In a Training Loop
Giles Thomas
gpjt
AI & ML interests
Doing my best to speedrun 20 years of AI research. YMMV
Recent Activity
updated a model about 13 hours ago
gpjt/jax-with-mha-bias-openwebtext published a model about 13 hours ago
gpjt/jax-with-mha-bias-openwebtextOrganizations
None yet
models 42
gpjt/jax-with-mha-bias-openwebtext
Text Generation • 0.2B • Updated
gpjt/jax-with-mha-bias-fw-fwedu-simplewiki
Text Generation • 0.2B • Updated • 535
gpjt/jax-with-mha-bias-fw-fwedu-5050
Text Generation • 0.2B • Updated • 155 • 1
gpjt/1xrtx3090-moe-1
Text Generation • 0.5B • Updated • 493
gpjt/jax-with-mha-bias-fineweb-edu
Text Generation • 0.2B • Updated • 264
gpjt/jax-with-mha-bias-larger-chinchilla-1
Text Generation • 0.3B • Updated • 284
gpjt/jax-with-mha-bias-larger-chinchilla-2
Text Generation • 0.2B • Updated • 274
gpjt/jax-with-mha-bias-no-dropout-2-epoch
Text Generation • 0.2B • Updated • 234
gpjt/jax-with-mha-bias-no-dropout-extended
Text Generation • 0.2B • Updated • 256
gpjt/jax-no-mha-bias-no-dropout
Text Generation • 0.2B • Updated • 329