MiniLLM/MiniLLM-gpt2-340M
Text Generation • Updated • 1.41k • 5
AI & ML interests
Training efficient language models (MiniLLM, MiniPLM)
MiniLLM/SFT-gpt2-120M
Text Generation • 0.1B • Updated • 370
MiniLLM/SFT-gpt2-760M
Text Generation • 0.8B • Updated • 44
MiniLLM/MiniPLM-Qwen-500M
Text Generation • 0.5B • Updated • 596 • • 7
MiniLLM/MiniPLM-llama3.1-212M
Text Generation • 0.2B • Updated • 19 • 6
MiniLLM/MiniPLM-Mamba-130M
Text Generation • 0.1B • Updated • 38 • 4
MiniLLM/MiniPLM-Qwen-1.2B
Text Generation • 1B • Updated • 291 • 4
MiniLLM/Ref-Pretrain-Qwen-104M
Text Generation • 0.1B • Updated • 227 • 5
MiniLLM/Pretrain-Qwen-1.2B
Text Generation • 1B • Updated • 20
MiniLLM/Pretrain-Qwen-500M
Text Generation • 0.5B • Updated • 55
MiniLLM/Pretrain-Qwen-200M
Text Generation • 0.2B • Updated • 85
MiniLLM/VanillaKD-Pretrain-Qwen-200M
Text Generation • 0.2B • Updated • 45
MiniLLM/VanillaKD-Pretrain-Qwen-500M
Text Generation • 0.5B • Updated • 33 •
MiniLLM/VanillaKD-Pretrain-Qwen-1.2B
Text Generation • 1B • Updated • 21
MiniLLM/init-gpt2-120M
Text Generation • 0.1B • Updated • 362 • 1
MiniLLM/teacher-Llama-13B
Text Generation • Updated • 10
MiniLLM/MiniLLM-Llama-7B
Text Generation • Updated • 12 • 3
MiniLLM/MiniPLM-Qwen-200M
Text Generation • 0.2B • Updated • 1.25k • 9
MiniLLM/init-Llama-7B
Text Generation • Updated • 11
MiniLLM/teacher-OPT-13B
Text Generation • Updated • 55
MiniLLM/SeqKD-Llama-7B
Text Generation • Updated • 14
MiniLLM/KD-Llama-7B
Text Generation • Updated • 9
MiniLLM/SFT-Llama-7B
Text Generation • Updated • 8
MiniLLM/init-OPT-6.7B
Text Generation • Updated • 14
MiniLLM/init-OPT-2.7B
Text Generation • Updated • 17
MiniLLM/init-OPT-1.3B
Text Generation • Updated • 17
MiniLLM/SeqKD-OPT-6.7B
Text Generation • Updated • 37
MiniLLM/SeqKD-OPT-2.7B
Text Generation • Updated • 40
MiniLLM/SeqKD-OPT-1.3B
Text Generation • Updated • 42
MiniLLM/KD-OPT-6.7B
Text Generation • Updated • 37