inference-optimization/gpt-oss-20b-from-gpt-oss-120b-ckpt0-speculator.eagle3
0.9B • Updated
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-DDP8
5B • Updated
inference-optimization/Qwen3-235B-A22B-Thinking-2507.w8a8
235B • Updated
inference-optimization/Qwen3-235B-A22B-Instruct-2507.w8a8
235B • Updated
inference-optimization/Qwen3-Next-80B-A3B-Instruct_mtp_speculator
Text Generation • 2B • Updated • 40
inference-optimization/Mistral-Small-4-119B-2603-BF16
119B • Updated
inference-optimization/Mistral3_speculator_dummy
2B • Updated • 11
inference-optimization/Phi-4-reasoning-vision-15B-FP8-dynamic
15B • Updated
inference-optimization/Qwen3-235B-A22B-Thinking-2507.w4a16
32B • Updated
inference-optimization/Qwen3-235B-A22B-Instruct-2507.w4a16
32B • Updated
inference-optimization/Qwen3-32B-from-Qwen3-235B_resps-speculators.eagle3-ckpt0
2B • Updated • 44
inference-optimization/gpt-oss-120b-from-qwen235b-ckpt5-speculator.eagle3
0.9B • Updated • 32
inference-optimization/gpt-oss-120b-from-qwen235b-ckpt4-speculator.eagle3
0.9B • Updated • 32
inference-optimization/gpt-oss-120b-ckpt4-speculator.eagle3
0.9B • Updated • 30
inference-optimization/gpt-oss-120b-ckpt3-speculator.eagle3
0.9B • Updated • 46
inference-optimization/Qwen3-Coder-Next.w4a16
Text Generation • 12B • Updated • 1.64k
inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_heuristic
3B • Updated • 15
inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_noise
3B • Updated • 13
inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_hybrid
3B • Updated • 15
inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_heuristic
3B • Updated • 16
inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_noise
3B • Updated • 16
inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_hybrid
3B • Updated • 15
inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_heuristic
3B • Updated • 15
inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_noise
3B • Updated • 16
inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_hybrid
3B • Updated • 14
inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_heuristic
3B • Updated • 15
inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_noise
3B • Updated • 14
inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_hybrid
3B • Updated • 16
inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_heuristic
3B • Updated • 16
inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_noise
3B • Updated • 15