Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

MeganEFlynn updated a dataset 1 day ago

inference-optimization/Gemma4-Responses-Nemotron

MeganEFlynn published a dataset 1 day ago

inference-optimization/Gemma4-Responses-Nemotron

ChibuUkachi updated a model 2 days ago

inference-optimization/Ministral-3-14B-Instruct-2512-NVFP4

View all activity

inference-optimization 's models 352

inference-optimization/gpt-oss-20b-from-gpt-oss-120b-ckpt0-speculator.eagle3

0.9B • Updated Mar 18 • 1

inference-optimization/Llama-3.1-8B-Instruct-NVFP4-DDP8

5B • Updated Mar 18

inference-optimization/Mistral3_speculator_dummy

2B • Updated Mar 17

inference-optimization/Phi-4-reasoning-vision-15B-FP8-dynamic

15B • Updated Mar 17 • 3

inference-optimization/Qwen3-32B-from-Qwen3-235B_resps-speculators.eagle3-ckpt0

2B • Updated Mar 17 • 3

inference-optimization/gpt-oss-120b-from-qwen235b-ckpt5-speculator.eagle3

0.9B • Updated Mar 16 • 3

inference-optimization/gpt-oss-120b-from-qwen235b-ckpt4-speculator.eagle3

0.9B • Updated Mar 15 • 2

inference-optimization/gpt-oss-120b-ckpt4-speculator.eagle3

0.9B • Updated Mar 12 • 2

inference-optimization/gpt-oss-120b-ckpt3-speculator.eagle3

0.9B • Updated Mar 12

inference-optimization/Qwen3-Coder-Next.w4a16

Text Generation • 12B • Updated Mar 12 • 35 • 1

inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_heuristic

3B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_noise

3B • Updated Mar 12

inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_hybrid

3B • Updated Mar 12 • 4

inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_heuristic

3B • Updated Mar 12

inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_noise

3B • Updated Mar 12

inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_hybrid

3B • Updated Mar 12

inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_heuristic

3B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_noise

3B • Updated Mar 12 • 2

inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_hybrid

3B • Updated Mar 12 • 3

inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_heuristic

3B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_noise

3B • Updated Mar 12

inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_hybrid

3B • Updated Mar 12

inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_heuristic

3B • Updated Mar 12 • 3

inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_noise

3B • Updated Mar 12

inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_hybrid

3B • Updated Mar 12 • 3

inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_noise

1B • Updated Mar 12

inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_noise

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_hybrid

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_noise

1B • Updated Mar 12 • 1

inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_hybrid

1B • Updated Mar 12 • 1