Quantized-Drafters - a inference-optimization Collection

inference-optimization 's Collections

Quantized-Drafters

Quantized-Drafters

updated 2 days ago

inference-optimization/Qwen3-8B-DFlash-Gauss-FP8-W8A8

Text Generation • 1B • Updated 6 days ago • 22

Note Static FP8 W8A8; Gaussian calibration.
inference-optimization/Qwen3-8B-DFlash-PerfectBlend-FP8-W8A8

Text Generation • 1B • Updated 6 days ago • 21

Note Static FP8 W8A8; PerfectBlend calibration.
inference-optimization/Qwen3-8B-DFlash-Gauss-NVFP4-W4A4

Text Generation • 1B • Updated 6 days ago • 99

Note NVFP4 W4A4; Gaussian calibration.
inference-optimization/Qwen3-8B-DFlash-PerfectBlend-NVFP4-W4A4

Text Generation • 1B • Updated 6 days ago • 95

Note NVFP4 W4A4; PerfectBlend calibration.
inference-optimization/Qwen3-8B-DFlash-FP8-DYNAMIC

Text Generation • 2B • Updated 6 days ago • 28

Note FP8_DYNAMIC; data-free.
inference-optimization/Qwen3-8B-DFlash-FP8-BLOCK

Text Generation • 2B • Updated 2 days ago • 21
inference-optimization/Qwen3-8B-DFlash-GPTQ-Gauss-NVFP4-W4A4

Text Generation • 1B • Updated 2 days ago • 21
inference-optimization/Qwen3-8B-DFlash-GPTQ-PerfectBlend-NVFP4-W4A4

Text Generation • 1B • Updated 2 days ago • 20
inference-optimization/Qwen3-8B-DFlash-GPTQ-IMatrix-Gauss-NVFP4-W4A4

Text Generation • 1B • Updated 2 days ago • 22
inference-optimization/Qwen3-8B-DFlash-GPTQ-IMatrix-PerfectBlend-NVFP4-W4A4

Text Generation • 1B • Updated 2 days ago • 24
inference-optimization/Qwen3.8-27B-DSpark-FP8-BLOCK

Text Generation • 2B • Updated 2 days ago • 24
inference-optimization/Qwen3.8-27B-DSpark-FP8-DYNAMIC

Text Generation • 2B • Updated 2 days ago • 30
inference-optimization/Qwen3.8-27B-DSpark-Gauss-FP8-W8A8

Text Generation • 2B • Updated 2 days ago • 26
inference-optimization/Qwen3.8-27B-DSpark-PerfectBlend-FP8-W8A8

Text Generation • 2B • Updated 2 days ago • 26
inference-optimization/Qwen3.8-27B-DSpark-Gauss-NVFP4-W4A4

Text Generation • 2B • Updated 2 days ago • 134
inference-optimization/Qwen3.8-27B-DSpark-PerfectBlend-NVFP4-W4A4

Text Generation • 2B • Updated 2 days ago • 133
inference-optimization/Qwen3.8-27B-DSpark-GPTQ-Gauss-NVFP4-W4A4

Text Generation • 2B • Updated 2 days ago • 24
inference-optimization/Qwen3.8-27B-DSpark-GPTQ-PerfectBlend-NVFP4-W4A4

Text Generation • 2B • Updated 2 days ago • 22
inference-optimization/Qwen3.8-27B-DSpark-GPTQ-IMatrix-Gauss-NVFP4-W4A4

Text Generation • 2B • Updated 2 days ago • 26
inference-optimization/Qwen3.8-27B-DSpark-GPTQ-IMatrix-PerfectBlend-NVFP4-W4A4

Text Generation • 2B • Updated 2 days ago • 27