nm-testing/TinyLlama-1.1B-Chat-v1.0-2of4-Sparse-Dense-Compressor
1B • Updated
• 18
nm-testing/llama-3-fp8-2of4-dynamic-uncompressed
nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic
71B • Updated
• 116
• 13
nm-testing/Meta-Llama-3-8B-Instruct-FP8-Dynamic-IA-Per-Tensor-Weight-testing
8B • Updated
• 17
nm-testing/Meta-Llama-3-8B-Instruct-FP8-Static-Per-Tensor-testing
8B • Updated
• 18
nm-testing/Meta-Llama-3-8B-Instruct-FP8-Static-testing
8B • Updated
• 17
nm-testing/Qwen2-VL-2B-Instruct-FP8-dynamic
nm-testing/Meta-Llama-3-8B-Instruct-FP8-Dynamic-2of4-testing
8B • Updated
• 18
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-FP8-Dynamic-testing
8B • Updated
• 19
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-FP8-Dynamic-Channel-BitMaskCompressed
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-FP8-Dynamic-Channel
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-FP8-Dynamic
nm-testing/TinyLlama-1.1B-Chat-v1.0-pruned_50.2of4-FP8-compressed
0.6B • Updated
• 1
nm-testing/TinyLlama-1.1B-Chat-v1.0-pruned_50.2of4-FP8-uncompressed
nm-testing/Llama-3.1-8B-gsm8k-quantized.w4a16-noactorder
2B • Updated
nm-testing/Sparse-Llama-3.1-8B-evolcodealpaca-pruned.2of4-quantized.w4a16-test
2B • Updated
nm-testing/pixtral-12b-W4A16
3B • Updated
nm-testing/pixtral-12b-W8A8
13B • Updated
• 2
nm-testing/Llama-3.2-90B-Vision-Instruct-quantized.w4a16
14B • Updated
• 3
• 1
nm-testing/Llama-3.2-11B-Vision-Instruct-quantized.w8a8
11B • Updated
nm-testing/Llama-3.1-8B-gsm8k-quantized.w4a16
2B • Updated
nm-testing/debug-gsm8k-llmcompressor_packed
2B • Updated
nm-testing/debug-gsm8k-autogptq_packed
2B • Updated
nm-testing/SparseLlama-3.1-8B-evolcodealpaca-pruned.2of4-FP8-dynamic
8B • Updated
• 2
nm-testing/Qwen2.5-Coder-32B-Instruct-FP8-dynamic
33B • Updated
• 45
• 5
nm-testing/Qwen2.5-32B-Instruct-FP8-dynamic
33B • Updated
• 3.88k
• 2
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-FP8-uncompressed
8B • Updated
nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-FP8-compressed
5B • Updated
nm-testing/Llama-3.1-8B-FP8-compressed
8B • Updated
nm-testing/Llama-3.1-8B-FP8-uncompressed
8B • Updated