nm-testing/Meta-Llama-3-8B-Instruct-W8A8-FP8-Channelwise-compressed-tensors
Text Generation • 8B • Updated • 33 • 2
NM Testing
company
AI & ML interests
None defined yet.
Recent Activity
View all activity
nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Dyn-Per-Token-2048-Samples
Text Generation • 8B • Updated • 176
nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Dyn-Per-Token
Text Generation • 8B • Updated • 164
nm-testing/Meta-Llama-3-8B-Instruct-W8-Channel-A8-Dynamic-Per-Token-Test
Text Generation • 8B • Updated • 184
nm-testing/Meta-Llama-3-8B-Instruct-W8-Channel-A8-Dynamic-Asym-Per-Token-Test
8B • Updated • 885 • 1
nm-testing/Meta-Llama-3-8B-Instruct-W4A16-compressed-tensors-test
Text Generation • 8B • Updated • 207
nm-testing/Meta-Llama-3-8B-Instruct-W4A16-ACTORDER-compressed-tensors-test
Text Generation • 8B • Updated • 153
nm-testing/Meta-Llama-3-8B-Instruct-W4-Group128-A16-Test
Text Generation • 8B • Updated • 159
nm-testing/Meta-Llama-3-8B-Instruct-Non-Uniform-compressed-tensors
Text Generation • 8B • Updated • 151
nm-testing/Meta-Llama-3-8B-Instruct-FP8-K-V
Text Generation • 8B • Updated • 22
nm-testing/Meta-Llama-3-8B-FP8-compressed-tensors-test-bos
Text Generation • 8B • Updated • 27
nm-testing/Meta-Llama-3-8B-FP8-compressed-tensors-test
Text Generation • 8B • Updated • 4.92k
nm-testing/Llama-3.2-1B-instruct-attn-quant
1B • Updated • 18
nm-testing/Llama-3.2-1B-Instruct-transformed-w4a16
1B • Updated • 18
nm-testing/Llama-3.2-1B-Instruct-group-activations
1B • Updated • 16
nm-testing/Llama-3.2-1B-Instruct-attention-fp8-head
1B • Updated • 17
nm-testing/Llama-3.1-8B-Instruct-QKV-FP8-tensor-static_minmax
8B • Updated • 14
nm-testing/Llama-3.1-8B-Instruct-QKV-FP8-attn_head-static_minmax
8B • Updated • 26
nm-testing/Llama-3.1-8B-Instruct-QKV-FP8-Tensor
8B • Updated • 20
nm-testing/Llama-3.1-8B-Instruct-QKV-FP8-Head
8B • Updated • 17
nm-testing/Llama-3.1-8B-Instruct-KV-FP8-tensor-static_minmax
8B • Updated • 108
nm-testing/Llama-3.1-8B-Instruct-KV-FP8-attn_head-static_minmax
8B • Updated • 20
nm-testing/Llama-3.1-8B-Instruct-KV-FP8-Tensor
8B • Updated • 17
nm-testing/Llama-3.1-8B-Instruct-KV-Cache-FP8
8B • Updated • 20
nm-testing/DeepSeek-R1-Distill-Qwen-14B2of4-W8A8-FP8-Dynamic-Per-Token
15B • Updated • 26
nm-testing/Qwen3.8-27B-NVFP4-FP8
20B • Updated • 80
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-Static-Asym-e2e
1B • Updated • 7
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A8-Dynamic-Asym-e2e
1B • Updated • 5
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16-e2e
1B • Updated • 8
nm-testing/TinyLlama-1.1B-Chat-v1.0-W8A16_channel-e2e
1B • Updated • 2