Intel Neural Compressor

INC4AI 's models 17

Sort:  Recently updated

INC4AI/DeepSeek-Math-V2-int4-AutoRound

3B • Updated 1 day ago • 2

INC4AI/DeepSeek-V3.2-Speciale-int4-AutoRound

3B • Updated 2 days ago • 1

INC4AI/unsloth-DeepSeek-R1-BF16-4Layers-Test-Only

15B • Updated 3 days ago • 38

INC4AI/Qwen3-8B-FP8_STATIC-FP8-Attn-LLMC-Test-Only

8B • Updated 4 days ago • 9

INC4AI/Youtu-LLM-2B-int4-AutoRound

Text Generation • 0.5B • Updated 9 days ago • 21

INC4AI/WeDLM-8B-Instruct-int4-AutoRound

Text Generation • 1B • Updated 9 days ago • 15

INC4AI/MiniMax-M2.1-int4-AutoRound

Text Generation • 1B • Updated 9 days ago • 29

INC4AI/Qwen2.5-0.5B-Instruct-FP8-Dynamic-LLMC-TEST-Only

0.5B • Updated 11 days ago • 13

INC4AI/ds-v32-exp-w4a16-test-only

3B • Updated 14 days ago • 11

INC4AI/DS-V3.2-fp8-w4a16-test-only

3B • Updated 14 days ago • 14

INC4AI/DeepSeek-R1_mxfp8

Updated 22 days ago

INC4AI/DeepSeek-V2-Lite-Chat-FP8-STATIC-ATTN-TEST-ONLY

16B • Updated 23 days ago • 8

INC4AI/DeepSeek-V2-Lite-Chat-BF16-FP8-STATIC-FP8-KV-TEST-ONLY

16B • Updated Dec 29, 2025 • 769

INC4AI/DeepSeek-V2-Lite-Chat-Block-wise-FP8-Test-Only

16B • Updated Dec 29, 2025 • 8

INC4AI/Qwen3-235B-A22B-W4A16-G128-AutoRound-ITERS200-LLMC-TEST-ONLY

32B • Updated Dec 19, 2025

INC4AI/Qwen3-235B-A22B-W4A16-G128-AutoRound-ITERS1-LLMC-TEST-ONLY

Updated Dec 19, 2025

INC4AI/Qwen2.5-0.5B-W4A16-G128-AutoRound-LLMC-TEST-ONLY

Updated Dec 5, 2025