GPTQ models quantized with QuaRot.
Harry Chen
cymic
AI & ML interests
None yet
Recent Activity
updated a collection about 20 hours ago
QuaRot GPTQ Models updated a collection about 20 hours ago
QuaRot GPTQ Models updated a collection about 20 hours ago
QuaRot GPTQ ModelsOrganizations
models 19
cymic/llama2-7b-quarot-w8
7B • Updated
cymic/llama2-7b-quarot-w4
7B • Updated
cymic/llama2-7b-quarot-w3
7B • Updated
cymic/llama2-13b-quarot-w8
13B • Updated
cymic/llama2-13b-quarot-w4
13B • Updated
cymic/llama2-13b-quarot-w3
13B • Updated
cymic/qwen3-8b-sq-gptq-w8
8B • Updated
cymic/qwen3-8b-sq-gptq-w4
8B • Updated
cymic/qwen3-8b-sq-gptq-w3
8B • Updated
cymic/llama3.1-8b-instruct-sq-gptq-w8
8B • Updated • 1