DrishtiSharma/dense-baseline
8B • Updated
Pruning
-
-
DrishtiSharma/aya-c4-sparsity-0.5-gmp
8B • Updated -
DrishtiSharma/aya_sparsity_0.5_wbits_4
8B • Updated -
DrishtiSharma/aya_sparsity_prunen_2_prunem_4
8B • Updated • 1 -
DrishtiSharma/aya_uniform_sparsity_0.5
8B • Updated • 1 -
yaya-sy/aya-4b-kld-pruning
Text Generation • 4B • Updated • 2 • 1 -
SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot
Paper • 2301.00774 • Published • 4 -
ShortGPT: Layers in Large Language Models are More Redundant Than You Expect
Paper • 2403.03853 • Published • 66 -
LLM-Pruner: On the Structural Pruning of Large Language Models
Paper • 2305.11627 • Published • 3 -
Pruning as a Domain-specific LLM Extractor
Paper • 2405.06275 • Published • 1 -
A Simple and Effective Pruning Approach for Large Language Models
Paper • 2306.11695 • Published • 3 -
Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning
Paper • 2310.06694 • Published • 3 -
Streamlining Redundant Layers to Compress Large Language Models
Paper • 2403.19135 • Published • 1 -
LaCo: Large Language Model Pruning via Layer Collapse
Paper • 2402.11187 • Published • 2