Inference Optimization

inference-optimization's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Articles

soyrsoyr 

updated 9 models about 7 hours ago

inference-optimization/Inkling-0.92B-MTP

Image-Text-to-Text • 0.9B • Updated about 7 hours ago • 7

inference-optimization/GLM-5-0.88B-MTP-FP8-Dynamic-MFPTQ

Text Generation • 0.9B • Updated about 7 hours ago • 5

inference-optimization/GLM-5-0.88B-MTP

Text Generation • 0.9B • Updated about 7 hours ago • 5

inference-optimization/DeepSeek-V3-0.86B-MTP-FP8-Dynamic

Text Generation • 0.9B • Updated about 7 hours ago • 6

inference-optimization/DeepSeek-V3-0.86B-MTP

Text Generation • 0.9B • Updated about 7 hours ago • 9

inference-optimization/GLM-4.7-Flash-0.82B-MTP-FP8-Dynamic

Text Generation • 0.8B • Updated about 7 hours ago • 4

inference-optimization/GLM-4.7-Flash-0.82B-MTP

Text Generation • 0.8B • Updated about 7 hours ago • 5

inference-optimization/GLM-4.5-Air-0.72B-MTP-FP8-Dynamic

Text Generation • 0.7B • Updated about 7 hours ago • 5

inference-optimization/GLM-4.5-Air-0.72B-MTP

Text Generation • 0.7B • Updated about 7 hours ago • 6

soyrsoyr 

updated 2 collections 1 day ago

Tiny Models

Collection

Tiny models used for testing • 33 items • Updated 1 day ago • 3

llm-c mtp test models

Collection

Toy-trained BF16/FP8 fixtures for PR #3225 on Transformers 5.17. Model cards document DSA and Inkling limitations. • 9 items • Updated 1 day ago