Boning Cui

Bc-AI's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

posted an update 1 day ago

view post

Post

56

Hello everyone! Today we have resolved the transformers incompatibility for Nova-1-Standard-Preview! It is currently loadable, with trust_remote_code as true. If you don't know what Nova-1-Standard is, we suggest you check out our intro video on the model card! https://huggingface.co/Smilyai-labs/Nova-1-Standard-Preview

See translation

Reply

posted an update 3 days ago

view post

Post

80

Hello everyone! We are Smilyai-labs, a small team of 4 high school students who love AI and find it very interesting! We are super excited to launch our first preview edition of our Nova-Standard model! Nova-1 is a small family of LLM's which we built from scratch! We designed a custom efficient architecture, featuring MoD layers and much more! We have added RoPE, making it perfect to use YaRN for context extrapolation! From internal tests, we have found that it can support 8K reasonably well and 16K with some performance decreases! Please note, that this is only a Beta version for testing, and we are actively working to fix it! We are only a small group of 4 students, so our progress might be a bit slow! Thank you for your patience! Thank you for checking out our work and a small follow would be appreciated! We are constantly updating, and we will roll out a gradio demo ASAP! Our hugging face org is at:

Smilyai-labs . Our model is at: https://huggingface.co/Smilyai-labs/Nova-1-standard-pretrained-preview . The Beta testers org is at:

Smilyai-labs-beta-testers .

See translation

Reply

replied to their post 4 days ago

view reply

Feel free to join the organization! we have posted standard for beta testing already!

posted an update 6 days ago

view post

Post

202

# 🔥 Nova-1 Beta: Test Our New LLMs!

**Smilyai Labs** is building **Nova-1** — open-source LLMs with novel architectures. Join our beta program!

## 🎯 Available Now:

**Nova-1-Standard (1.2B)** — Phase 2 of pretraining in progress
- PPL 13.5 (beats GPT-2 Large!)
- 48K tok/s on consumer GPUs
- Great for code, reasoning, edge deployment

**Nova-1-Large (3.5B)** — Training live RIGHT NOW
- Current: 30.9 PPL, improving fast, loss at 3.5 right now
- Will finish with ~1.7B tokens today
- Better reasoning & longer context

**Nova-1-XL (10B MoE)** — Coming soon (We dont know yet! haha)
- Final Specs not decided yet


## What Makes Nova Special?

✨ **Mixture of Depths (MoD)** — Routes tokens dynamically, 30% faster
✨ **Grouped Query Attention** — Efficient like LLaMA 2/3
✨ **Phased Training** — Fresh 1B tokens each phase (no overfitting!)
✨ **RoPE** — Context extendable to 8K+

## 🤝 Join Beta Testing:

👉 **[Smilyai-labs-beta-testers](

Smilyai-labs-beta-testers

Get early access, shape the roadmap, and help build transparent open-source AI!

See translation

• 
• 1 reply

·

👀

3

3

+

Reply

replied to sagar007's post 5 months ago

view reply

Nice