Bc-AI/nova-dump
0 Bytes
Boning Cui
Bc-AI
AI & ML interests
I like LLM's and VLM's.
Recent Activity
updated a Space about 12 hours ago
Smilyai-labs/README posted an update about 12 hours ago
# 🔥 Nova-1 Beta: Test Our New LLMs!
**Smilyai Labs** is building **Nova-1** — open-source LLMs with novel architectures. Join our beta program!
## 🎯 Available Now:
**Nova-1-Standard (1.2B)** — Phase 2 of pretraining in progress
- PPL 13.5 (beats GPT-2 Large!)
- 48K tok/s on consumer GPUs
- Great for code, reasoning, edge deployment
**Nova-1-Large (3.5B)** — Training live RIGHT NOW
- Current: 30.9 PPL, improving fast, loss at 3.5 right now
- Will finish with ~1.7B tokens today
- Better reasoning & longer context
**Nova-1-XL (10B MoE)** — Coming soon (We dont know yet! haha)
- Final Specs not decided yet
## What Makes Nova Special?
✨ **Mixture of Depths (MoD)** — Routes tokens dynamically, 30% faster
✨ **Grouped Query Attention** — Efficient like LLaMA 2/3
✨ **Phased Training** — Fresh 1B tokens each phase (no overfitting!)
✨ **RoPE** — Context extendable to 8K+
## 🤝 Join Beta Testing:
👉 **[Smilyai-labs-beta-testers](https://huggingface.co/Smilyai-labs-beta-testers)**
Get early access, shape the roadmap, and help build transparent open-source AI!
liked a model 7 days ago
sKT-Ai-Labs/SKT-ST-X-0-3BOrganizations
