Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Hardware
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
NamrataThakur
/
Small_Language_Model_MOE_127M_Pretrained
Like
4
Text Generation
PyTorch
roneneldan/TinyStories
English
customGPT_pretrain
Pretrain
SLM
Group_Query_Attention
Mixture-Of-Experts
Top K Routing
Custom_Model
From_Scratch
tiny-model
research
arxiv:
1910.09700
License:
mit
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
Small_Language_Model_MOE_127M_Pretrained
/
pytorch_model.bin
Commit History
Initial upload of custom GPT model
d03982e
verified
NamrataThakur
commited on
Mar 8
Initial upload of custom GPT model
497719b
verified
NamrataThakur
commited on
Mar 8
NamrataThakur commited on 