Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
NamrataThakur
/
Small_Language_Model_MOE_127M_Pretrained
like
3
Text Generation
PyTorch
roneneldan/TinyStories
English
customGPT_pretrain
Pretrain
SLM
Group_Query_Attention
Mixture-Of-Experts
Top K Routing
Custom_Model
From_Scratch
tiny-model
research
arxiv:
1910.09700
License:
mit
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
Small_Language_Model_MOE_127M_Pretrained
2.03 GB
Ctrl+K
Ctrl+K
1 contributor
History:
13 commits
NamrataThakur
Update README.md
78ccaaf
verified
2 months ago
.gitattributes
Safe
1.52 kB
initial commit
3 months ago
README.md
Safe
8.58 kB
Update README.md
2 months ago
config.json
Safe
559 Bytes
Initial upload of custom GPT model
3 months ago
gpt2_MOE_preTrain_S_V3.pth
pickle
Detected Pickle imports (5)
"gpt_ClassificationFT.gpt2_model_customConfig.GPT2_CustomConfig"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
,
"torch._utils._rebuild_tensor_v2"
,
"torch.ByteStorage"
How to fix it?
1.52 GB
xet
Upload gpt2_MOE_preTrain_S_V3.pth
3 months ago
pytorch_model.bin
Safe
pickle
Detected Pickle imports (3)
"torch._utils._rebuild_tensor_v2"
,
"torch.FloatStorage"
,
"collections.OrderedDict"
What is a pickle import?
507 MB
xet
Initial upload of custom GPT model
3 months ago
