469 GB

Ctrl+K

1 contributor

History: 359 commits

OpenTransformer

Fix assessments for step 19266213 inference report

b02faf9 verified about 21 hours ago

checkpoints
Upload checkpoints/pretrain_delta_step19057505.pt with huggingface_hub 1 day ago
inference_results
Fix assessments for step 19266213 inference report about 21 hours ago
tokenizer
Add archived tokenizer: tokenizer/special_tokens_map.json 23 days ago
.gitattributes

1.52 kB
initial commit 23 days ago
README.md

2.91 kB
Add README documenting tokenizer bug and v2 restart 23 days ago
n.py

55.1 kB
Add training script with tokenizer fix 23 days ago
pretrain_delta_step12491626.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
What is a pickle import?
2.79 GB
xet

Upload delta checkpoint step 12491626 23 days ago
pretrain_delta_step12504626.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step12504626.pt with huggingface_hub 23 days ago
pretrain_delta_step12517126.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict"
What is a pickle import?
2.79 GB
xet

Upload delta checkpoint step 12517126 23 days ago
pretrain_delta_step12542667.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step12542667.pt with huggingface_hub 23 days ago
pretrain_delta_step12555667.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
2.79 GB
xet

Upload delta checkpoint step12555667 (~11.035B tokens, 31.5%) 22 days ago
pretrain_delta_step12568667.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step12568667.pt with huggingface_hub 22 days ago
pretrain_delta_step12568667.sha256

97 Bytes
Upload pretrain_delta_step12568667.sha256 with huggingface_hub 22 days ago
pretrain_delta_step12581167.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step12581167.pt with huggingface_hub 22 days ago
pretrain_delta_step12725668.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step12725668.pt with huggingface_hub 22 days ago
pretrain_delta_step12738168.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step12738168.pt with huggingface_hub 22 days ago
pretrain_delta_step12750668.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step12750668.pt with huggingface_hub 22 days ago
pretrain_delta_step12763668.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step12763668.pt with huggingface_hub 22 days ago
pretrain_delta_step12776168.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step12776168.pt with huggingface_hub 22 days ago
pretrain_delta_step12788668.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step12788668.pt with huggingface_hub 22 days ago
pretrain_delta_step12788668.sha256

97 Bytes
Upload pretrain_delta_step12788668.sha256 with huggingface_hub 22 days ago
pretrain_delta_step12801168.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step12801168.pt with huggingface_hub 22 days ago
pretrain_delta_step12825668.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.79 GB
xet

Upload delta checkpoint step12825668 22 days ago
pretrain_delta_step12838131.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step12838131.pt with huggingface_hub 22 days ago
pretrain_delta_step12906131.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step12906131.pt with huggingface_hub 21 days ago
pretrain_delta_step12915131.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step12915131.pt with huggingface_hub 21 days ago
pretrain_delta_step12927631.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step12927631.pt with huggingface_hub 21 days ago
pretrain_delta_step12940631.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.79 GB
xet

Upload delta checkpoint step12940631 (32.8%, 11.47B tokens) 21 days ago
pretrain_delta_step12966631.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step12966631.pt with huggingface_hub 21 days ago
pretrain_delta_step12979131.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step12979131.pt with huggingface_hub 21 days ago
pretrain_delta_step12991756.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step12991756.pt with huggingface_hub 21 days ago
pretrain_delta_step13003256.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step13003256.pt with huggingface_hub 21 days ago
pretrain_delta_step13016256.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step13016256.pt with huggingface_hub 21 days ago
pretrain_delta_step13029256.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step13029256.pt with huggingface_hub 21 days ago
pretrain_delta_step13057256.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step13057256.pt with huggingface_hub 21 days ago
pretrain_delta_step13068256.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step13068256.pt with huggingface_hub 21 days ago
pretrain_delta_step13081256.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step13081256.pt with huggingface_hub 21 days ago
pretrain_delta_step13177124.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step13177124.pt with huggingface_hub 20 days ago
pretrain_delta_step13185124.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step13185124.pt with huggingface_hub 20 days ago
pretrain_delta_step13198124.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
2.79 GB
xet

Upload delta checkpoint step 13198124 (33.6%) 20 days ago
pretrain_delta_step13224124.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step13224124.pt with huggingface_hub 20 days ago
pretrain_delta_step13236624.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step13236624.pt with huggingface_hub 20 days ago
pretrain_delta_step13253624.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step13253624.pt with huggingface_hub 20 days ago
pretrain_delta_step13262624.pt
Detected Pickle imports (3)
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step13262624.pt with huggingface_hub 20 days ago
pretrain_delta_step13288624.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step13288624.pt with huggingface_hub 20 days ago
pretrain_delta_step13301505.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step13301505.pt with huggingface_hub 20 days ago
pretrain_delta_step13314505.pt
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step13314505.pt with huggingface_hub 20 days ago
pretrain_delta_step13327005.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage",
- "collections.OrderedDict"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step13327005.pt with huggingface_hub 20 days ago
pretrain_delta_step13340005.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step13340005.pt with huggingface_hub 20 days ago
pretrain_delta_step13352505.pt
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
2.79 GB
xet

Upload pretrain_delta_step13352505.pt with huggingface_hub 20 days ago

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)