leonMW commited on
Commit
c882ca7
·
verified ·
1 Parent(s): 0518f60

Training in progress, epoch 1

Browse files
Files changed (4) hide show
  1. README.md +2 -2
  2. generation_config.json +3 -1
  3. model.safetensors +1 -1
  4. training_args.bin +1 -1
README.md CHANGED
@@ -4,8 +4,8 @@ library_name: transformers
4
  model_name: DeepSeek-R1-Distill-Qwen-1.5B-GSPO-Basic
5
  tags:
6
  - generated_from_trainer
7
- - trl
8
  - grpo
 
9
  licence: license
10
  ---
11
 
@@ -27,7 +27,7 @@ print(output["generated_text"])
27
 
28
  ## Training procedure
29
 
30
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/leonwenderoth-tu-darmstadt/huggingface/runs/doctacqy)
31
 
32
 
33
  This model was trained with GRPO, a method introduced in [DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models](https://huggingface.co/papers/2402.03300).
 
4
  model_name: DeepSeek-R1-Distill-Qwen-1.5B-GSPO-Basic
5
  tags:
6
  - generated_from_trainer
 
7
  - grpo
8
+ - trl
9
  licence: license
10
  ---
11
 
 
27
 
28
  ## Training procedure
29
 
30
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/leonwenderoth-tu-darmstadt/huggingface/runs/6bd0c08q)
31
 
32
 
33
  This model was trained with GRPO, a method introduced in [DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models](https://huggingface.co/papers/2402.03300).
generation_config.json CHANGED
@@ -2,7 +2,9 @@
2
  "_from_model_config": true,
3
  "bos_token_id": 151646,
4
  "do_sample": true,
5
- "eos_token_id": 151643,
 
 
6
  "pad_token_id": 151643,
7
  "temperature": 0.6,
8
  "top_p": 0.95,
 
2
  "_from_model_config": true,
3
  "bos_token_id": 151646,
4
  "do_sample": true,
5
+ "eos_token_id": [
6
+ 151643
7
+ ],
8
  "pad_token_id": 151643,
9
  "temperature": 0.6,
10
  "top_p": 0.95,
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4063875ab44841b5b9e89b6512782388e5a09a40182f73b3b4d92289c09be891
3
  size 3554214752
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:881e0405a9463bd88293cd913673aa174b3f1f2dce1d0c587a3f817609456865
3
  size 3554214752
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ad85fddfd0c066756e452c5f3de99ac4c06e778d6db1a8c438765d1548d41a78
3
  size 11345
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e5c0eb24ce25b866eb756ba2cfdbb5fcea4aef29550622de9bac93352cb0e93
3
  size 11345