SCAPO-Qwen3-1.7B

SCAPO-Qwen3-1.7B is a full-parameter RL fine-tune of Qwen3-1.7B-Base using Semifactual Credit-Augmented Policy Optimization (SCAPO) on DAPO-Math-17K. SCAPO uses answer-preserving prompt perturbations to refine token-level credit assignment during training.

Paper Code SCAPO-Qwen3-4B

Results

Full results and evaluation details are available in the paper and code repository.

Method AIME 24–26 AMC 23–25 HMMT 25–26 ID Avg. OOD Avg.
Base 3.61 23.33 0.69 12.45 9.31
GRPO 7.71 32.97 1.98 17.86 13.70
SCAPO 11.88 41.39 4.96 23.08 17.22

Usage

Use the checkpoint's chat template with the R1-style instruction shown below.

from transformers import pipeline

model = pipeline(
    "text-generation",
    model="DtYXs/SCAPO-Qwen3-1.7B",
    torch_dtype="auto",
    device_map="auto",
)
messages = [{
    "role": "user",
    "content": "What is the remainder when 7^100 is divided by 13?\n\n"
               "Please reason step by step, and put your final answer within \\boxed{}.",
}]
output = model(
    messages,
    max_new_tokens=16384,
    do_sample=True,
    temperature=0.7,
    top_p=0.9,
    top_k=0,
)
print(output[0]["generated_text"][-1]["content"])

Citation

@misc{pan2026semifactualcreditaugmentedpolicyoptimization,
  title         = {Semifactual Credit-Augmented Policy Optimization},
  author        = {Junshu Pan and Zhizhang Fu and Shulin Huang and Yiran Ding and Zifan Cheng and Wenqi Shao and Qiaosheng Zhang and Yue Zhang},
  year          = {2026},
  eprint        = {2609.40360},
  archivePrefix = {arXiv},
  primaryClass  = {cs.LG},
  url           = {https://arxiv.org/abs/2609.40360}
}
Downloads last month
17
Safetensors
Model size
2B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for DtYXs/SCAPO-Qwen3-1.7B

Finetuned
(482)
this model
Quantizations
1 model

Dataset used to train DtYXs/SCAPO-Qwen3-1.7B

Paper for DtYXs/SCAPO-Qwen3-1.7B