Qwen3-8B DSpark speculator

DSpark (DFlash backbone + Markov logit-bias head + confidence head) draft model for Qwen/Qwen3-8B, trained with speculators (PR #677).

Preview/research checkpoint: online training on a 20k ShareGPT slice, seq 2048, 3 epochs.

Validation per-position acceptance (pos1-7): 0.689 / 0.541 / 0.440 / 0.369 / 0.319 / 0.283 / 0.255 | full_acc 0.415.

Downloads last month
79
Safetensors
Model size
2B params
Tensor type
I64
BF16
BOOL
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for mgoin/Qwen3-8B-speculator.dspark

Finetuned
Qwen/Qwen3-8B
Finetuned
(2053)
this model