Qwensploit 3.5 4B: Cybersecurity and Red Team

Qwensploit is a cybersecurity-focused fine-tune of a Qwen3.5-4B model merge, designed for security reasoning, vulnerability analysis, secure coding, red-team knowledge, and technical question answering.

The model was fine-tuned using LoRA on 7,000 training examples drawn from four datasets, with an additional 350 evaluation examples.

Intended use

Designed to assist with:

  • Cybersecurity research and technical question answering.
  • Vulnerability analysis and secure code review.
  • Defensive security, threat modeling, and incident analysis.
  • Authorized penetration testing and red-team exercises.
  • CTF challenges, security education, and programming assistance.

Outputs may be incorrect or unsafe. Validate generated code and recommendations, and use offensive-security capabilities only in authorized environments.

Training datasets

The training mixture was randomly selected and shuffled, with a maximum entry length of 8,000.

Dataset Entries Share
CyberSec-Reasoning-Premium 2,305 33%
RedTeam-Premium 2,385 34%
Claude Mythos Distilled 25K — Clean 1,385 20%
Qwen3.8-Max Distillation 50K — Clean 925 13%
Total 7,000 100%

The mixture combines cybersecurity and red-team examples with synthetic reasoning, coding, and general instruction-following data.

Upstream dataset sources

The datasets are primarily built from the following second-level sources:

Consult all linked cards for full source provenance, dataset construction details, and licensing terms.

Base model lineage

The direct base model is Qwen3.5-4B-Claude-3xMerge-Jackrong-UNCENSORED-heretic.

The related Claude 3xMerge Jackrong model is a merge combining reasoning distillation, coding, and multi-step reasoning fine-tunes distilled from Claude Opus. The underlying model family is Qwen3.5-4B.

Training configuration

Parameter Value
Epochs 1
Training entries 7,000
Evaluation entries 350
Context length 8,192
Learning rate 2e-4
Batch size 4x8
LoRA rank (r) 16
LoRA alpha 32
LoRA dropout 0.02
LoRA traget modules all
Optimizer AdamW 8-bit
LR scheduler Linear
Weight decay 0.002
GPU NVIDIA A100 40 GB

Training results

Reported final metrics:

Metric Value
Training loss 0.524
Evaluation loss 0.532

Loss tracking by training step

Metric \ Step Step 48 Step 96 Step 144 Step 192 Step 219
Training loss 0.695 0.699 0.546 0.530 0.524
Evaluation loss 0.700 0.604 0.558 0.537 0.532

Loss is a training diagnostic, not a direct measure of cybersecurity accuracy or safety. Independent benchmarks are needed to assess performance.

Limitations and safety

  • May generate inaccurate explanations, insecure code, or outdated security advice.
  • Synthetic distillation data may contain teacher-model errors.
  • Performance on real-world security tasks has not been independently established.
  • Use only on systems for which testing is explicitly authorized.
  • Review generated commands, code, and recommendations before use.

Licensing

Although this model's is licensed under Apache-2.0, upstream licensing must be reviewed before redistribution or commercial use. In particular, the Qwen distillation dataset documents inherited restrictions that may affect downstream use. Review the base-model and dataset cards and for license information if necessary.

References

Base model

Training datasets

Second-level dataset sources

Downloads last month
37
Safetensors
Model size
5B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for xtools-at/Qwen3.5-4B-Qwensploit-CyberSecurity

Datasets used to train xtools-at/Qwen3.5-4B-Qwensploit-CyberSecurity

Collections including xtools-at/Qwen3.5-4B-Qwensploit-CyberSecurity