DeepSeek-R1-Distill-Qwen-14B — MLX 4-bit

4-bit MLX conversion of DeepSeek-R1-Distill-Qwen-14B for Apple Silicon. Runs natively on M1, M2, M3, and M4 Macs via mlx_lm. Faithful port of the upstream weights — no fine-tuning, no merge.

Quick facts

  • Upstream base: DeepSeek-R1-Distill-Qwen-14B
  • Format: MLX 4-bit (mlx_lm.convert --q-bits 4 --q-group-size 64)
  • License: mit
  • Use case: reasoning
  • Runtime: mlx-lm, LM Studio, Jan, Outlier desktop app
  • Publisher: Outlier-Ai (solo, Mac-native AI platform)

Quickstart (mlx-lm)

pip install -U mlx-lm
python -m mlx_lm.generate \
  --model Outlier-Ai/DeepSeek-R1-Distill-Qwen-14B-MLX-4bit \
  --prompt "Write a haiku about compilers." \
  --max-tokens 256

Quickstart (LM Studio)

Search for Outlier-Ai/DeepSeek-R1-Distill-Qwen-14B-MLX-4bit, then Load and chat.

Quickstart (Outlier desktop app)

One-click install from outlier.host. Listed in the library picker under reasoning.

Why this repo exists

This is a canonically-named twin of Outlier-Ai/Outlier-R1-Distill-14B-MLX-4bit. Same weights, same quant, different name. The branded repo carries the Outlier identity; this one carries the upstream identity so it's findable via searches like "deepseek-r1-distill-qwen-14b 4bit mlx". Use whichever path you came across — both point to the same files.

Provenance

  • Converted via mlx_lm.convert --q-bits 4 --q-group-size 64
  • Source: DeepSeek-R1-Distill-Qwen-14B
  • Date produced: 2026-04-19 (Day 19)
  • Conversion factory: Outlier MEGA-INFINITE phase3

Related

Collections

Attribution

Base model by the upstream author (see DeepSeek-R1-Distill-Qwen-14B). Outlier contributes the MLX 4-bit conversion and desktop-app packaging. Capability credit for the base belongs entirely to upstream.

License

Redistributed under the upstream license: mit. Respect the terms of DeepSeek-R1-Distill-Qwen-14B when using this conversion.

Downloads last month
987
Safetensors
Model size
15B params
Tensor type
BF16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Outlier-Ai/DeepSeek-R1-Distill-Qwen-14B-MLX-4bit

Quantized
(131)
this model

Collection including Outlier-Ai/DeepSeek-R1-Distill-Qwen-14B-MLX-4bit