Mirrored from https://modelscope.cn/models/ApproachingAI2024/DeepSeek-V3-0324-GPU-weight
For inference with sglang and kt-kernel: https://lmsys.org/blog/2025-10-22-KTransformers/
当前模型的精度: 非 experts 部分 FP8,experts GPTQ4
- Downloads last month
- 104
Mirrored from https://modelscope.cn/models/ApproachingAI2024/DeepSeek-V3-0324-GPU-weight
For inference with sglang and kt-kernel: https://lmsys.org/blog/2025-10-22-KTransformers/