This 4bit W4A16 model has been quantized by @Qubitum at ModelCloud using GPT-QModel.

SPDX-License-Identifier: NonCommercial-ModelCloud
Copyright (c) 2024–2025 ModelCloud.ai
Released for non-profit use only.
Commercial use requires permission from [@qubitium](https://x.com/qubitium).

ARC_Challenge and MMLU evals pending.

Downloads last month: 10

Safetensors

Model size

357B params

Tensor type

BF16

F16

I32

F32

Model tree for ModelCloud/GLM-4.6-GPTQMODEL-W4A16-v1

Base model

zai-org/GLM-4.6

Quantized

(40)

this model