This 4bit W4A16 model has been quantized by @Qubitum at ModelCloud using GPT-QModel.

SPDX-License-Identifier: NonCommercial-ModelCloud
Copyright (c) 2024–2025 ModelCloud.ai
Released for non-profit use only.
Commercial use requires permission from [@qubitium](https://x.com/qubitium).

Downloads last month: -

Safetensors

Model size

15B params

Tensor type

BF16

I32

F32

Model tree for ModelCloud/Brumby-14B-Base-GPTQMODEL-W4A16

Base model

manifestai/Brumby-14B-Base

Quantized

(2)

this model