This is an mlx-OptiQ conversion of EldritchLabs/MN-Crimson-Cafe-12B.

This is an RP/Writing model. See the original model card for the details.

Downloads last month
17
Safetensors
Model size
12B params
Tensor type
U32
ยท
BF16
ยท
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for jaithree/MN-Crimson-Cafe-12B-OptiQ-4bit

Quantized
(3)
this model