EXPERIMENTAL

Needs llama.cpp built from this branch: https://github.com/ngxson/llama.cpp/tree/xsn/mistral_large_moe

'Make knowledge free for everyone'

Quantized version of: mistralai/Mistral-Large-3-675B-Instruct-2512 Buy Me a Coffee at ko-fi.com

Downloads last month
81
GGUF
Model size
673B params
Architecture
deepseek2
Hardware compatibility
Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for DevQuasar/mistralai.Mistral-Large-3-675B-Instruct-2512-GGUF