Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,558

Base only

Active filters: exl3

ArtusDev/L3.3-Electra-R1-70b_EXL3_8.0bpw_H8

Text Generation • 36B • Updated May 13, 2025 • 1

MetaphoricalCode/QwQ-32B-Snowdrop-v0-exl3-8bpw-hb8

Text Generation • 17B • Updated Jun 7, 2025 • 1

turboderp/Qwen3-235B-A22B-exl3

Updated Nov 1, 2025 • 2 • 5

isogen/Qwen3-0.6B-exl3-8bpw-h8

Updated May 13, 2025

isogen/Qwen3-0.6B-Base-exl3-8bpw-h8

Updated May 13, 2025

isogen/Josiefied-Qwen3-0.6B-abliterated-v1-exl3-8bpw-h8

Updated May 13, 2025 • 2

isogen/Qwen3-1.7B-exl3-8bpw-h8

Updated May 14, 2025 • 1

isogen/Qwen3-1.7B-Base-exl3-8bpw-h8

Updated May 14, 2025 • 2

isogen/Josiefied-Qwen3-1.7B-abliterated-v1-exl3-8bpw-h8

Updated May 14, 2025 • 2

isogen/Josiefied-Qwen3-4B-abliterated-v1-exl3-4bpw

Updated May 14, 2025 • 1

isogen/Josiefied-Qwen3-4B-abliterated-v1-exl3-6bpw

Updated May 14, 2025 • 2

isogen/Josiefied-Qwen3-4B-abliterated-v1-exl3-8bpw-h8

Updated May 14, 2025 • 3

MetaphoricalCode/Dans-PersonalityEngine-V1.2.0-24b-exl3-4bpw-hb6

Text Generation • 6B • Updated May 14, 2025 • 5

MetaphoricalCode/Dans-PersonalityEngine-V1.2.0-24b-exl3-5bpw-hb6

Text Generation • 8B • Updated May 14, 2025 • 3

MetaphoricalCode/Dans-PersonalityEngine-V1.2.0-24b-exl3-6bpw-hb6

Text Generation • 9B • Updated May 14, 2025 • 3

MetaphoricalCode/Dans-PersonalityEngine-V1.2.0-24b-exl3-6.5bpw-hb8

Text Generation • 10B • Updated May 14, 2025 • 3

MetaphoricalCode/Dans-PersonalityEngine-V1.2.0-24b-exl3-8bpw-hb8

Text Generation • 12B • Updated May 14, 2025 • 3

MetaphoricalCode/Cydonia-v1.3-Magnum-v4-22B-exl3-4bpw-hb6

Text Generation • 6B • Updated May 14, 2025 • 7

MetaphoricalCode/Cydonia-v1.3-Magnum-v4-22B-exl3-5bpw-hb6

Text Generation • 7B • Updated May 14, 2025 • 3

MetaphoricalCode/Cydonia-v1.3-Magnum-v4-22B-exl3-6bpw-hb6

Text Generation • 8B • Updated May 14, 2025 • 2

MetaphoricalCode/Cydonia-v1.3-Magnum-v4-22B-exl3-6.5bpw-hb8

Text Generation • 9B • Updated May 14, 2025 • 1 • 1

MetaphoricalCode/Cydonia-v1.3-Magnum-v4-22B-exl3-8bpw-hb8

Text Generation • 11B • Updated May 14, 2025 • 3

ArtusDev/nvidia_Llama-3_1-Nemotron-Ultra-253B-v1_EXL3_3.0bpw_H6

Text Generation • 50B • Updated May 14, 2025 • 1

MetaphoricalCode/Apriel-Nemotron-15b-Thinker-exl3-8bpw-hb8

8B • Updated May 14, 2025 • 4

DanyDA/Mellum-4b-base-exl3-8.0bpw

Text Generation • 2B • Updated May 14, 2025 • 2

DanyDA/Mellum-4b-base-exl3-6.0bpw

Text Generation • 2B • Updated May 14, 2025 • 1

patf82/Absolute_Zero_Reasoner-Coder-14b-5.0bpw-exl3

5B • Updated May 14, 2025 • 3 • 4

isogen/Qwen3-4B-exl3-4bpw

Updated May 14, 2025 • 7

isogen/Qwen3-4B-exl3-6bpw

Updated May 14, 2025 • 4

matatonic/Qwen3-235B-A22B-3.5bpw-exl3

Text Generation • 52B • Updated May 14, 2025 • 1