Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

19

Base only

Active filters: QAT

prithivMLmods/gemma-4-12B-it-qat-GGUF

Image-Text-to-Text • 12B • Updated Jun 7 • 4.55k • 4

typhoon-ai/typhoon-ocr1.5-3b-qat

Image-Text-to-Text • 4B • Updated Nov 14, 2025 • 1.54k • 2

mradermacher/typhoon-ocr1.5-3b-qat-GGUF

3B • Updated Jan 16 • 648 • 1

mradermacher/typhoon-ocr1.5-3b-qat-i1-GGUF

3B • Updated Jan 16 • 221

Melikshah/gpt-oss-20b-clinical-cot-gguf

Text Generation • 21B • Updated Jun 5 • 443 • 4

tokenlabsdotrun/Llama-3.1-8B-ModelOpt-NVFP4-QAT

5B • Updated Jan 21 • 19

tokenlabsdotrun/Llama-3.1-8B-ModelOpt-FP8-QAT

8B • Updated Jan 22 • 8

anemll/anemll-google-gemma-3-4b-it-qat-int4-unquantized-ctx4096_0.3.5

Updated Jan 30 • 22

prithivMLmods/gemma-4-E2B-it-qat-GGUF

Image-Text-to-Text • 5B • Updated Jun 7 • 1.16k • 1

prithivMLmods/gemma-4-E4B-it-qat-GGUF

Image-Text-to-Text • 7B • Updated Jun 7 • 842 • 2

RachidAR/gemma-4-26B-A4B-it-qat-assistant-q4_0-gguf

0.4B • Updated Jun 7 • 7.13k • 14

terra-cognita-ai/ResAI_Image-to-text_Champ

Image-Text-to-Text • 7B • Updated Jun 15 • 16

Jeesup/MUSE-Books_iclm-7b_npo_beta0p1_lr5e-6_lam10_ep1-QAT-int4

Text Generation • 7B • Updated Jun 29 • 7

Jeesup/MUSE-Books_iclm-7b_npo_beta0p1_lr5e-6_lam10_ep1-QAT-int8

Text Generation • 7B • Updated Jun 29 • 9

Jeesup/MUSE-Books_iclm-7b_npo_beta0p1_lr5e-6_lam10_ep1-QAT-int4-warmup

Text Generation • 7B • Updated Jun 29 • 9

Jeesup/MUSE-Books_iclm-7b_npo_beta0p1_lr5e-6_lam10_ep1-QAT-int4-from-unlearned

Text Generation • 7B • Updated Jun 29 • 11

Jeesup/MUSE-News_Llama-2-7b_npo_beta0p1_lr1e-5_lam1_ep5_bestretain-QAT-int4-ffn

Jeesup/MUSE-News_Llama-2-7b_npo_beta0p1_lr1e-5_lam1_ep5_bestretain-QAT-int4-ffn-from-unlearned

Jeesup/MUSE-News_Llama-2-7b_npo_beta0p1_lr1e-5_lam1_ep5_bestretain-QAT-int4-all-from-unlearned