Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,698

Base only

Active filters: vllm

fesalfayed/gpt-oss-20b-hermes_agent-tool-finetune_16bit

Text Generation • 21B • Updated May 2 • 90 • 1

useful-quants/InternVL3-5-8B-W4A16-INT4

Image-Text-to-Text • 3B • Updated Apr 30 • 105

AEON-7/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-BF16

Any-to-Any • 33B • Updated Jul 15 • 171 • 6

AEON-7/Nemotron-3-Nano-Omni-AEON-Ultimate-Uncensored-NVFP4

Any-to-Any • 20B • Updated Jul 15 • 3.37k • 8

viethang/Voxtral-4B-TTS-2603

Text-to-Speech • Updated Apr 30

rdtand/Mistral-Medium-3.5-128B-PrismaQuant-4.75-vllm

Text Generation • 78B • Updated Apr 30 • 289 • 3

LLM-OS-Models/Qwen3.6-35B-A3B-Terminal-SFT-2Epoch-HF-FSDP-2BData

Text Generation • 4B • Updated Jun 3 • 11 • 1

TOFU-SFT/Mistral-Nemo-Base-2407-4bit-alpaca-sft-tofu

inferRouter/Qwen3.6-27B-FP8-lmhead-embed-fp8

Image-Text-to-Text • 28B • Updated Apr 30 • 22

TOFU-SFT/Mistral-Nemo-Base-2407-4bit-uf-sft-tofu

RedHatAI/Kimi-K2.6-NVFP4

Image-Text-to-Text • Updated Jul 17 • 3.21k • 13

depop-ml/Qwen3.5-9B-FP8-Dynamic

Image-Text-to-Text • 9B • Updated May 27 • 95 • 3

ScottzillaSystems/supergemma4-e4b-abliterated

Text Generation • 8B • Updated Apr 30 • 14

confamnode/Ministral-3-3B-Instruct-2512

4B • Updated Apr 30 • 5

hardcoremoore699/Qwopus3.5-27B-v3-FP8-vllm-ready

Text Generation • 27B • Updated Apr 30 • 5

confamnode/Ministral-3-8B-Instruct-2512

9B • Updated Apr 30 • 8

LLM-OS-Models/gemma-4-E2B-it-Terminal-SFT-2Epoch-DDP-4GPU

Text Generation • 5B • Updated Jun 3 • 8

LLM-OS-Models/gemma-4-E4B-it-Terminal-SFT-2Epoch-DDP-4GPU

Text Generation • 8B • Updated Jun 3 • 7

mlx-community/gpt-oss-20b-mxfp4-bf16

Text Generation • 21B • Updated Apr 30 • 445

mlx-community/gpt-oss-120b-mxfp4-bf16

Text Generation • 117B • Updated Apr 30 • 951 • 2

rdtand/Gemma4-31B-IT-PrismaQuant-5.5bit-vllm

Text Generation • 19B • Updated 20 days ago • 392 • 1

RedHatAI/Laguna-XS.2-FP8

Text Generation • 33B • Updated Jun 26 • 321

RedHatAI/Laguna-XS.2-NVFP4

Text Generation • 20B • Updated Jun 26 • 370 • 1

RedHatAI/Qwen3.6-35B-A3B-FP8

Image-Text-to-Text • 36B • Updated 4 days ago • 7.77k

LLM-OS-Models/gemma-4-26B-A4B-it-Terminal-SFT-1Epoch-HF-FSDP-2BData

Text Generation • 3B • Updated May 9 • 8

vfrome/Behemoth-X-123B-v2.1-FP8-Dynamic

Text Generation • 123B • Updated May 1 • 4

LLMWildling/gpt-oss-160b-kiwi

Text Generation • 165B • Updated May 1 • 22

LLM-OS-Models/gemma-4-26B-A4B-it-Terminal-SFT-2Epoch-HF-FSDP-2BData

Text Generation • 3B • Updated May 9 • 6

protoLabsAI/Qwen3.6-35B-A3B-uncensored-heretic-FP8

35B • Updated Jun 20 • 2.8k • 4

feanors/nemotron-3-nano-omni-30b-a3b-awq

Image-Text-to-Text • 33B • Updated May 1 • 407 • 3