Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

77

Base only

Active filters: 1.58-bit

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 266k • 145

prism-ml/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated Jun 10 • 6.42k • 44

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Jun 10 • 6.03k • 33

prism-ml/bonsai-image-ternary-4B-gemlite-2bit

Text-to-Image • Updated Jun 1 • 1.55k • 132

prism-ml/bonsai-image-ternary-4B-mlx-2bit

Text-to-Image • Updated Jun 1 • 1.04k • 95

Schackay3/Qwen3-Next-80B-A3B-Instruct-ternary-GGUF

Text Generation • 80B • Updated 14 days ago • 426 • 3

rileyseaburg/distillix-100m-v0.3

Text Generation • 0.1B • Updated Jan 1 • 27

Chris4K/bitnet-gpt2-1.58bit

0.2B • Updated Jan 5 • 9

rileyseaburg/distillix

Text Generation • Updated Jan 7 • 1

rileyseaburg/bitmamba-zen-distillix-300m

0.3B • Updated Jan 8 • 50

Zhayr1/BitMamba-2-1B

Text Generation • Updated Feb 11 • 44 • 15

Zhayr1/BitMamba-2-0.25B

Text Generation • Updated Feb 11 • 23 • 4

tzervas/phi-4-bitnet-1.58b

Text Generation • 4B • Updated Jan 29 • 251 • 2

tzervas/qwen2.5-coder-14b-bitnet-1.58b

Text Generation • 4B • Updated Jan 29 • 768 • 5

tzervas/qwen2.5-coder-32b-bitnet-1.58b

Text Generation • 9B • Updated Jan 29 • 1.25k • 6

OpenCoresAI/HGF-60M-TinyStories

Text Generation • Updated Feb 6 • 8 • 1

ugonfor/1.58bit-flux-reproduction

Text-to-Image • Updated Mar 19 • 1

rasatavohary/BitMamba-2-0.25B

Text Generation • Updated Mar 23 • 10

rasatavohary/BitMamba-2-1B

Text Generation • Updated Mar 23 • 13

prism-ml/Ternary-Bonsai-8B-mlx-2bit

Text Generation • 0.6B • Updated Apr 18 • 18.2k • 122

prism-ml/Ternary-Bonsai-4B-mlx-2bit

Text Generation • 0.3B • Updated Apr 18 • 1.13k • 13

prism-ml/Ternary-Bonsai-1.7B-mlx-2bit

Text Generation • 0.1B • Updated Apr 18 • 1.65k • 19

MiaoMint/Ternary-Bonsai-1.7B-gguf

Text Generation • 2B • Updated Apr 29 • 22

MiaoMint/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 29 • 30

jinreiyu/Bonsai-REDUX2-MLX-2bit-pure

Text Generation • 0.6B • Updated May 15 • 100

jinreiyu/Bonsai-REDUX2-MLX-d8

Text Generation • 1B • Updated May 15 • 51

jinreiyu/Bonsai-REDUX2-MLX-edge-d8-Lo6

Text Generation • 1B • Updated May 15 • 51

jinreiyu/bonsai-redux2-johnny-lora-v3-q4_k_m-gguf

Text Generation • 0.6B • Updated May 19 • 313

jinreiyu/Bonsai-REDUX3-MLX-2bit-pure

Text Generation • 0.6B • Updated May 12 • 46

jinreiyu/bonsai-2bit-abl-mlx-redux

Text Generation • 0.6B • Updated May 13 • 92