Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

arxiv: 2309.00071

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

1,170

Full-text search

Active filters: 2309.00071

LoneStriker/Yarn-Mistral-7b-128k-4.0bpw-h6-exl2

Text Generation • Updated Nov 2, 2023 • 5 • 1

LoneStriker/Yarn-Mistral-7b-128k-5.0bpw-h6-exl2

Text Generation • Updated Nov 2, 2023 • 6 • 1

LoneStriker/Yarn-Mistral-7b-128k-6.0bpw-h6-exl2

Text Generation • Updated Nov 2, 2023 • 6

LoneStriker/Yarn-Mistral-7b-128k-8.0bpw-h6-exl2

Text Generation • Updated Nov 2, 2023 • 5

LoneStriker/Yarn-Mistral-7b-128k-8.0bpw-h8-exl2

Text Generation • Updated Nov 2, 2023 • 10 • 2

LoneStriker/Yarn-Mistral-7b-64k-3.0bpw-h6-exl2

Text Generation • Updated Nov 2, 2023 • 6

LoneStriker/Yarn-Mistral-7b-64k-4.0bpw-h6-exl2

Text Generation • Updated Nov 2, 2023 • 4

LoneStriker/Yarn-Mistral-7b-64k-5.0bpw-h6-exl2

Text Generation • Updated Nov 2, 2023 • 3 • 1

LoneStriker/Yarn-Mistral-7b-64k-6.0bpw-h6-exl2

Text Generation • Updated Nov 2, 2023 • 5

LoneStriker/Yarn-Mistral-7b-64k-8.0bpw-h8-exl2

Text Generation • Updated Nov 2, 2023 • 4

TheBloke/Yarn-Mistral-7B-128k-GPTQ

Text Generation • 7B • Updated Nov 2, 2023 • 16 • 13

TheBloke/Yarn-Mistral-7B-64k-GPTQ

Text Generation • 7B • Updated Nov 2, 2023 • 20 • 4

yanismiraoui/Yarn-Mistral-7b-128k-sharded

Text Generation • 7B • Updated Nov 7, 2023 • 8 • 2

NousResearch/Yarn-Llama-2-70b-32k

Text Generation • Updated Nov 20, 2023 • 106 • 38

lightonai/alfred-40b-1023

Text Generation • Updated Feb 13, 2024 • 2.09k • 49

TheBloke/alfred-40B-1023-GPTQ

Text Generation • 42B • Updated Nov 17, 2023 • 27 • 3

TheBloke/alfred-40B-1023-GGUF

42B • Updated Nov 17, 2023 • 1.16k • 5

TheBloke/alfred-40B-1023-AWQ

Text Generation • 42B • Updated Nov 17, 2023 • 3 • 5

maddes8cht/lightonai-alfred-40b-1023-gguf

42B • Updated Nov 22, 2023 • 137

TheBloke/Yarn-Llama-2-70B-32k-AWQ

Text Generation • 69B • Updated Nov 21, 2023 • 7 • 2

TheBloke/Yarn-Llama-2-70B-32k-GPTQ

Text Generation • 69B • Updated Nov 21, 2023 • 19

TheBloke/Yarn-Llama-2-70B-32k-GGUF

69B • Updated Nov 20, 2023 • 586 • 9

LoneStriker/Yarn-Llama-2-70b-32k-2.4bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 11

LoneStriker/Yarn-Llama-2-70b-32k-4.0bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 3 • 1

LoneStriker/Yarn-Llama-2-70b-32k-4.65bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 2

LoneStriker/Yarn-Llama-2-70b-32k-2.55bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 5

LoneStriker/Yarn-Llama-2-70b-32k-6.0bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 2 • 1

LoneStriker/Yarn-Llama-2-70b-32k-5.15bpw-h6-exl2

Text Generation • Updated Nov 22, 2023 • 5

MaziyarPanahi/Yarn-Mistral-7b-64k-Mistral-7B-Instruct-v0.1

Text Generation • 7B • Updated Jan 16, 2024 • 61 • 1

NousResearch/Yarn-Solar-10b-64k

Text Generation • Updated Jan 18, 2024 • 138 • 15