RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16
Image-Text-to-Text
•
5B
•
Updated
•
104k
•
10
Edit Models filters
Apps
Inference Providers
Active filters:
W4A16
ModelCloud/QwQ-32B-Preview-gptqmodel-4bit-vortex-v2
Text Generation
•
7B
•
Updated
•
35
•
16
ModelCloud/QwQ-32B-Preview-gptqmodel-4bit-vortex-v3
Text Generation
•
7B
•
Updated
•
21
•
14
ModelCloud/Falcon3-10B-Instruct-gptqmodel-4bit-vortex-v1
Text Generation
•
2B
•
Updated
•
14
•
3
ModelCloud/Qwen2.5-0.5B-Instruct-gptqmodel-w4a16
Text Generation
•
0.5B
•
Updated
•
27
•
1
ModelCloud/DeepSeek-R1-Distill-Qwen-7B-gptqmodel-4bit-vortex-v1
Text Generation
•
2B
•
Updated
•
25
•
5
ModelCloud/DeepSeek-R1-Distill-Qwen-7B-gptqmodel-4bit-vortex-v2
Text Generation
•
2B
•
Updated
•
289
•
7
RedHatAI/phi-4-quantized.w4a16
Text Generation
•
3B
•
Updated
•
703
•
4
RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16
Image-Text-to-Text
•
20B
•
Updated
•
21k
•
12
pyrymikko/nomic-embed-code-W4A16-AWQ
1B
•
Updated
•
57.6k
tcclaviger/Minimax-M2-Thrift-GPTQ-W4A16-AMD
Text Generation
•
24B
•
Updated
•
49
•
1
TevunahAi/granite-34b-code-instruct-8k-Ultra-Hybrid
Text Generation
•
11B
•
Updated
•
9
TevunahAi/Llama-3.1-70B-Instruct-Ultra-Hybrid
Text Generation
•
22B
•
Updated
•
12
TevunahAi/Qwen3-Next-80B-A3B-Instruct-Ultra-Hybrid
Text Generation
•
Updated
•
10