RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 Text Generation • 71B • Updated Aug 19 • 1.35k • 21
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • 8B • Updated Aug 19 • 8.32k • 20
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a8 Text Generation • 406B • Updated Aug 19 • 68 • 2
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a16 Text Generation • 71B • Updated Jul 18, 2024 • 26 • 6
RedHatAI/Meta-Llama-3-8B-Instruct-quantized.w8a16 Text Generation • 8B • Updated Jul 18, 2024 • 156 • 3
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a16 Text Generation • 406B • Updated Aug 19 • 44 • 2
RedHatAI/Llama-3.2-3B-Instruct-quantized.w8a8 Text Generation • 4B • Updated Jul 10, 2025 • 1.03k • 1