# benchmarks

unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: CPU BLAS - Model: DeepSeek-R1-Distill-Llama-8B-Q8_0 - Test: Prompt Processing 2048


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: CPU BLAS - Model: DeepSeek-R1-Distill-Llama-8B-Q8_0 - Test: Prompt Processing 1024


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: CPU BLAS - Model: DeepSeek-R1-Distill-Llama-8B-Q8_0 - Test: Prompt Processing 512


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: NVIDIA CUDA - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 512


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: Vulkan - Model: DeepSeek-R1-Distill-Llama-8B-Q8_0 - Test: Prompt Processing 1024


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: Vulkan - Model: DeepSeek-R1-Distill-Llama-8B-Q8_0 - Test: Prompt Processing 2048


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: Vulkan - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: NVIDIA CUDA - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: NVIDIA CUDA - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: Vulkan - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: Vulkan - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: NVIDIA CUDA - Model: DeepSeek-R1-Distill-Llama-8B-Q8_0 - Test: Text Generation 128


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: NVIDIA CUDA - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: NVIDIA CUDA - Model: DeepSeek-R1-Distill-Llama-8B-Q8_0 - Test: Prompt Processing 512


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: NVIDIA CUDA - Model: DeepSeek-R1-Distill-Llama-8B-Q8_0 - Test: Prompt Processing 1024


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: NVIDIA CUDA - Model: DeepSeek-R1-Distill-Llama-8B-Q8_0 - Test: Prompt Processing 2048


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: NVIDIA CUDA - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: NVIDIA CUDA - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024


unit: Tokens Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Llama.cpp: Backend: NVIDIA CUDA - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048


unit: Frames Per Second
source: OpenBenchmarking: Llama.cpp
test_name:
Unigine Superposition: Resolution: 6144 x 2560 - Mode: Fullscreen - Quality: Medium - Renderer: OpenGL


