Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

81

Base only

Active filters: rockchip

jamescallander/txgemma-9b-chat_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 8

jamescallander/NextCoder-7B_w8a8_g128_rk3588.rkllm

Text Generation • Updated Oct 27, 2025 • 27 • 1

jamescallander/Qwen2.5-Math-1.5B-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 20

jamescallander/MediPhi-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 6, 2025 • 4 • 1

jamescallander/Qwen2.5-Coder-3B-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 42 • 2

jamescallander/Llama-3.1-8B-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Oct 9, 2025 • 33

jamescallander/MiniCPM4-0.5B_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 31

jamescallander/TinyLlama-1.1B-Chat-v1.0_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 19 • 2

jamescallander/MediPhi-PubMed_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 5, 2025 • 2 • 1

jamescallander/medgemma-4b-it_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 6, 2025 • 20 • 1

jamescallander/Qwen2.5-Math-7B-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 6, 2025 • 6

jamescallander/deepseek-coder-1.3b-instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 19, 2025 • 17

jamescallander/MiniCPM3-4B_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 8, 2025 • 2

jamescallander/Llama-3.2-3B-Instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Oct 9, 2025 • 61

cluangar/typhoon2-qwen2.5-7B-rk3588

Text Generation • Updated Sep 18, 2025 • 2

jamescallander/DeepSeek-R1-Distill-Qwen-14B_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 20, 2025 • 17

jamescallander/deepseek-coder-6.7b-instruct_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 21, 2025 • 16

jamescallander/CodeLlama-7b-Instruct-hf_w8a8_g128_rk3588.rkllm

Text Generation • Updated Sep 20, 2025 • 11

jamescallander/DeepSeek-R1-Distill-Qwen-1.5B_w8a8_g128_rk3588.rkllm

Text Generation • Updated Oct 9, 2025 • 62

jamescallander/DeepSeek-R1-Distill-Llama-8B_w8a8_g128_rk3588.rkllm

Text Generation • Updated Oct 9, 2025 • 17

jamescallander/gemma-2-2b-it_w8a8_g128_rk3588.rkllm

Text Generation • Updated Oct 3, 2025 • 19

jamescallander/gemma-3-4b-it_w8a8_g128_rk3588.rkllm

Text Generation • Updated Apr 8 • 122

jamescallander/gemma-3-1b-it_w8a8_g128_rk3588.rkllm

Text Generation • Updated Oct 4, 2025 • 31

jamescallander/gemma-3-270m-it_w8a8_g128_rk3588.rkllm

Text Generation • Updated Nov 1, 2025 • 15

jamescallander/qwen2-5_convos__SCP_org_chemistry_w8a8_g128_rk3588.rkllm

Text Generation • Updated Oct 4, 2025 • 3

flylcw/Qwen3-4B-Instruct-2507_w8a8_g128_1.2.2_rkllm

Text Generation • Updated Nov 9, 2025 • 20 • 4

Prince-1/SmolVLM-Instruct-RKllm

Image-Text-to-Text • Updated Nov 14, 2025 • 10 • 1

kautism/DeepSeek-R1-Distill-Qwen-1.5B_w8a8_g128_rk3588.rkllm

Text Generation • Updated Nov 18, 2025 • 20

rk-transformers/distilbert-base-uncased-finetuned-sst-2-english

Updated Nov 29, 2025 • 2

rk-transformers/all-MiniLM-L6-v2

Sentence Similarity • Updated Nov 29, 2025 • 135