Cloud/Datacenter
Validated models ready for Arm cloud & datacenter platforms with tailor-made Learning Paths to guide you through your Arm development and deployment
Text Generation • 8B • Updated • 5.42M • • 5.11kNote Run a Large Language Model (LLM) chatbot with PyTorch using KleidiAI on Arm servers - https://learn.arm.com/learning-paths/servers-and-cloud-computing/pytorch-llama/
Qwen/Qwen2-0.5B-Instruct
Text Generation • 0.5B • Updated • 200k • 196Note Run an LLM chatbot with rtp-llm on Arm-based servers - https://learn.arm.com/learning-paths/servers-and-cloud-computing/rtp-llm/
Qwen/Qwen2.5-0.5B-Instruct
Text Generation • 0.5B • Updated • 2.24M • 406Note Build and Run a Virtual Large Language Model (vLLM) on Arm Servers - https://learn.arm.com/learning-paths/servers-and-cloud-computing/vllm/
distilbert/distilbert-base-uncased-finetuned-sst-2-english
Text Classification • 67M • Updated • 4.55M • • 858Note Discover how to Accelerate NLP models from Hugging Face on Arm servers with DistilBERT - https://learn.arm.com/learning-paths/servers-and-cloud-computing/benchmark-nlp/
dphn/dolphin-2.9.4-llama3.1-8b
8B • Updated • 14.3k • 96Note Learn how you can build a RAG application using Zilliz Cloud on Arm servers with Dolphin 2.9.4-llama3.1-8b - https://learn.arm.com/learning-paths/servers-and-cloud-computing/milvus-rag/ You can also deploy a Large Language Model (LLM) chatbot with llama.cpp using KleidiAI on Arm servers with this model - https://learn.arm.com/learning-paths/servers-and-cloud-computing/llama-cpu/
chatpdflocal/llama3.1-8b-gguf
8B • Updated • 424 • 29Note Deploy a RAG-based Chatbot with llama-cpp-python using KleidiAI on Google Axion processors - https://learn.arm.com/learning-paths/servers-and-cloud-computing/rag/
cardiffnlp/twitter-roberta-base-sentiment-latest
Text Classification • Updated • 3.63M • • 740Note Run a Natural Language Processing (NLP) model from Hugging Face on Arm servers - https://learn.arm.com/learning-paths/servers-and-cloud-computing/nlp-hugging-face/
sentence-transformers/all-MiniLM-L6-v2
Sentence Similarity • 22.7M • Updated • 152M • • 4.21kNote Learn how you can Build a RAG application using Zilliz Cloud on Arm servers with all-MiniLM - https://learn.arm.com/learning-paths/servers-and-cloud-computing/milvus-rag/