--- title: README emoji: 🐢 colorFrom: purple colorTo: gray sdk: static pinned: false ---
Intel Logo
### Intel® Software Catalog Choose from a broad range of solutions designed to simplify and accelerate your AI development, each one ready to deploy on Intel® Xeon® processors. Browse the full catalog, including models, blueprints and optimizations, at [swcatalog.intel.com](https://swcatalog.intel.com). #### 💬 Intel® Chatbot Toolkit Enterprise-grade RAG solutions, extended with security, scalability, performance and user-experience features.
💬 Chat Q & ARetrieval-augmented chat over your own knowledge base, deployable end to end on a single Xeon node with one installer. 📄 Document SummarizationSummarizes large documents and datasets, returning concise and relevant insights quickly. 🎙️ Audio Q & AVoice in, voice out. Speech-to-text and text-to-speech wrapped around the RAG pipeline for dynamic spoken conversations.
🌐 Multilingual SupportSwap in multilingual embedding, reranking and LLM models to run end-to-end RAG in 100+ languages.
#### ⚡ Inference, Agents and Multimodal
⚡ Intel® Inference ToolkitKubernetes-orchestrated LLM serving on Intel hardware. Automates model deployment, compute provisioning and tuning for faster inference with less manual effort. 🤖 Intel® Agent ToolkitProduction agentic AI stack on Xeon: API gateway, inference routing, agent memory, sandboxed code execution, MCP tool integration and full observability, pre-integrated. 🎬 Video Search and SummarizationSearch through video datasets and generate concise summaries. Deploys on Kubernetes with vLLM as the inference backend.
#### 🤝 Partner Platform Deployments The same open source stacks, validated on partner infrastructure.
🎩 Red Hat® OpenShift® AI on XeonInference and agentic AI on Red Hat OpenShift AI, with vLLM CPU tuning, KV-cache sizing and GuideLLM benchmarking guidance. 🗄️ NetApp® AIPod™ Mini with IntelAir-gapped RAG inferencing over an internal knowledge repository, serving concurrent users without GPUs. ☁️ Nutanix® Enterprise AI with IntelChat Q&A at scale using Nutanix Enterprise AI as the inference engine, on Nutanix Kubernetes Platform or any Kubernetes cluster.
🖥️ VMware® vSphere with IntelProvisions a production-ready Kubernetes cluster on vSphere / ESXi and runs Chat Q&A on Xeon with Intel® AMX acceleration. 🏭 Dell® On-Prem Automated DeploymentBare-metal automation via iDRAC Redfish and Terraform: custom ISO boot, then an automated post-OS script that launches inference services. 🔌 Dell® Airgapped DeploymentStages Docker images, Helm charts, Python packages, binaries and model weights in JFrog Artifactory, then installs on a system with no internet access.
🎮 Dell® with Xeon Host CPU and NVIDIA GPUPowerEdge deployment with Xeon as host CPU: installs the NVIDIA GPU operator and serves a model with vLLM on the GPU.
#### 🔐 Security and Libraries
🔐 Confidential ContainersConfidential AI powered by Intel® TDX. Protects models and data from compromised software and administrators, even on untrusted infrastructure. 📈 Extension for scikit-learnFree AI accelerator delivering up to 100x faster performance for existing scikit-learn code, with no code rewrite required.
#### Explore More - [All solutions](https://swcatalog.intel.com/solutions) - [Blueprints](https://swcatalog.intel.com/blueprints) - deployable reference configurations - [Models](https://swcatalog.intel.com/models) - models validated on Intel® Xeon® - [Optimizations](https://swcatalog.intel.com/optimizations) - tuning recipes for Intel hardware #### Community Join us on the [Intel DevHub Discord](https://discord.gg/kfJ3NKEw5t). #### Disclaimer Intel is not responsible for the download or security of Hugging Face assets.