README.md

metadata

base_model: jinaai/jina-embeddings-v3
model_creator: jinaai
quantized_by: Second State Inc.

---

jina-embeddings-v3-Embedding-GGUF

Original Model

jinaai/jina-embeddings-v3

Run with LlamaEdge

• LlamaEdge version: coming soon

• Prompt template

  • Prompt type: embedding

• Embedding size: 32, 64, 128, 256, 512, 768, 1024

• Run as LlamaEdge service

  wasmedge --dir .:. --nn-preload default:GGML:AUTO:jina-embeddings-v3-f16.gguf \
    llama-api-server.wasm \
    --prompt-template embedding \
    --ctx-size 768 \
    --model-name jina-embeddings-v3
  

Quantized with llama.cpp b6311