Update README.md

README.md

@@ -81,7 +81,7 @@ KeyError: 'qwen2'
 ```
 
 ## Usage
-
+### sentence-transformers support
 Using this model becomes easy when you have [sentence-transformers](https://www.SBERT.net) installed:
 
 ```
@@ -132,6 +132,33 @@ embeddings = model.encode(
 print(embeddings)
 ```
 
+### vllm support
+```python
+import torch
+import vllm
+from vllm import LLM
+def get_detailed_instruct(task_description: str, query: str) -> str:
+    return f'Instruct: {task_description}\nQuery:{query}'
+
+task = 'Given a query, retrieve documents that answer the query'
+queries = [
+    get_detailed_instruct(task, 'What is the capital of China?'),
+    get_detailed_instruct(task, 'Explain gravity')
+]
+documents = [
+    "The capital of China is Beijing.",
+    "Gravity is a force that attracts two bodies towards each other. It gives weight to physical objects and is responsible for the movement of planets around the sun."
+]
+input_texts = queries + documents
+
+model = LLM(model="{MODEL_NAME_OR_PATH}", task="embed", trust_remote_code=True, dtype="float16")
+
+outputs = model.embed(input_texts)
+embeddings = torch.tensor([o.outputs.embedding for o in outputs])
+scores = (embeddings[:2] @ embeddings[2:].T)
+print(scores.tolist())
+```
+
 
 ## Citation
 If you find this model useful, please consider giving a star and citation.