Feature Extraction
Transformers
Safetensors
English
qwen2
embeddings
base-model
qwen
text-embeddings-inference
# Load model directly
from transformers import AutoTokenizer, AutoModel
tokenizer = AutoTokenizer.from_pretrained("ssmits/Qwen2-7B-embed-base")
model = AutoModel.from_pretrained("ssmits/Qwen2-7B-embed-base", device_map="auto")Quick Links
Qwen2-7B-embed-base
This is a base model derived from Qwen2.5-7B-Instruct with the language modeling head removed. It's intended to be used as a base for embedding tasks and further fine-tuning.
Model Details
- Base model: Qwen2.5-7B-Instruct
- The 'lm_head' layer has been removed
- Maintains the original model's norm layers
- Suitable for embedding tasks and custom head additions
- Downloads last month
- 8
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="ssmits/Qwen2-7B-embed-base")