| language: | |
| - en | |
| tags: | |
| - embeddings | |
| - base-model | |
| - qwen | |
| license: apache-2.0 | |
| # Qwen2-7B-embed-base | |
| This is a base model derived from Qwen2.5-7B-Instruct with the language modeling head removed. | |
| It's intended to be used as a base for embedding tasks and further fine-tuning. | |
| ## Model Details | |
| - Base model: Qwen2.5-7B-Instruct | |
| - The 'lm_head' layer has been removed | |
| - Maintains the original model's norm layers | |
| - Suitable for embedding tasks and custom head additions | |