Update README.md
Browse files
README.md
CHANGED
|
@@ -52,6 +52,25 @@ embeddings = model.encode(texts)
|
|
| 52 |
|
| 53 |
## Model Comparison
|
| 54 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 55 |
Compared to `NeuML/bioclinical-modernbert-base-embeddings`, this model demonstrates superior understanding of medical concepts and enhanced discrimination of non-medical content.
|
| 56 |
|
| 57 |
### Medical Text Similarity
|
|
|
|
| 52 |
|
| 53 |
## Model Comparison
|
| 54 |
|
| 55 |
+
Compared to `NeuML/bioclinical-modernbert-base-embeddings`, our model demonstrates superior understanding of medical concepts and enhanced discrimination of non-medical content.
|
| 56 |
+
|
| 57 |
+
### Comprehensive Evaluation Results
|
| 58 |
+
|
| 59 |
+
| Metric | Our Model | NeuML Model | Improvement |
|
| 60 |
+
|--------|-----------|-------------|-------------|
|
| 61 |
+
| **Accuracy@1** | 91.28% | 85.86% | +6.3% |
|
| 62 |
+
| **Accuracy@3** | 98.46% | 95.66% | +2.9% |
|
| 63 |
+
| **Accuracy@5** | 99.24% | 97.14% | +2.2% |
|
| 64 |
+
| **Accuracy@10** | 99.64% | 98.29% | +1.4% |
|
| 65 |
+
| **NDCG@5** | 95.96% | 92.37% | +3.9% |
|
| 66 |
+
| **NDCG@10** | 96.10% | 92.75% | +3.6% |
|
| 67 |
+
| **MRR@10** | 94.89% | 90.90% | +4.4% |
|
| 68 |
+
| **MAP@100** | 94.91% | 90.96% | +4.3% |
|
| 69 |
+
|
| 70 |
+
*Evaluation performed using `InformationRetrievalEvaluator` from sentence-transformers on the `gamino/wiki_medical_terms` dataset.*
|
| 71 |
+
|
| 72 |
+
## Model Comparison
|
| 73 |
+
|
| 74 |
Compared to `NeuML/bioclinical-modernbert-base-embeddings`, this model demonstrates superior understanding of medical concepts and enhanced discrimination of non-medical content.
|
| 75 |
|
| 76 |
### Medical Text Similarity
|