lokeshch19 commited on
Commit
810bc50
·
verified ·
1 Parent(s): 913b848

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md CHANGED
@@ -52,6 +52,25 @@ embeddings = model.encode(texts)
52
 
53
  ## Model Comparison
54
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
55
  Compared to `NeuML/bioclinical-modernbert-base-embeddings`, this model demonstrates superior understanding of medical concepts and enhanced discrimination of non-medical content.
56
 
57
  ### Medical Text Similarity
 
52
 
53
  ## Model Comparison
54
 
55
+ Compared to `NeuML/bioclinical-modernbert-base-embeddings`, our model demonstrates superior understanding of medical concepts and enhanced discrimination of non-medical content.
56
+
57
+ ### Comprehensive Evaluation Results
58
+
59
+ | Metric | Our Model | NeuML Model | Improvement |
60
+ |--------|-----------|-------------|-------------|
61
+ | **Accuracy@1** | 91.28% | 85.86% | +6.3% |
62
+ | **Accuracy@3** | 98.46% | 95.66% | +2.9% |
63
+ | **Accuracy@5** | 99.24% | 97.14% | +2.2% |
64
+ | **Accuracy@10** | 99.64% | 98.29% | +1.4% |
65
+ | **NDCG@5** | 95.96% | 92.37% | +3.9% |
66
+ | **NDCG@10** | 96.10% | 92.75% | +3.6% |
67
+ | **MRR@10** | 94.89% | 90.90% | +4.4% |
68
+ | **MAP@100** | 94.91% | 90.96% | +4.3% |
69
+
70
+ *Evaluation performed using `InformationRetrievalEvaluator` from sentence-transformers on the `gamino/wiki_medical_terms` dataset.*
71
+
72
+ ## Model Comparison
73
+
74
  Compared to `NeuML/bioclinical-modernbert-base-embeddings`, this model demonstrates superior understanding of medical concepts and enhanced discrimination of non-medical content.
75
 
76
  ### Medical Text Similarity