End of training

README.md

@@ -2,6 +2,8 @@
 base_model: dmis-lab/biobert-v1.1
 tags:
 - generated_from_trainer
+metrics:
+- f1
 model-index:
 - name: biobert_modality
   results: []
@@ -13,6 +15,9 @@ should probably proofread and complete it, then remove this comment. -->
 # biobert_modality
 
 This model is a fine-tuned version of [dmis-lab/biobert-v1.1](https://huggingface.co/dmis-lab/biobert-v1.1) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.2753
+- F1: 0.9368
 
 ## Model description
 
@@ -39,6 +44,14 @@ The following hyperparameters were used during training:
 - lr_scheduler_type: linear
 - num_epochs: 2
 
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | F1     |
+|:-------------:|:-----:|:----:|:---------------:|:------:|
+| 0.3771        | 1.0   | 241  | 0.3110          | 0.9321 |
+| 0.1805        | 2.0   | 482  | 0.2753          | 0.9368 |
+
+
 ### Framework versions
 
 - Transformers 4.42.3

config.json

@@ -46,6 +46,7 @@
   "num_hidden_layers": 12,
   "pad_token_id": 0,
   "position_embedding_type": "absolute",
+  "problem_type": "single_label_classification",
   "torch_dtype": "float32",
   "transformers_version": "4.42.3",
   "type_vocab_size": 2,

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e1826721ac4f04cf8be2306ad24cccf5b33c960693f4b4308d351fcdd9c706a1
+oid sha256:cce1090c9c0426bccf86db720361d7711123bd3994c55cf0a7437f33aaec80e6
 size 433301528

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8a94115df0ebc189c6c2b13e71a35c2453e11feca90d95a4d15cb843eb90c687
+oid sha256:7e08b96d08f9127eb0cd43164992281ee9787f7fb4b91eaf70283d068838be61
 size 5112