Uploaded model
- Developed by: romitraj-ds
- License: apache-2.0
- Finetuned from model : unsloth/llama-3-8b-bnb-4bit
- Fine-tuning Method: LoRA (Low-Rank Adaptation) using Unsloth
Evaluation
The model was evaluated using the ROUGE metric on a subset of the neil-code/dialogsum-test dataset.
Results
| Metric | Original Model | Fine-tuned Model | Improvement |
|---|---|---|---|
| rouge1 | 0.164 | 0.418 | +25.40 |
| rouge2 | 0.061 | 0.163 | +10.25 |
| rougeL | 0.119 | 0.333 | +21.37 |
| rougeLsum | 0.126 | 0.332 | +20.56 |
Model tree for romitraj-ds/llama3_8B_summarise_fine_tune
Base model
meta-llama/Meta-Llama-3-8B Quantized
unsloth/llama-3-8b-bnb-4bit