fixie-ai/common_voice_17_0
Viewer • Updated • 11.4M • 65.2k • 20
How to use mmarron14/whisper-medium-cv17-es-500-steps_proc3-def3 with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("automatic-speech-recognition", model="mmarron14/whisper-medium-cv17-es-500-steps_proc3-def3") # pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq
processor = AutoProcessor.from_pretrained("mmarron14/whisper-medium-cv17-es-500-steps_proc3-def3")
model = AutoModelForSpeechSeq2Seq.from_pretrained("mmarron14/whisper-medium-cv17-es-500-steps_proc3-def3", device_map="auto")This model is a fine-tuned version of openai/whisper-medium on the Common Voice 17.0 dataset. It achieves the following results on the evaluation set:
More information needed
More information needed
More information needed
The following hyperparameters were used during training:
| Training Loss | Epoch | Step | Validation Loss | Wer Ortho | Wer |
|---|---|---|---|---|---|
| 0.2126 | 0.2 | 100 | 0.1915 | 11.4950 | 7.0113 |
| 0.1861 | 0.4 | 200 | 0.1843 | 11.2696 | 6.5645 |
| 0.1902 | 0.6 | 300 | 0.1785 | 10.6012 | 6.2633 |
| 0.1741 | 0.8 | 400 | 0.1735 | 10.3084 | 5.9830 |
| 0.1796 | 1.0 | 500 | 0.1708 | 10.2104 | 5.9175 |
Base model
openai/whisper-medium