How to use Arm/whisper-large-v3-quantized.w4a8 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("automatic-speech-recognition", model="Arm/whisper-large-v3-quantized.w4a8")
# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq processor = AutoProcessor.from_pretrained("Arm/whisper-large-v3-quantized.w4a8") model = AutoModelForSpeechSeq2Seq.from_pretrained("Arm/whisper-large-v3-quantized.w4a8", device_map="auto")
The community tab is the place to discuss and collaborate with the HF community!
