Integrating with Hugging Face pretrained models

[mkatic007]

Could you please explain how to add a Hugging Face pretrained model to work with WhisperLive?

[makaveli10]

@mkatic007 that is indeed possible with both backends i.e. tensorrt as well as faster_whisper

• TensorRT
  This guide converts the original whisper models to TensorRT. Adjust accoridingly to convert huggingface pretrained whisper models.

• faster_whisper
  Faster whisper has a section in their readme which shows how you can convert hf model to ctranslate2. Once you have the model converted run the server with your custom model:

python3 run_server.py --port 9090 \
                      --backend faster_whisper
                      -fw "/path/to/custom/faster/whisper/model"