Installing Whisper

[firmansi]

What do you mean by installing whisper?

[andreasdueren]

@firmansi Running the OpenAI Whisper model for transcription purposes

[firmansi]

You mean from voice to text? If that you mean then you can enable it through Admin Settting > Audio

[andreasdueren]

@firmansi Hmm I see. But how do I select that then in the interface? I.e. I have an audio file. What are the steps in OpenWebUI to get the transcription from said file.

[firmansi]

Steps will be

1. Choose OpenAI STT setting
2. Fill openAI API
3. Fill API Key
4. Fill STT Model with whisper-large-v3 or any other that you prefer

[andreasdueren]

@firmansi said in Installing Whisper:

Steps will be

1. Choose OpenAI STT setting
2. Fill openAI API
3. Fill API Key
4. Fill STT Model with whisper-large-v3 or any other that you prefer

Yes I#ve gotten that far. But when you select a new chat, I can not select the whisper models.

[andreasdueren]

Seams like I'm not the only one struggling to understand the whisper implementation: https://github.com/open-webui/open-webui/issues/2248

[robi]

Do you have a GPU for this? Otherwise it will be very slow.

There are speedups that have been made with JAX, but that still runs on GPUs.

Once you get it working, let me know how long it takes for x minutes of audio.

[andreasdueren]

@robi Nope, just CPU. But seems to be very manageable. Faster Whisper says in the repo that a 13 minute on 8 threads Intel Core i7-12700K CPU takes roughly a minute.

[andreasdueren]

BTW it seems to automatically recognize any audio file you throw at it. Either via Microphone or file upload and process TTS locally before passing it on to the selected model. Logs and graphs are pretty clear about this. Documentation however is not lol.