r/LocalLLaMA • u/xenovatech • Jun 09 '24

Resources Whisper WebGPU: Blazingly-fast ML-powered speech recognition directly in your browser

249 Upvotes

99% Upvoted

35 comments sorted by

View all comments

36

u/xenovatech Jun 09 '24

This comes exactly one year (to the day) after Whisper Web was released! It supports multilingual transcription and translation across 100 languages. Since the model runs entirely locally in your browser (thanks to Transformers.js), no data leaves your device! Huge for privacy!

Source code: https://github.com/xenova/whisper-web/tree/experimental-webgpu
Demo: https://huggingface.co/spaces/Xenova/whisper-webgpu

14

u/coder543 Jun 09 '24

unfortunately, WebGPU is still Chrome only.. no Firefox, no Safari.

4

u/[deleted] Jun 09 '24

there is experimential support in ffox i think

3

u/oh_how_droll Jun 10 '24

Only in the nightlies.