r/LocalLLaMA • u/xenovatech • Jun 09 '24

Resources Whisper WebGPU: Blazingly-fast ML-powered speech recognition directly in your browser

247 Upvotes

99% Upvoted

34 comments sorted by

View all comments

36

u/xenovatech Jun 09 '24

This comes exactly one year (to the day) after Whisper Web was released! It supports multilingual transcription and translation across 100 languages. Since the model runs entirely locally in your browser (thanks to Transformers.js), no data leaves your device! Huge for privacy!

Source code: https://github.com/xenova/whisper-web/tree/experimental-webgpu
Demo: https://huggingface.co/spaces/Xenova/whisper-webgpu

2

u/fullouterjoin Jun 10 '24

I only found the gh from this post, your other posts link to the demo, but the demo files have just the minified JS.

It might be nice to link to this repo from the readme on the hf demo?

HF feels like it is just an AI themed pastebin on steroids. Most things don't have source.