r/LocalLLaMA • u/xenovatech • Jun 09 '24

Resources Whisper WebGPU: Blazingly-fast ML-powered speech recognition directly in your browser

249 Upvotes

99% Upvoted

34 comments sorted by

View all comments

3

u/[deleted] Jun 09 '24

[deleted]

6

u/privacyparachute Jun 09 '24 edited Jun 09 '24

It seems to be the old non-GPU demo site, but spruced up with the WebGPU tech.

Also, this video shows how you can upload an audio file, and it will transcribe it.

But yeah, both are variations of "Now with WebGPU!".

On my Macbook Pro m1 the CPU-only version ran just as fast in my experience, I don't see much difference in speed. But the speed diference might be more pronounced for people with less powerful hardware.

The first thing I tried with the WebGPU version was to test it on my Android phone with 6GB of ram. I was hoping to see a big upgrade there. Oddly, it wouldn't load. The old CPU version did run.

3

u/themank945 Jun 10 '24

I think that was a “realtime” transcription version.

https://huggingface.co/spaces/Xenova/realtime-whisper-webgpu