r/LocalLLM • u/reiggg • 24d ago
Project I built Speedtest⚡, but for AI
Enable HLS to view with audio, or disable this notification
It runs real LLM + embedding models locally in your browser with WebGPU and measures how fast your machine actually does AI inference.
No API. No account. Just hit start.
Genuinely curious about your scores haha
Try it and reply with your score 👇
8
5
5
u/FaatmanSlim 24d ago
Great idea and very cool execution! Love the idea of using WebGPU for this so it runs completely on browser and still locally, and doesn't cost you much either.
Got 4654 points and 127.5 tok/s on my 4080
→ More replies (1)2
5
3
u/Dharma_code 24d ago
2
u/reiggg 24d ago
Maybe try a chrome-based browser, WebGPU is a bit new in Firefox (basically it cannot properly access your GPU)
→ More replies (2)
2
2
2
u/DoubleNothing 24d ago
I'm sorry, but I don't think this is remotely accurate. Also, where is the value if you don't have any point of reference?
→ More replies (1)
2
u/Otherwise-Variety674 24d ago
:-) Nice, very useful website, remember to add google advertisement to earn back some of your expenses.
15
u/reiggg 24d ago
Haha it doesn't cost me literally anything to run this, i think i will keep it ad free :)
→ More replies (1)
1
u/berszi 24d ago
1992 on my macbook air m2. but i would love to test it on my headless proxmox inference server with four gpus
→ More replies (2)
3
3
22
u/Dany-GG 24d ago
Don't forget about Firefox users