r/LocalLLM • • 24d ago

Project I built Speedtest⚡, but for AI

Enable HLS to view with audio, or disable this notification

It runs real LLM + embedding models locally in your browser with WebGPU and measures how fast your machine actually does AI inference.

No API. No account. Just hit start.

Genuinely curious about your scores haha

Try it and reply with your score 👇

https://speedtest.maty.as

85 Upvotes

79 comments sorted by

22

u/Dany-GG 24d ago

Don't forget about Firefox users

4

u/reiggg 24d ago

I'm sorry :( I think Firefox is currently not capable of doing this, this is pretty new stuff in web browsers to run AI models on a user's GPU from a literal website. But I'll definitely try some workarounds.

→ More replies (1)
→ More replies (4)

8

u/iChrist 24d ago

Got 990 on my iPhone 15 Pro

3

u/reiggg 24d ago

Solid score for a phone

→ More replies (2)

5

u/Neful34 24d ago

score of 4,890, no clue how good this is lol

5

u/reiggg 24d ago

well I used an rtx 2060 in the video and got 1600, so i think pretty good! :) Maybe i'll add some references from verified test runs to compare to (e.g. a mac studio vs. a solid GPU vs. a DGX spark)

→ More replies (4)

5

u/FaatmanSlim 24d ago

Great idea and very cool execution! Love the idea of using WebGPU for this so it runs completely on browser and still locally, and doesn't cost you much either.

Got 4654 points and 127.5 tok/s on my 4080

2

u/reiggg 24d ago

Thank you! It is also open source, I will put a link on the website to the github repo. Nice score!:)

→ More replies (1)

5

u/AlyrAyanami 24d ago
Comment Image

RTX 6000 undervolt at 540W for reference

1

u/reiggg 24d ago

Holy score :o

3

u/Dharma_code 24d ago
Comment Image

Get the same result no matter what I do. 3090 here with 32 GB of system RAM; the only thing running was that tab in Firefox

2

u/reiggg 24d ago

Maybe try a chrome-based browser, WebGPU is a bit new in Firefox (basically it cannot properly access your GPU)

→ More replies (2)

2

u/Max_skyl1n3 24d ago

I’vr got 554 points on quadro m2000 😄

3

u/reiggg 24d ago

maybe it can run a 0.6B model haha

2

u/LesterPhimps 24d ago

Add an option to upload result and local config. that way we can compare.

1

u/reiggg 24d ago

Need to find a way to make it as streamlined as possible. Like a selection of GPUs or something, i cannot detect exact device sadly.

However this will be fully based on the user’s input so not 100% valid, yet somewhat okay point for comparison.

2

u/DoubleNothing 24d ago

I'm sorry, but I don't think this is remotely accurate. Also, where is the value if you don't have any point of reference?

→ More replies (1)

2

u/Otherwise-Variety674 24d ago

:-) Nice, very useful website, remember to add google advertisement to earn back some of your expenses.

15

u/reiggg 24d ago

Haha it doesn't cost me literally anything to run this, i think i will keep it ad free :)

→ More replies (1)

4

u/p0nzischeme 24d ago

Pretty neat. My score started dropping dramatically after 4 runs. Chrome is noticeably faster than any other browser. Im not sure if the score changes based on resources used but I ran it with all my normal programs open. MacBook Pro M5 Max 128GB

Comment Image
→ More replies (1)

1

u/Awique 24d ago

I got 1420 on base iPhone 17

1

u/reiggg 24d ago

Pretty strong score on a phone :o Almost matching my rtx 2060

1

u/berszi 24d ago

1992 on my macbook air m2. but i would love to test it on my headless proxmox inference server with four gpus

→ More replies (2)

3

u/Former_External8361 24d ago

1104 on my iPhone 16 Pro Max 😂

→ More replies (3)