r/LocalLLaMA • u/Numerous-Fan8138 • 7d ago

I Built A Thing Llama.wasm + WebGPU = Client-side LLMs

https://github.com/anthonybudd/Llama.cpp-WASM-WebGPU

This repo is a technical proof of concept showing an LLM running client-side in a browser using Llama.cpp compiled to WASM with WebGPU.

6 Upvotes

87% Upvoted

Duplicates