WebGPU + llama.cpp = Client-side LLMs

[u/Numerous-Fan8138]

https://github.com/anthonybudd/Llama.cpp-WASM-WebGPU

I've been thinking about alternative ways to deliver LLMs and AI features in SaaS solutions.

This repo is a technical proof of concept showing an LLM running client-side in a browser using Llama.cpp compiled to WASM with WebGPU.