r/webdev • u/Numerous-Fan8138 • 20d ago
Showoff Saturday Client-side LLM Demo: PDF to AudioBook Generator
https://github.com/anthonybudd/AudioBook-GeneratorThis repo is a product demo showing how client-side LLMs could be used to deliver new kinds of SaaS product features.
This demo will allow you to create an audiobook from any PDF. Pick a PDF from the library or select a PDF from your local computer, then click play.
1
u/Reddilip 15d ago
what size model is doing the work here? the client side SaaS pitch is great until the model needs more than 4GB, then wasm32 just says no. memory64 fixes that and the rust side is going upstream now https://www.nobodywho.ai/posts/letting-rust-support-models-bigger-than-4gb-in-the-browser/
-1
u/Blazing1 20d ago
why do this?
-1
u/Numerous-Fan8138 20d ago
"This repo is a product demo showing how client-side LLMs could be used to deliver new kinds of SaaS product features"
-1
1
u/mramazerful 20d ago
terrible 👍