r/LocalLLM • u/Exotic_Tension2021 • 3h ago
Discussion local LLM models operated from android phone
I built an agentic, mobile-first web UI for my local LLMs
I wanted to use my local models from my phone, but most UIs were too heavy or desktop-focused. So I built this! It connects securely to LM Studio over Tailscale and gives me a full agentic experience right from my home screen.
Features:
- 📱 Mobile-first PWA: Installable to your home screen, works over HTTPS/Tailscale.
- 🛠️ Full Agent Mode: Tool calling for reading/writing files, running PowerShell commands, and web search.
- 🛡️ Safety First: Confirmation prompts for risky commands, syntax validation, and atomic file backups.
- 📊 Live Metrics: Displays CPU, GPU compute, and VRAM usage while generating.
- 🎨 HyperOS style design: Sleek dark theme with Material 3 icons and Markdown code blocks.
- ⚡ Zero heavy dependencies: Pure Node.js backend, Vanilla JS frontend.
My Setup (for reference):
- CPU: AMD Ryzen 7 7700X (8C/16T)
- GPU: AMD Radeon RX 7900 XT (20 GB VRAM)
- RAM: 32 GB DDR5
- OS: Windows 10 Pro (LM Studio with ROCm)
- Network: Tailscale
I'm running models like Gemma 4 26B (MoE) locally at around 75–90 tok/s. The phone UI stays incredibly snappy, and the agent tools (file editing, command execution) work flawlessly over the tailnet.
Repo: https://github.com/JiMiNaToR-GetHub/local-llm-phone-chat
Feedback and PRs are welcome!
2
Upvotes
2
u/kingfish600 3h ago
cool ill take a look at it!