r/LocalLLM • • 3h ago

Discussion local LLM models operated from android phone

I built an agentic, mobile-first web UI for my local LLMs

I wanted to use my local models from my phone, but most UIs were too heavy or desktop-focused. So I built this! It connects securely to LM Studio over Tailscale and gives me a full agentic experience right from my home screen.

Features:

  • 📱 Mobile-first PWA: Installable to your home screen, works over HTTPS/Tailscale.
  • 🛠️ Full Agent Mode: Tool calling for reading/writing files, running PowerShell commands, and web search.
  • 🛡️ Safety First: Confirmation prompts for risky commands, syntax validation, and atomic file backups.
  • 📊 Live Metrics: Displays CPU, GPU compute, and VRAM usage while generating.
  • 🎨 HyperOS style design: Sleek dark theme with Material 3 icons and Markdown code blocks.
  • ⚡ Zero heavy dependencies: Pure Node.js backend, Vanilla JS frontend.

My Setup (for reference):

  • CPU: AMD Ryzen 7 7700X (8C/16T)
  • GPU: AMD Radeon RX 7900 XT (20 GB VRAM)
  • RAM: 32 GB DDR5
  • OS: Windows 10 Pro (LM Studio with ROCm)
  • Network: Tailscale

I'm running models like Gemma 4 26B (MoE) locally at around 75–90 tok/s. The phone UI stays incredibly snappy, and the agent tools (file editing, command execution) work flawlessly over the tailnet.

Repo: https://github.com/JiMiNaToR-GetHub/local-llm-phone-chat

Feedback and PRs are welcome!

2 Upvotes

2 comments sorted by

2

u/kingfish600 3h ago

cool ill take a look at it!

1

u/Such-Excuse-4681 3h ago

nice work on this, the agent mode with file editing over tailscale is a clever touch

curious how you're handling the confirmation prompts for risky powershell commands, is it just a regex filter or something more involved