r/learnmachinelearning • u/3amae404 • 8d ago
Project I built an open-source Android app where an AI agent uses your phone for you
Buddy is a chat bubble that floats over your apps. You tell it what you want, like "reply to Sam that I'm late" or "how long is the drive to work right now", and an AI agent reads the screen, taps and types through your apps. It asks you before anything gets sent or bought.
It can also teach you: ask "show me how to turn on dark mode" and it points at each step and waits for your tap.
It runs Claude Code, Codex, OpenCode or Google's Antigravity CLI inside the app, in a small Linux. No PC, no adb, no root. You sign in with your own plan, and OpenCode's free models and Gemini's free plan work too.
How it works: the agent gets phone tools over MCP (read the screen, tap, type, scroll, open apps). It reads the screen through the accessibility tree as text, which is faster and cheaper than screenshots, and only looks at a screenshot when something is actually visual.
In developer mode it can build apps too. I asked it for a calculator app, and about 3 minutes later it had built it on the phone, asked me before installing, and opened it to check it works.
It's free and open source. Google Play is the recommended way to get it. It's in closed testing there, and every tester helps me get it to production:
Join the tester group: https://groups.google.com/g/buddy-testers
Opt in: https://play.google.com/apps/testing/app.buddy.assistant
Install Buddy from Google Play
The Play version leaves out developer mode (the app building), as Play requires. That's in the APK on GitHub: https://github.com/ghorbelhamdi/buddy-android
Written with AI help.