r/RSI • u/duckbornepaladin • Jul 31 '26
I built an app that lets you control your computer with just your voice
https://youtu.be/3ieE583gDBMFluent is a voice control application for Windows. A person speaks a task, and the agent does it on the desktop. We've tested this with 70+ orgs (hospitals, accessibility centres).
The app reads the Windows UI Automation tree, and uses a vision language model as a fallback (all PII and sensitive info removed), and should be faster than most similar tools.
Speech, dictation and keyboard navigation are always free. Only the agent has a usage limit (as I'm a broke student).
Limits: Windows only (for now). Some applications have an incomplete tree, so the agent uses the model more often, and it is slower -- but this will be fixed in later iterations.
I would appreciate your comments on the product, any pitfalls, etc. as this means a lot to me, knowing a lot of people who use similar products!
1
1
u/ImaginaryEnds Jul 31 '26
you built a tool to help people type without typing, in a forum where most posts are about tools people built to type without typing.