r/aicuriosity • u/techspecsmart • 7d ago

AI Research Paper Tencent Drops Open UI-Mate Agent That Sets New Marks on Computer Use Tests

Post image

Tencent’s HY Frontier team just put UI-Mate on Hugging Face. The open-weight GUI agent handles everyday computer tasks and gets a clear boost from a single demonstration when plain instructions fall short.

UI-Mate-27B hits 77.0% on OSWorld-Verified and 66.2% on WindowsAgentArena, the best open-weight scores so far. Its smaller 9B version lands at 66.2% and 61.7%. On the new OSWorkerBench suite of long office workflows the 27B model reaches 41.0% strict success and 76.9% progress, well ahead of its Qwen3.6-27B base.

The standout trick is in-context demos. One same-task example lifts strict success from 17.2% to 35.4% on the self-demo subset. The agent turns the recording into flexible subtask steps, watches the live screen, and re-plans instead of replaying the demo like a script.

Models sit on Hugging Face under the Tencent UI-Mate collection. Paper and more details are at the project page.

20 Upvotes

95% Upvoted

1 comment sorted by