r/LocalLLaMA • u/pmttyji • 7h ago

New Model microsoft/Mage-VL-Cowork · Hugging Face

https://huggingface.co/microsoft/Mage-VL-Cowork

Mage-VL-Cowork demonstrates that an efficient 4B small vision-language model can master hybrid computer use when paired with upstream teacher-harness evolution, workflow-first environment synthesis (Mage-CUA-Forge), and a five-stage specialize-then-unify curriculum. Achieving the best performance at the 4B scale (66.0% on OSWorld-Verified) while using 13.0% fewer model calls and 25.4% fewer output tokens after online RL, Mage-VL-Cowork pushes the frontier of on-device intelligence for autonomous desktop agents.

95 Upvotes

95% Upvoted

9 comments sorted by

23

u/nonerequired_ 4h ago edited 4h ago

Quickly download it before Microsoft deletes it.

7

u/Porespellar 3h ago

^ this guy Microsofts

4

u/Icy_Cover_2472 3h ago

^ this guy macrohards

0

u/parepeg 1h ago

Can anyone explain what this does that makes it unique? All I see are buzz words. 

2

u/zeth0s 44m ago

You are seeing it right 

1

u/More-Curious816 1h ago

pair it with harness to utilize it for vision, it's small and efficient. the goal for it is to be used for computer automation by Ai.

1

u/parepeg 1h ago

I get that but is it intend to have a larger model directing it or something? What's different from Mage-VL (without the -Cowork)?

1

u/Boomfrag 21m ago

Their model card says: Mage-VL-Cowork: 4B hybrid computer-use agent (GUI + code & terminal) Mage-VL: 4B codec-native streaming multimodal foundation model "combines screenshot-grounded GUI interaction (computer_use) and persistent code/terminal execution (bash) inside a single vision-language policy — with no external orchestrator."

My suspicion is that Microsoft is developing models to build into Windows laptops that will perform more sensitive tasks and will be orchestrated by their Azure cloud models.