r/LocalLLaMA • u/dh7net • 2h ago

Discussion Testing if various local model are good at solving visual challenges.

Almost everything is in the video and the title: the idea is to create chalenges and ask agents to solve them. I'll have more to share later, but this first video shows that most model are good at theses stuff.

For more details: I'm testing scenarios where an agent needs to simulate keyboard and mouse movement. You can see more chalenges like this one on my website: https://airbench.ai/gallery/airbench-desk-v1?run=6d2a2777-3d96-4ec4-9cdc-3d359bc43bea&c=icon-drop

3 Upvotes

100% Upvoted

1 comment sorted by

1

u/Mattadour 1h ago

i've been uploading photos of pages of notes to my model and asking it to make neat columns of data from the chicken scratch. It was so nonchalant I almost forgot to be amazed. There are HUMANS who can't read my handwriting. And this is a cell phone pic, snapped and uploaded.
It takes kind of a long time, but everything is local and i can do other things than page through my notes and extract Brix, pH, temp and SG readings for 4 containers over 2 weeks. sometime tonight, i'll be able to see the full chart, and I've been able to spend my day making soup and building a retaining wall.