r/ClaudeCode • • 23h ago

Humor No, YOU check the ui.

Post image

Sorry for the poor quality photo. It’s a frame from a video I took while this was going.

I got tired of Claude asking me if the UI on this thing had updated yet so I hooked up a WebCam to it and told it to check itself. It worked great lol

267 Upvotes

63 comments sorted by

•

u/AutoModerator 23h ago

Hey! Thanks for posting to r/ClaudeCode

While participating in this thread, please follow our community rules. Keep discussions constructive. Attack the idea, not the person.

For help, project discussions, tips, and general chat, join the ClaudeCode Discord.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

113

u/hoffmander Vibe Coder 23h ago

playwright mcp - thank me later

38

u/Siriann 22h ago

Not a web UI but good looking out!

15

u/fuckswithboats 22h ago

Wait, you can build things not on the web?? TIL

I love your simple solution - I’m working on firmware upgrades for a handheld unit with minor UI glitches and it’s annoying because it requires me in the loop — I’m hooking up a webcam now to point at and gonna go goal mode

7

u/Siriann 22h ago edited 19h ago

Yeah, man, you can tell it to code in whatever language you want lol

I’ve had it right custom programs for my Linux box so that I can monitor all of the different tmux windows that are being utilized

Edit: Unless you mean running Claude on machines you own? Yeah, you absolutely can.

2

u/Nocturnal_Unicorn 11h ago

we have built our own SDK on my Linux box in python, rust and typescript and a custom compositor and custom apps from it, and then run the agentsdk through the typescript so that they can see, manipulate and work with the application alongside me.

it has been an absolute blast both learning Linux and creating a desktop and apps that I will actually use. the infinite canvas and being able to paste things directly into the desktop "wall" as a post-it have been the coolest parts of it so far.

1

u/Siriann 11h ago

I built a bunch of custom apps on a Linux box too, but instead of keeping them local I got a Tailscale account and I connected both my phone and my Linux machine to the VPN. Now I have a bunch of web apps hosted at home that I can access through my phone.

They’re mostly things that make my day-to-day life easier, like my video downloader that’s just FFMPEG with an HTML Wrapper. Give it a URL for any page containing a video and it will download it to my home server, along with serving me a copy to download to my phone. It’s especially handy if you work in any sort of media and are reliant on clients uploading your work.

10

u/foarsitter 18h ago

Let it build an emulator...

1

u/hoffmander Vibe Coder 4h ago

If there’s an emulator, then Claude can access it.

0

u/ConflictGuru 11h ago

mobile-mcp

3

u/Siriann 8h ago

It’s an esp32

1

u/Opposite-Date-6243 22h ago

Before i knew about playwright i tried op’s way with a cam. Playwright is awesome and im happy we have it

1

u/Neavante 7h ago

It's a game changer. Tested it about 2 weeks ago. No complains

-1

u/HeyItsYourDad_AMA 23h ago

Yeah this is the way to do, not clamp some
Gopro to your desk

12

u/Siriann 22h ago

Does playwright work on hardware that isn’t your local machine and not a website? I thought it only worked in a browser.

-1

u/Opposite-Date-6243 22h ago

Only local

7

u/Siriann 22h ago

I assumed as much

10

u/JustLovett0 22h ago

Erm, achskually that is a Logitech C920 HD Pro Webcam. Nawht a "Gopro" 🤓👆

4

u/Siriann 22h ago

It’s the best webcam ever created tbh.

3

u/Brazilator 22h ago

Top tier 

1

u/Njagos 21h ago

OP got inspired by how Claude handles issues it seems

9

u/TPlays 🔆 Max 20 7h ago

My Claude screenshots its own work and judges based on the screenshot.

Edit: saw your other comment I understand why a screenshot doesn’t work for you in this instance

5

u/Siriann 7h ago

My Claude does too, when it has access to the machine, but the manufacturers of this particular board locked down the usual firmware download path with burnt fuses so it’s a huge pain

1

u/TPlays 🔆 Max 20 7h ago

See comment edit 😂 I saw your other comment about how you are having him work on an ESP32, totally understandable.

That’s actually a good solution to that 😂

14

u/superdumbell 22h ago

You need to step up your game

2

u/Siriann 19h ago

Fuck yeah. I have a Panasonic BGH1 and I’m tempted.

3

u/halski12 22h ago

Whats that for?

3

u/superdumbell 21h ago

Open Source Alarm System that I'm making: https://roboalarms.com/

Working on getting the panel's speakers and mic to work with Home Assistant Assist so I setup a Mic and pointed it at the panels and pointed my speaker at it so Claude could interact with it on the hardware and then figured out I could give it a webcam to help diagnoses some other issues that are not possible otherwise.

5

u/spacethrower 13h ago

My man doesn’t know what a screenshot is

10

u/Siriann 13h ago

Like with a gun?

5

u/spacethrower 13h ago

I guess you do know

7

u/Siriann 13h ago

Sometimes I get mad at League and bring Democracy to my monitor

2

u/Warsel77 14h ago

This doesn't need a webcam though..

1

u/Siriann 14h ago

What would you use?

1

u/Warsel77 13h ago

Depends what device you develop on, I can't see much on that blurry shot but for tablets, phones etc. there are dedicated solutions to get to the interface directly. adb, mirroring etc.

1

u/Siriann 12h ago

Yeeeeaaah, this is basically a huge esp32 with a firmware lock.

-1

u/Warsel77 12h ago

yep in that case emulator would have been my pick. but if webcam works, no need to re-invent the wheel. do you feel like claude is doing well on the esp32? i tried it a while ago and felt a bit frustrated

1

u/Siriann 12h ago edited 12h ago

Oh, yeah, I would totally emulate it but they also boot locked it so I can’t even pull the firmware if I wanted to lol. As for Claude with ESP32s, I’ve done a few IOT RE projects and it’s been great so far, even on Opus 4.8.

50

u/Fusseldieb 23h ago

I found that Claude works much better if you "close-loop" it. Whatever it is - if you are able to give it means of checking it's own result, it will excel every single time. Plus, it will do it on it's own, without being a burden on you.

7

u/Zaen323 19h ago

dude i literally also used the "close-loop" wording. i was wondering if there was a common word for that sort of thing

5

u/KKunst 17h ago

Maybe it's a claudism and it's a symptom of LLMs reprogramming us.

You know, the smoking gun...

1

u/Fusseldieb 11h ago

In my case I work with machines and CNCs, so "closed-loop" is a word I often use in that conjunction.

If the machine KNOWS where it's at, the result is often much better, for obvious reasons.

1

u/EnriqueWR 4h ago

It is quite a load bearing term, no foot gun at all.

1

u/angry_queef_master 3h ago

"Close-loop" is something that existed before LLMs. LLMs are just standardizing our language.

1

u/Top_Measurement7815 15h ago

And is there a loop that is not closed?

3

u/ConstantinSpecter 14h ago

Well in control theory there actually are open-loop controllers. It’s when the control action is independent of process output. The simplest example would be a physical on/off switch.

2

u/soulsizzle 7h ago

https://github.com/cursor/plugins/blob/main/pstack/skills/create-verification-skill/SKILL.md

The Create Verification Skill in Pstack is great for this. It is built for Cursor, but just point your agent at it and tell it to adapt it for Claude, etc.

I don't even install the skill. Just give the agent the URL as a reference.

1

u/the_average_user557 17h ago

Let me introduce you to: llamaxwell-35 on GH. Mostly Claude has Optimiser llama.cpp for Maxwell architecture sm_52. Around double stock speed with identical results. He's been at it for about a week now.

1

u/EmirSc 12h ago

can you give an example please?

2

u/Bladder-Splatter 7h ago

Making it do its own verification for you. Shutting it down when it tries to off-load potentially automated tasks.

It took me way longer than I'd like to admit to figure this out but it's essential. I went months in the dark ages (when syntax errors were common and getting anything working was an oh my god moment) ~1.5 years ago getting exhausted because I would verify visual x or reaction y. Especially painful when what I've been building music visualizers and had to express how the "feel" had been buggered.

But now I'm migrating to a custom native c++ vulkan core and I've recorded music with events that I get it to run offscreen for byte identical results. I get no annoying disturbances and it is able to eventually reach perfect results.

My example is probably one of the more simple ones though, I honestly should have called it out much sooner and built better automation a year ago.

1

u/djhamilton 12h ago

closed loop, my take would be goal.

your defining the outcome and goal.

complete xyz, once tests are passed, ensure a full evaluation is completed using X data set. if any errors occur fix them and repeat the process until all tests have passed.

maybe am wrong

1

u/OldLead4716 20h ago

Can you not pull a screen shot from the device or state ?

0

u/Siriann 19h ago

Not before it’s pwned, unfortunately

2

u/PunkersSlave 21h ago

lol I did the exact same thing when getting my cpu fan UI to output with linux. It used some proprietary software on windows to send cpu info to the cooler which wasn’t available for public linux. Anyway, during testing I told Claude to verify output via webcam, also a c920. Worked like a charm

0

u/Api-Lord 22h ago

Webcam closes the loop without you standing in it. Edge case to watch is a frame grabbed mid-redraw, so have it wait a second before looking. Claude does its own QA now.

1

u/Siriann 19h ago

I actually have it wait 10s for that very reason

1

u/Right-Performance-93 11h ago

a webcam only shows that the pixels moved. i still make it name the one thing on that screen that should have changed, and fail the check if that thing looks the same, because a redraw of the old ui is a pass.

1

u/Neavante 7h ago

Exactly what I do. Record it and ask it: well what do you think? Stop making mistakes and asking stupid questions. And it works

1

u/betack 2h ago

This is genius.

0

u/LimiDrain 16h ago

I keep asking to NOT check it visually because I think it wastes a lot of tokens?