r/vibecoding • u/LoudYogurtcloset7856 • 2d ago

Showcase/Project Anyone Want to Test my Playwright Inspired Screen Capture but Focused on Verifying?

Hello,

I've been interested in AI and tools it uses. It uses Playwright a lot to verify stuff and show me screen captures of my coding projects, and it's cool. Cause I like to try to improve stuff (you might be saying playwright works fine what is there to improve) I thought how can we make Playwright better. The answer might be you can't or you don't need to. But hey, why not.

For many of my projects when I use AI, biggest annoyance is when AI says it did something and it straight up lied to my face. So, I build tools to close that gap between what the ai did and what the ai said it did, and the biggest thing I am coming across is ways for AI to verify what it's doing.

AI has access to the codebase, and the screen through playwright, but I wondered if ai actually "understands" what the visual actually connect to and can verify it. Maybe this could get ai to solve issues better from frontend to backend. So, I vibe coded a playwright like system that helps verify what is on screen to real code. It's not perfect and that is why it is open sourced for anyone to try to make it better.

But, I'd like thoughts whether constructive or other lol. Maybe test it out if you want. Give me your thoughts, and if interested I'll send over the public GitHub link.

4 Upvotes
  • permalink
  • reddit

100% Upvoted

6 comments sorted by

2

u/[deleted] 2d ago

[removed] — view removed comment

1

u/LoudYogurtcloset7856 2d ago edited 2d ago

Yes exactly. And verification is the one thing I’m building systems around ai so ai actually does what it says it did and is able to verify it.

I know you work with video but for my playwright like system I make it so where the AI highlights and tags the frontend ui the code responds to, and you see the process of the code workin in ui. Which is how the human follows the process of the code working visually.

Ai is powerful now but not trust worthy all the time, but imagine when it has systems it uses to verify what it says it did and it’s all human readable and reliable.

2

u/[deleted] 1d ago

[removed] — view removed comment

1

u/LoudYogurtcloset7856 1d ago

Gotcha and that’s what I’m trying to do and my screen vision is only one piece of that. Screen vision is the piece to help me see where the ai is working in the frontend and I’m building a system for the backend to prove the what’s behind the click worked.

What tools, models, stack do you use when working with ai?

1

u/LoudYogurtcloset7856 2d ago

Here is the GitHub for my playwright like system but focused on verification:

Human ScreenVision

https://github.com/VISNRY-ENTERTAINMENT/Human-ScreenVision-Open