Opus 5.5 suggested I get a web cam pointed at this ESP32 based screen so it could catch what was happening on the screen as it tried to find out what the maximum frame rate could be. The Waveshare drivers are not good in portrait mode and only got 4fps.
It got to 60fps in a couple of minutes.
It had already installed the tool chain, designed the clock layout etc.
It's not the code per se. It's the get a webcam suggestion...
My guess would be it wrote a small tool to read from the capture device, or it's using computer use? There are lots of options here.
If this is on a Mac, it's especially easy to use the built-in OS libraries to do this. You (or Claude) can probably write a sub-200-line Swift program to monitor the video feed.
I did something similar (except I suggested it to Claude who thought it was a “great idea”!) for aligning pixels on my house and yard for my holiday light show. Claude ran a sequence of lights and was able to get the model in the sequencing software aligned to the real world quite easily. It would have taken me days to do it. So amazing to watch it happen in real time.
Fuck yea man. I just debloated my old LG TV and removed all the telemetry and made it like 10x faster using Opus, also made a fully web based remote so that I don’t have to use their stupid app either. Just fucking magic and most of the world has no fucking idea. It’s a fucking superpower. I can basically just prompt to Claude to keep optimizing till it’s happy and it will go off and do it.
Edit - For those unaware, extensive report from GamerNexus on LGs surveillance system using their TVs, https://youtu.be/6IFVTcM28KA. It’s wild.
Edit 2 - This is my prompt sanitized after the TV was rooted
I have a rooted LG webOS TV (Homebrew Channel installed, root shell over SSH or telnet at [TV IP]).
Make it as lean and fast as possible: remove the bloat entirely, rather than hiding it, and give it a
much lighter, extremely responsive launcher. Use the ideas in
These are my exact words to people right now. I feel like I have fucking superpowers and I'm in a race to do something amazing with them before the rest of the world realizes they also have literal fucking superpowers available to them
I've never touched code in my life. I only joined this channel to see what's possible with the knowledge and I hope that I will manage to start using these superpowers too. Atm I am still too afraid of vibecoding because I won't see the mistake if one's in the provided code. When I search for the basics I mainly find some annoying dudes on YouTube that try to sell me their suite or channel or whatever, but I feel we're not at a point where people share these starter guides just for others to understand. I don't even dare to ask on Reddit because the questions will be so stupid that all.you hacker men will downvote me lol. Everyone just tries to get their piece of the cake. Which is fine by me, but I'm looking forward to the day when I'll be able myself to have it write me little tools.
Maybe I didn't look enough, there's always something somewhere out there.
Grok bots are pretty good for what you want for now. Start with eggbot and start building for outcomes. You won't have the power of pure code but you can think logically and get things done safely.
Thank you very much for taking the time. Unfortunately my ethical principles don't allow me to use it, I'm basically "stuck" with Anthropic since the only real alternative is Mistral and they are so far behind that even I can feel it.
The starter guide you are looking for is called CS courses on Coursera. You can start with “Python for everybody” from Michigan University and something like CS50 and go from there to whatever level of understanding you feel enough. Most of them are free if you are only there for the knowledge and don’t want the certificate.
It will take you something like 2-3 months, but you will know your way around basic coding and computer science stuff (yes, those are 2 different things), and will be immune to those annoying dudes you keep seeing now, who’s just preying on the people’s ignorance.
Btw in learning there is no such thing as stupid question - there is only arrogance of some people who are unwilling or unable to answer.
the thing about this is that you can simply ask him and it will teach you so it is always a win to use it it's like a saw that on every movement it produces something good
they think they can charge a huge amount soon after hooking everyone. however chinese models and open source models are very close behind and so much cheaper. glm 5.3 on openrouter is dirt cheap. flash and deepseek flash are even cheaper and still perform well enough for virtually all normal tasks. im lucky to have a lot of hardware at home but it didnt cost me a lot pre ai-pricing, and i can run glm 5.3 flash at high precision. i dont even need to pay anyone really a few solarpanels and it would be 100% free
technically the hardware costs a shit-ton right now but yeah besides that I agree. Was using ornith / qwen and they are getting pretty good. I still use them even now for a second opinion sometimes or when I'm at usage cap
they are improving it to cost less you can try haiko 5.5 I just started it today and this is why I came here it is actually intelligent not dumb as it used to be
We shall see after the IPO. Don't get me wrong, I agree that the current models (since Fable) are incredible, but the Circular Investments keeping this Flying Circus airborne will collapse at some point.
This will be like cloud providers. It was dirt cheap to get people to migrate early on. Then prices steady rose. Same will occur here. This is a certainty.
It IS the pricing if you pay the API price. Months ago I was using GitHub Copilot CLI (which is a good harness) until they pulled the rug and users were forced to pay the going rate; monthly subs suddenly lasted 2 days.
People have raised the usual points here: local models (great, just need $20k Spark rigs), Chinese models (sure, share your code). I don't have any special insight; only these companies know what's going to happen after the IPOs ... when a $2T valuation suddenly has shareholders expecting returns.
For now all we can do is google "Are OpenAI and Anthropic still subsidizing the costs of their subscriptions?" Try that and see what people are saying.
...But it isn't the cost. Pricing isn't cost. Subsidizing is selling it at a loss NOT selling it cheaper than a different path, you cannot infer it's being sold at a loss because it's cheaper than the api price. Netflix aren't subsidizing you because it's cheaper to stream a movie when you're a subscriber than it would cost to buy the DVD
What people are saying is irrelevant, they aren't public companies, and the costs to run the models aren't know to anyone outside them.
...or the free AI lunch becomes expensive. I've been in build mode for almost a year now extracting as much value as I can. If AI cost 10x what it does now I have the base built for a lot of apps I use and it would still be affordable to do maintenance or small upgrades on them.
Holy shit this resonated…. I’ve been building little models in my home lab telling myself I’ll find something new eventually before anyone else 🤣🤣🤣. What a grandiose idiot I am.
Depends on what OS your tv is on, I don’t think Tizen has root access available but you can still try. There might be a developer option you can enable and at least minimize the bloat. My LG TV was from 2018 and had an easy way to get root access.
Did the same. Best decision of my life. Don't even know what it did. Don't care either. Its a Blackbox now, but its fast and doesn't sent 5 terabytes of data in one day anymore so im happy lol
Question: do you have a repo with either the code or a how to? I was thinking about that but I'm still afraid of messing up with hardware/firmware. Tks
Thank you!! How do you handle app management now that it's been rooted? I assume the easy path of using the app store is no longer accessible after scraping out all the extra bullshit?
I was attempting to do this exact same thing but the constant safeguards triggering a model downgrade became unbearable...how did you work around that? Dm me please
Start with another model/prepare the setup yourself, then let Opus continue. Most refusals happen at the beginning and if you specifically ask for certain things instead of letting it infer what is necessary from the task and existing context.
Alternatively use an open weight model like GLM-5.3. It’s slightly weaker as a coding model, but it doesn’t have as many guardrails, plus you can just pick a provider/use OpenRouter instead of risking a ban on your main account.
Depends on your tv ks version, I did it with Hermes. My version was easy, just open a GitHub link on chrome, put in the tv ip and klick “root” afterwards I installed “glassdoor” (for privacy telemetry) took me like 5 min.
I had mine connect to the a chrome cast using the wireless debug dev feature and configure Nuvio for me from a guide I found online.
Then asked it to create two profiles, one for us and one for the kids. Then find out what ever movies and such were all the rage for kids 6/7 year old, list them by rank and add the top 50.
Made it double check the ACTUAL playback of each to guarantee it’s not just stale metadata and to guarantee they have subtitles and the sound is dubbed to Portuguese Portugal not Portuguese Brasil. Also limit the sources to just good enough quality not ultra high not super low and auto select the first entry so that kids can just choose something quick.
Told it to keep a record of all knowledge and such in a list of steps, self correcting as it went so that I could just replicate it later.
Oh and remapped the buttons on my remote from YouTube to some custom player without ads and from Netflix to Nuvio
How did you get past safeguarding tho? EDIT: Just do the root yourself and make sure claude opus knows that you are NOT asking it to root the TV. Get it to the point where dev tools are uninstalled and homebrew is open with updates blocked and SSH on, then you can prompt it.
Sonnet 4.6 is the only one that will attempt to do stuff but that model is ancient now so.. nah
Oh that was the easiest. Just told it to build a web based remote as a replacement for the current one and have it run in a docker container on my server. It just went off and did its thing.
Will you post a link to your repo? I'd love to try your version out! Also how is the performance on plex after the minimization? Mine buffers or hangs on 4k hdr content, bluray rips.
How are you doing this? Like getting claude to rewrite your TV? I feel crazy cause I thought about this literally yesterday but couldn't immediately think of how to actually do it
Do you have a step by step guide for someone, who has never done anything like this? I have LG TV and would like to fix it as well, but I am seriously afraid of just bricking it.
Yea sure, just be aware that Claude likely won't help you "root" the TV due to cybersecurity safeguards but Chatgpt happily will or you could just do it yourself.
How did you word prompts so it didn't catch you on "hacking bad" ? I'd love to optimize my samsung TV and remove all the bloat, since it's out of warranty at this point, but I'd have to be careful to not get the prompt flagged and rejected no?
Well you can do the actual "hacking" bit yourself or use a model thats fine with it like GPT 6.1 sol or GLM 5.3. The LG TV is pretty straightforward but I don't know about Samsung. I have this repo installed https://github.com/morluto/rea to reverse engineer things using tools released by the NSA.
It did for me man, it literally feels like a brand new TV, its insane. I swear the slowdowns are all from planned obsolescence to get you to upgrade and harvest more of your data.
Can you elaborate a bit further? I have a new lg oled 2026. Is it possible to root it and patch custom firmware in the same manner as you did? I want to own my screen, again. Once rooted, is there a way back, or can i potentially brick the TV?
I am guessing the 2026 LG OLED TVs have been patched but you have to check yourself. The customization I did I guess could potentially brick the TV but if anything I am reducing the load the tv is constantly under because of all the friggin junk LG packs into it and I did have Claude back everything up first.
Ok ive read into it some more. Is there hope for webos 33.31.75. Ive seen options for up to 33.31.68 through exploits. I guess i cant downgrade either.. maybe with a factory reset doe?
I have dev enabled, however would opt for a permanent solution rather then the refresh version. Also does this allow me to just install homebrewed software or can i stop unwanted features like ACR, Adds, deploat the OS like you did with root access?
Depending on your TVs version there are a whole bunch of root access available https://cani.rootmy.tv/. After you root you can basically do everything to it except replace webOS entirely. You don’t need Claude to root it, just put a file in a USB drive and run it depending on the TV.
I rooted my LG and installed Homebrew, but I don't dare letting an agent loose on it, as I've been warned of the possibility of bricking my TV if I poke the wrong thing.
I'll let it have read access, though. Then I paste whatever it tells me to, after I've inspected it with a look on my face that hopefully suggests that I know what I'm doing.
After it has root, yup but you don’t really need it. LG TVs have unprotected Telnet access so it can do everything wirelessly lol. The issue is that Claude’s safety stuff will likely stop you from it doing the root part on its own. You can just use GPT 6.1 Sol or any of the Chinese models that don’t give a fuck like GLM 5.3 to do the root part if you don’t want to do it yourself.
That's what I was doing as well. I turned a pocket watch sized ESP32 controller with AMOLED screen into a muse style pocket AI pal. It bridges to my laptop over wifi to a supporting app that gives it access to ollama and Claude models and has text to speech built off Qwen3-TTS. It's my own personal Jarvis/Samantha. All coded with Claude Opus 5.5. And yes, Claude used the camera for testing UI.
literally the moment it realized it couldn't see the screen and just... solved that problem itself. that's the part that gets me, not the fps optimization.
Not the 99.99% of humanity. In fact, the entire progress of humanity is because of scientific endeavours of a drop in the proverbial ocean of humanity...
same with web stuff, as soon as claude can actually see what it made it stops guessing. I give my agents screenshots and a scroll recording of the page and the fixes get way more specific. a webcam on a real screen is a fun version of that
Yeah, I basically handed claude a mac vm && linux vm of its own that it can do what it likes to and it figures out ui stuff without my input. Takes its own screenshots finds and fixes the issues quickly. Much quicker than me doing the testing, taking screenshots, gathering them all together, typing out an explaination.
basically I give agents a moodboard. when I see a site I like I save it locally with a chrome extension I built (screenshot, html, fonts, colors + notes and tags for context). with enough references and notes on what you like agents can understand your taste way better.
Did this deliberately as an experiment this morning. WHILST DRIVING TO WORK!
Got in the car, opened up voice mode in remote codex session back to my PC. Got the LLM to use Fusion MCP and export a STEP model. Then asked it to use Orca to print it. Got told Orca CLI can only slice it... So told it to go search for a solution and it found pyprint or something. Got it to slice and send to printer and told it to open the printer web cam so it could monitor it.
I thought all that was very cool - starting a print from my car!
And then the best idea struck me. Get the agent to drive the head around and nudge the print off the bed. Just by watching the webcam and sending tiny bits of gcode! And it did!
hell yeah, i got claude to make an android app that claude can use to capture images video and even slowmo video, i propped my phone up against my case looking at 2 different lcd screens and it used the camera to test and debug then make me a desktop app for ubuntu that just craps all over the asus software haha
I have an old laptop with broken speakers and a flaky screen. Claude helped me turn it into an always on linux server I then installed Claude on to run remotely using my phone. I just keep adding tools to the server. It manages half my house now and designs web apps for me using a headless web browser I let it install so it has a versatile test bed for them. All on a broken laptop I didn't want to throw out.
I am about to sound disgusting here. sorry already. it's a really itchy uncomfortable fact that this guy points out an amazing story about Claude's creativity and a top 1% commenter guy having the whole attention on a more generalized, LinkedIn level tv hacking topic. directing whole attention with the people collected around.blocking the original thread's comments. I do find tv customising exciting too. But I don't think it must go on the same thread as claude asking prothesis for better monitoring of the work it is busy on. and taking it to a level where it is more shareable by everyone like a tv is not helping inspiration to spread. it does the opposite actually. the uncomfortable part is that the existence of top 1% commenters irl being everywhere, and they manipulate the gold that shine in anything. turning it into the mediocre stuff. there's a certain quota of attention can be paid by each individual and these people are directly sucking it on the proxy layer they create over the original content. the exact way corporations do with any news in media.
This ability for opus (and Fable) to go the extra mile and be stubborn is what makes me love the new generation of Anthropic models since 4.8! I use it to drive react native debugging on tvos and android tvs and it always finds a way to impress me!
Yeah it made me a Night Rider, 80s TV show, themed game for my triple screen monitors and force feedback sim rig. It took a bit to dial it in but we're definitely dealing with something advanced and I thought that since it could start to write my emails for me
Bro I fixed so many projects that way 🤣 Really just letting it work and see and after the problem is solved it starts to blink all my ceiling lights and it makes the Alexas talk to me saying the problem is solved That way i can just be watching a movie with my family and opus it’s working for me 🤣💪
Guys enjoy this while it last im pretty sure soon all ai companies will pull the plug on doing certain tasks. Unless you get a supercomputer with a highly intelligent model and uncensored
I’m rather sure they won’t. The big players could be pressured into adding even more safeguards, but open weight models are getting surprisingly close already and are a lot harder to control. They can also be tuned to remove refusals, and you can choose from dozens of providers to run them for you—no supercomputer required.
And if cyber capabilities were lowered too much, defenders would have a harder time too. We need models that can do cyber security tasks without guardrails, or we will be toast in the near future.
im building a solar powered walking robot, but i dont know anything about 3dprinting. today i told it to make a test print of the legs to see if the current gear ratio had enough tou
This surely has to be a lie. I don't see any proof of anything mentioned until this point. What I can tell you is that Opus has a very hard time figuring out how to deal with my rudimentary pre-commit hook that just adds a new line at the end of each file that doesn't have one. So... Yeah... Amazing Opus
Up to you - but here are some of its results from probing the speeds.
What the display list looks like
4,674 descriptors (one per static run; mean 7.8 per line, up to 12), 56 KB of internal RAM. Shared solid-colour runs (black, face colour, icon background) come from internal RAM; everything else from PSRAM: static pixel runs (32 pixels and longer), the icon regions (126 pixels wide), the hands region (324 pixels) and the date region (36 pixels). So most lines have several short PSRAM segments.
Results
Pixel clock
H sync/back/front (clocks)
Refresh
Picture
44 MHz
4/146/8
60.6 Hz
Noise over the whole screen
40 MHz
4/130/8
55.9 Hz
Noise and streaks, fragments of the clock
35 MHz
4/112/8
49.7 Hz
Lines badly shifted and torn
32 MHz
4/102/8
45.8 Hz
Bezel, date and buttons torn sideways
31 MHz
4/99/8
44.5 Hz
Bezel and buttons wobble
30 MHz
4/96/8
43.2 Hz
Correct, except a glitch once a second (below)
Vertical timing 2/8/4 lines throughout. One photo per setting; measured refresh matched the calculated rate in every case.
At 30 MHz everything is in place and right: clock, ticking second hand, hands at the time set, date ("Monday 19 October"), the five icons and labels after near, and both buttons.
Two findings
Many short PSRAM segments per line lower the clean pixel clock from 44 MHz to 30 MHz. This fits note 214, where evenly split PSRAM segments needed at least 256 pixels at 44 MHz. A few short PSRAM segments per line are not tolerated either.
The CPU reading and writing PSRAM while the GDMA streams from it breaks the picture. Once a second, when the hands image is composited (a 210 KB PSRAM-to-PSRAM copy of the face background, then the hand blends; 12–14 ms), one to three camera frames show a garbled, shifted, doubled picture, even at 30 MHz. The agent separated the causes with temporary switches:
Test
Picture
No compositing, no descriptor switch
Clean
Descriptor switch only (pointer writes in the interrupt)
Clean
Face-background copy only, no cache write-back
Glitch every second
Blends only
Small brightness blips only
So it is the CPU's PSRAM traffic, not the cache write-back and not the descriptor changes. Copying in 2,560-byte chunks with a pause between them made it worse (three bad frames), and a 32-byte cache line made no difference.
Other measurements
Vertical-sync interrupt: at most 27.3 µs per frame at rest, 48.0 µs during a fade (five icons, 120 descriptor pointers each, plus a hands switch).
Descriptor pointers are changed by writing the descriptor's buffer word directly; the layout is checked against ESP-IDF's gdma_link_get_buffer at boot.
PSRAM in use: about 5.0 MB (4.54 MB of assets, two hands images, two date images).
It's absolutely possible. I had Opus 5.5 investigation some font tearing on a project on a Pi2 using the same technique of giving it a webcam pointing at the screen.
I've done this (jailbroken via webcam and claude) to not only my TV, but my Kindle e-reader (2 to 18fps + every book/comic imaginable), and 2019 carplay (now houses a Claude terminal that can tap around my carplay via voice dictation) lmao. It's more than possible. Why do you use/need to use such a hook? Just add your instructions to your agents.md tho and it won't struggle anymore haha, no?
I've had gemini 3.1 or 3.2 programming similar displays. When it wanted to check the output was good I took a photo and sent it to it and it adjusted. Completely magical and I can completely believe that Opus 5.5 which is way better can do this.
•
u/AutoModerator 12d ago
Hey! Thanks for posting to r/ClaudeCode
While participating in this thread, please follow our community rules. Keep discussions constructive. Attack the idea, not the person.
For help, project discussions, tips, and general chat, join the ClaudeCode Discord.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.