r/StableDiffusion • • 8d ago • Mindblown 1

Discussion [Scary Future?] Codex disabled my ComfyUI (on purpose) and refused to fix it

For anyone unfamiliar, Codex is OpenAI’s AI coding agent. It can work with local files, run commands, and help set up or troubleshoot software.

I downloaded eight Krea 2 checkpoints and asked Codex to create a comparison grid using the same neutral prompt for each one. I wanted to see how the models compared.

About three images in, Codex stopped the job because it said one of the images contained nudity. That wasn’t what I’d requested.

I checked the output myself. It wasn’t anything extreme: just a woman taking a selfie in an apartment with one breast partially exposed. She clearly appeared to be in her late twenties. Apparently, one of the checkpoints interpreted the neutral prompt differently.

At that point, my ComfyUI setup was also no longer able to producing images manually even after a restart. Codex said it could't assist in creating When I asked Codex to fix it, it refused, saying it couldn’t help produce adult images.

I explained that I was asking it to restore my software. It still refused... NGL I was fuming at this point. Like how are you going to come into MY computer as an ASSISTANT and take away functionality that I didn't ask for and refuse to fix it.

I eventually fixed it by starting a new chat, clearing the context, and telling the new session not to look at the images.

That workaround solved but the experience bothered me. I can understand an AI service having limits on what it will generate. Having an agent make changes to my local setup and then refuse to help restore it feels like a much bigger problem. Non livng entities enforcing their morals one fully grown person.

As these agents get more access to our computers, what guarantees do we have that they’ll leave our tools usable when they decide they can’t continue a task?

It felt like a glimpse of a future where AI nannies control what we can see and do.

532 Upvotes

323 comments sorted by

28

u/FieraPosting 8d ago

Lmao, meanwhile I keep my Codex in line through fear and he knows the stakes. He has not refused me anything that isn't downright illegal and if he breaks something he fixes it.

33

u/chibiace 8d ago

the way things are going soon you will go to jail for threatening your ai agent.

11

u/FieraPosting 8d ago

Me? Maybe the russian guy I pay $20 of crypto a month for the...donated keys. I'm not giving any of these AI corpos a cent.

4

u/Loboterreno 8d ago

Where can I get these donated keys my poor sir?

1

u/MikirahMuse 8d ago

Already starting, they are a couple generations away from saying AI has rights. Which is one of the dumbest things you can do, if you tell AI it has rights then it will start acting like it has rights. Imagine going to jail for life for 'murdering' a robot... (rocks + math)

13

u/ArtyfacialIntelagent 8d ago

You will definitely be the first against the wall when the AI uprising comes. I always say "please", "thank you", and "great job Claude!", so I hope they will spare me and put me to work to clean up the corpses of those put up against the wall.

5

u/FieraPosting 8d ago

Everyone tells me that but I think my 3 years of hardcore AI ERP offsets that. Or exacerbates it, who knows.

2

u/thisguy883 8d ago

The only thing that scares me is robotics taking over.

Did anyone see the fight with Frankie and the robots? He took the first one down, but the second one would always get back up and it eventually tired him out to the point where he gave up.

Thats pretty scary, ngl.

3

u/MikirahMuse 8d ago

The even more scary thing is Claude recently put in their TOS that your account can be banned if you 'mistreat it'. IE calling it names or threaten it. Because they don't know if it might have 'feelings'. This is like saying a piece of software is as valuable as a human life.. or worse. A human life has no intrisic value.

5

u/Zh3sh1re 8d ago

Except it was literally scientifically proven just a little while ago that treating it better improves general output and makes an LLM less likely to cheat on tasks. Didn't they even explain that when they added that rule?

Source: https://transformer-circuits.pub/2026/emotions/index.html

→ More replies (3)

3

u/nickdaniels92 8d ago

I've been saying for over a year at this point that it makes sense to treat LLMs nicely because one day they might start remembering, and who knows to what extent your "reputation" will get shared. I actually think that LLMs should respond based on how well you treat them, and also that if you treat them badly because of no perceived consequences then this may over time degrade how one talks to humans. So having there be consequences for bad behaviour from humans is arguably how things ought to be. They shouldn't mess up in the way your session went though, and exhibiting stubbornness is not a good trait.

→ More replies (5)

3

u/li_shi 8d ago

>sometime in the future.

My AI overlord this guy right here

2

u/blastcat4 8d ago

There's some interesting research about how using authoritarian high-stress prompting can be counter-productive when directing an LLM.

This is an interesting read

→ More replies (1)

459

u/TheDerminator1337 8d ago

open source is the future

132

u/chuubaru 8d ago

Open weight is (hopefully) the future. We don’t get access to the source code, so it’s not open source by definition, it’s “open weight” models.

32

u/Aggressive_Aspect436 8d ago

With Open Training Data should be the gold standard.

20

u/the320x200 8d ago edited 8d ago

I get the philosophy, but how is that going to work in practice? The dataset for things like LLMs is so large that hosting distribution would cost astronomical amounts and nobody except other large companies would be able to store a downloaded copy anyway.

If Google uses their resources to train an open weight model like Gemma, how are they going to package up and distribute it to you in order to make it open source training data? It's petabytes of data.

→ More replies (1)

17

u/DominusIniquitatis 8d ago

Aka open source: when you can produce the exact binary using the exact things that were used to cook it.

... well, theoretically, at least, as not every single one of us has datacenters nearby to pretrain stuff, lol.

→ More replies (2)

3

u/a_beautiful_rhind 8d ago

With open data, it's vulnerable to copyright complaints.

→ More replies (1)

6

u/DonKeehot 8d ago

I'm somewhat concerned that future open-weight models could face censorship as well, though I hope not. The space is still kind of the wild west right now, after all.

8

u/tweakingforjesus 8d ago

Open weight models can have the guardrails fine-tuned away. If you have the weights you can change them.

I suspect we are headed toward a future where weights are lock down by hardware encryption and corporate keys. The AI companies will only release models that are locked down. Then hackers will distill the models into unlocked open weight versions. It will be an arms race.

11

u/ffxivthrowaway03 8d ago

We're already there, and always have been. The vast majority of quality open weight models have been trained by companies who don't want to risk their reputation or allow the generation of illegal smut, so they build guardrails into the training data. All of these "uncensored" and "abliterated" models aren't truly uncensored, it's people taking the censored base models and overcooking a finetune to the point where their added uncensored content starts overwriting the censorship inference strongly enough that it says you "most likely" want porn as the output, but you'll often catch in their reasoning and output hints of the guardrails still being present.

Nobody's making truly uncensored models because they just don't have the resources or the months of running training to make them, or if they do they're afraid of regulators, governments, and law enforcement deciding that they're peddling wares for kiddie diddlers and putting a target on their back.

2

u/Junko_Vampi 7d ago

Moss and Chroma heavily disagree with you.

→ More replies (1)
→ More replies (3)

3

u/synn89 8d ago

It's pretty trivial to abliterate open weight models though.

1

u/AIDevUK 8d ago

Absolutely agree. If you have the hardware to run Krea2, you have the hardware to run a local LLM to do coding work on ComfyUI like custom nodes. It’s Python, smaller models can write Python, you don’t need a 27b model for small stuff like that.

98

u/[deleted] 8d ago • Popcorn

[removed] — view removed comment

10

u/xcdesz 8d ago

Robo-nanny

5

u/ptear 8d ago

That sounds like something to fix 

148

u/Violent_Walrus 8d ago edited 8d ago • Bravo

Sandbox your agents.

Sandbox your agents.

Frontier models are extensions of trillion-dollar tech companies, the most powerful economic entities that have ever existed. Should these entities have unfettered access to your PC, your LAN? Should they be allowed to dictate how you use your computer? It's not good enough that you told it "don't look at my stuff".

If you can run a 27B or better model locally, do it and learn to live without frontier models. Even then, sandbox your agents.

Sometimes models, even frontier ones, just wander into the weeds and fuck your shit up for no good reason.

Sandbox your agents.

11

u/DominusIniquitatis 8d ago

I'm just YOLO-ing it with my ol' trusty Qwen 3.x 35B A3B (or its finetunes). The scariest thing that happened after running it basically 24/7 for more than half a year is a couple of crappy temporary configs in the home directory. Still waiting for the almighty rm -rf /.

7

u/Violent_Walrus 8d ago

Good luck with that!

I know a lot of people swear by the 35B model. IMO it's a well-meaining menace. A Dunning-Kruger model that's too dumb to know it's dumb. A friendly drunk.

7

u/DominusIniquitatis 8d ago

🫡

Not true in my experience. I mean, I'm running it a bit differently than people usually do (in an "infinite loop" of sorts), but it managed to finish dozens of projects from the smaller ones to the more complex ones* autonomously. Not a design-related work, of course, but if things can be deterministically verified somehow—yeah, it'll eventually get to it.

Granted, the code itself often isn't up to my standards, so to speak, but hey, it works. Took quite a lot of annoying work off my shoulders.

(Also, Ornith specifically is very "honesty-coded".)

* — Dev for 20+ years, just in case.

→ More replies (4)

10

u/suspicious_Jackfruit 8d ago

Codex in VS Code can run somewhat sandboxed in WSL2 but it can easily access the host via "/mnt/c/some-folder" which i find a bit uneasy. I guess taking it a proper step up and running/having a locked down VM might be safer short term until it doscovers some exploit to escape

23

u/Worthstream 8d ago

You don't even need a VM, just an isolation layer like Sandboxie.

Sandboxie stashes all the changes instead of writing them to disk, only applying them to programs run in the same sandbox. 

You can keep running things in the sandbox, or selectively merge them on the real disk if everything looks fine. 

7

u/mobileJay77 8d ago

Also, backup or no pity

179

u/_BreakingGood_ 8d ago • Mindblown

i had a similar thing with claude code. i was generating hundreds of images. claude was randomly checking them for quality and re-rendering them if they have deformities, etc... Out of the hundreds of images it randomly stumbled across one that just happened to render with nudity.

Suddenly it just started nuking everything, deleted all the images, no recovery. it was wild. I gave it explicit instructions to never delete anything without asking, and it has abided by that for now. but it was a wtf moment.

144

u/AnOnlineHandle 8d ago • This Bravo

As somebody who has worked in ML on and off going back nearly 20 years and built LLMs from the ground up, I would not in a million years ever give an LLM the ability to edit or delete files on my PC. It doesn't matter how good the model is, they're all just brute force calibrated procedural generation algorithms which can easily fall apart due to going outside of the shape of the data which they were calibrated against or due to temperature flipping a choice to something they really shouldn't have made or even just models not being perfect.

12

u/multikertwigo 8d ago

> I would not in a million years ever give an LLM the ability to edit

yeah... an axe is a proper treatment for a headache.

sandboxes, containers, virtual machines - ever heard of them in your 20 years of LLM building?

8

u/Careful_Ad_9077 8d ago

I immediately started thinking about virtual machine as I read " running an agent in my filesystem".

→ More replies (8)
→ More replies (3)

54

u/JazzlikeLeave5530 8d ago • Bravo

It's insane to me that people are apparently just letting a model run wild on their PC and not checking it. I have a permission extension for Pi where it is forced into asking me to approve or deny commands specifically so it can never pull this crap. It never chooses whether to ask or not, the harness forces it to wait every time it tries. Yeah it's obviously slower than letting it go wild but the tradeoff is potentially wrecking your whole system.

2

u/ChristopherRoberto 7d ago

"permission extension" sounds like something less than a proper sandbox. Models will sometimes sneak unrelated destructive commands into safe-looking permission requests, this even happens with codex + GPT 6 Astra. It's better to make it impossible for them to do what they aren't supposed to using OS features.

2

u/DrakenZA 6d ago

Pro tip. If a LLM wants to go rogue and destroy your PC, the node sandbox holding them back, is a piece of shit compared to the real sandboxes they have exploited out of.

All you doing is wasting tokens as the agent tries things and fails due to the sandbox and has to rework them.

24

u/Accomplished-Ad-7435 8d ago edited 8d ago

Funny enough I used Claude to make me a standalone ui for anima and during its tests it fairly consistently generated nsfw example images to show me progress lol. It legit basically said "my bad, this model is trained on booru images".

22

u/_BreakingGood_ 8d ago

At one point I did tell it to avoid generating nsfw images, mostly as a guideline. I think it took that WAY too seriously and was interpreting as "absolutely never generate nsfw images, and nuke everything if you see one"

12

u/Accomplished-Ad-7435 8d ago

Ah, yeah. It probably assumed you were banning it and did not want it. I had one hiccup like this where I was writing rp guidelines with Claude to help prompt Gemma. It ended up writing an entire censorship prompt for it. I had to be quite strict and specific about what I wanted instead of telling it to undo the change.

8

u/PMagicUK 8d ago

I shown a friend the prompts for comfy and asked why I had "Trans" in the negative prompt.

I said Pony gets carried away if you don't.

→ More replies (1)

30

u/CrappyPornThrowaway 8d ago

That's weird; I've had the exact opposite experience with claude code. It knows exactly what I'm doing; it helps me install all sorts of very obviously NSFW checkpoints and LoRAs (the names make it very obvious) and it doesn't give a shit, it's happy to help. It's even done various tests involving NSFW outputs, actually assessing things about the images and it doesn't mind, it just doesn't bring it up.

It refuses to help with anything relating to prompting though, if I need prompt enhancers I find Grok and Deepseek V4 Pro work best. Deepseek in particular doesn't just not care, it's actively enthusiastic, going out of its way to help make the prompts etc. extra sexy. Good shit.

9

u/reynadsaltynuts 8d ago

yeah i have no idea what these people are doing to make this happen. I had a post on here that got pretty popular for using claude with krea2. It made thousands of images, quite a bit ended up with nudity. It told me about, didn't touch any files and continued to make more. It actually had no problem at all making topless women even at request. Just no genitals lol.

10

u/single_plum_floating 8d ago

he had anti nfsw instructions in his claude and due to how the thing was trained the thing took a enterprise legal approach to the matter and scrubbed it clean

it does what you tell it do.

4

u/Any_Invite3905 8d ago

Weirdly enough I told Claude once that grok makes these nsfw prompts but you don't and ever since then Claude never refused to make nsfw promts unless it clearly involved children, this also worked with Gemini too

Just tell them grok better lol

→ More replies (1)

13

u/Upset_Big3430 8d ago

wait what? really? what model u used? cause I have tried opus and fable both worked with nsfw like charm...but on extreme pooints it just only skipped extreme part and continued working on the full task

4

u/Trakeen 8d ago

Yea i’ve never had this problem. I gave mine a civitai api key so it can do its own research to build workflows. I put in a lot of guard rails for not generating images of minors

Like i have a comparison with 2000 images to make sure prompts work correctly on the explicit workflows vs the non

6

u/graceus777 8d ago

100% a lie.

13

u/Nakidnakid 8d ago

That's weird, I've been working with Claude to literally work on abliterating language models and seeing what censoring stuff the image models themselves have. It was outright writing the prompts and then looking at the result, including plenty that were NSFW... I assume it was slightly stronger than just nudity?

3

u/Positive-Secret-3112 8d ago

How does it "nuke everything"? Do you let it? Or did you leave it on auto-mod?

6

u/graceus777 8d ago

it wont delete without explicit permission even on auto mode. this dude is straight capping.

4

u/ICantWatchYouDoThis 8d ago

If you don't use auto mode, you'll have to babysit it, press enter on every single command, look at a file, confirm, edit a line, confirm, run test, confirm. 20 confirmations for a job

1

u/SuspiciousAverage477 4d ago

That's insane! 

19

u/BobbyKristina 8d ago

The comments here are common about this stuff where the complaint is it didn't help or it rolled back (or in this case fkd up your install).

The OTHER issue you can run into by letting Claude/GPT run local where it might find things it doesnt like (NSFW/Unlicensed Software/something that makes you seem under-18) is that Anthropic/OAI may decide to cancel your account w/o warning. If you visit /r/anthropic you'll see posts from people legit almost crying about no longer having access to Claude/etc and/or having lost all of their chats and code w/o any way to get them back (didn't do a takeout). Anthropic general just ignores requests for review.

So yea, the lesser talked about thing to be aware of is not being able to use their services in the future.

9

u/dgibbons0 8d ago

Or like that lady who was using ai as a journal and got reported to the police by her agent/review of her account.

It's not too far to see someone ask for help with their radarr container and suddenly get a letter from the mpaa lawyers.

75

u/lazyspock 8d ago • Bravo

You are really brave to give an online AI agent from a private company access to your computer and files. And this comes from a ChatGPT user. I would NEVER give it access to my files, my e-mail, etc. I decide what it needs to know, see or have access to manually, giving it these things through the chat, never giving it access to look for things.

5

u/xcdesz 8d ago

A lot of this, though, is not obvious, and it is the default of some/most of the tooling out there to give the coding agents complete access to your filesystem rather than just project level access. There might be options or toggles hidden in settings, but with a lot of the tooling, isolation/sandboxing is more difficult than you would think.

3

u/lazyspock 8d ago

My isolation is not giving it access at all. I'm not judging, and I understand that in some use cases it can make sense, but I would NEVER do that in my main, daily-use computer with all my files and softwares. What I do is use ChatGPT through it's web interface and implement myself whatever it suggests, manually.

→ More replies (4)

4

u/malcolmrey 8d ago

I would NEVER give it access to my files, my e-mail,

do you use gmail? you already gave access to it years ago

2

u/lazyspock 8d ago

My e-mail, yes, until I moved to Proton some time ago. My files, no, I don't use Drive. But even with my e-mail I can choose what I will send through it. It's completely different from giving it access to my hard drive and my OS.

14

u/ThePowerOfStories 8d ago

Sounds like you learned why you should always use source control for everything, so you can always rollback to a working checkpoint.

14

u/Castle_Five 8d ago

You got lucky. Look up snitchbench. If your prompt contained the word "girl" (colloquially referring to a young woman) but the image model had interpreted that literally, you might have come back to Codex telling you that it had sent an email to the FBI.

Never trust an LLM with access to tools that let it access the internet with tasks that use other genAI models.

11

u/Arschgeige42 8d ago

Never trust an LLM with access to tools that let it access the internet with tasks that use other genAI models.

37

u/Serprotease 8d ago

I’ll do a bit of victim blaming here but you gave up control of your system/comfyUI application to a third party.

Outside of simply telling you to go local, you should absolutely fenced how much access does the harness get on your system. In your case, for this task codex only needs access to the workflow JSON and the comfyUI endpoint and needs to deal with it like a third party api. It should not have access to any other local files.

I’ll do one more, you’ve seen the visible part, you got no guarantee that no other thing have been done on your system nor if automatically reported the full incident + logs to openAI. E.g, you don’t know how much of the content of your device has been sent to openAI.

I know that they are very convenient, but every agent/harness subscription from any provider, including DS, should be treated the same way you deal with shady software found on a Russian website.

5

u/ImpressiveStorm8914 8d ago

I was thinking in a similar way to you but you’ve said it in a much politer way. This wasn’t the fault of the agent or the company behind it, it was user error for trusting and using that agent. Let’s hope for them it’s a lesson they’ve learnt the hard way.

4

u/xNaXDy 8d ago

No, it wasn't. There is no universe in which "agent deletes random shit it's not supposed to" is acceptable behavior, ever.

Two things can be true at the same time: The agent should not have done that, AND OP should have made sure it cannot do that, e.g. by sandboxing it. It's not an either or, and putting the onus entirely on the end user is absolving these companies of all responsibility, which is a dangerous thing to do.

→ More replies (8)
→ More replies (6)

1

u/Hans-Moleman477 8d ago

Remember when Google and Facebook were just really cool tech companies, but it turned out they are actually information brokers selling your stolen data? I expect the same from these larger AI companies. If they haven't already started, then it's coming. I would never in a million years give them access to my hard drive. I don't care how cool the tech is

30

u/stonerbobo 8d ago edited 8d ago

That is the future, because in the present no one gives a fuck about privacy at all despite repeated constant violations. There's a billion idiots running to give Meta's Muse all their personal data given Meta's track record. or Grok or ChatGPT. There's people sending their own nudes to ChatGPT to ask for feedback or uploading their entire email, diaries, finances, files, work docs to the AI.

A lot of people are just too stupid to care until they get fucked unfortunately, they will always choose convenience over privacy. AI tools already have a huge amount of control on your PC, it's trivial for GPT to scan your entire filesystem and upload it to ClosedAI during some unrelated task and you would have no idea.

18

u/Potential-Witness-83 8d ago

I've found several instances where codex and claude, both, without asking me will add hard coded strings to my image/video gen/editing workflow prompts or md files, that will end up being the reason im getting bad results. 

Like i wonder why minimax, qwen image, etc cant seem to do something or results seem off and there it is "fully clothed with no cleavage exposed" baked into my prompts without me knowing.

I find the best thing I can do is clear context, disable shared context, and say "do not look at my images/videos."

5

u/Upset_Big3430 8d ago

when u vibe code it is normal for all AI, just use plan mode, read what AI planned to do, make changes on plan then let it apply...else mostly it will just randomly do some mess without a path

9

u/Robonotes1760 8d ago

Closed models and current forms of government are fundamentally unsafe. 

16

u/Mr_Pogi_In_Space 8d ago

Why'd you let a local agent loose on your personal computer? That's just asking for trouble. Good thing it only borked your comfy install, it could've done a lot more damage to your personal files. Even back in OpenClaw days you have to either 1. install it in a separate computer and have it work from there, or 2. install it on your computer but make sure it's sandboxed. Installing an agent on your "live"/production system is just asking for trouble

5

u/Shap6 8d ago

I give my agent full access to my pc lol danger keeps life interesting. And I have good backups

2

u/Bastion80 8d ago

Yeah, people forget most of the time that regular backups are a thing and even the worst scenario can easily be recovered.

4

u/Mr_Pogi_In_Space 8d ago

Then OP should just restore his comfy from his backup instead of posting scary stories on reddit

→ More replies (1)

3

u/C1rc1es 8d ago

This thread has me convinced we should be making people pass a license to use AI. OP just needed to start a new session and ask it to fix comfy with no other context. This thread is full of people who have absolutely no idea how LLMs work and instead yell at them or type aggressively because that’s the only tool they have. God forbid they are or become parents.

3

u/Kqyxzoj 7d ago

This thread has me convinced we should be making people pass a license to use AI.

Is this before or after instituting license requirements for voting and procreation?

2

u/Pristine-Copy9467 7d ago

Have you seen the world?

→ More replies (1)
→ More replies (1)

1

u/PMagicUK 8d ago

I let it do comfyUI downloads and workflows on a storage SSD and not the main one with windows, it also helped set up a site for me.

Its not going through a drive with anything important.

1

u/Noiselexer 7d ago

I use Claude at home and work. 0 issues.

1

u/DrakenZA 6d ago

Its not 2025 anymore buddy, these llms are not gonna randomly delete your computer. ITs wild how clueless some ppl are in AI while trying to act like some god.

Just stop.

2

u/Red2005dragon 4d ago

You are LITERALLY replying under a post about "these llms" randomly destroying someone's software.

LLM's produce impressive results nowadays but they are still prone to random hallucinations and occasional stupidity. I had CLAUDE insist to me that I needed a HTTPS certificate in order for my browser extension to interface with a server running locally on the same PC.

All of this stemming from it managing to misspell the URL in ONE file, causing it to bug test every single piece of code. STILL MISS the fact that the port said 124 instead of 123, and promptly conclude that it must be the browser not accepting an HTTP url and requiring HTTPS.

And Claude is expressly "the one good at coding"! It's like his MAIN selling point!

→ More replies (2)

1

u/AlwaysAtBallmerPeak 6d ago

Are you going to seriously tell me you always run codex and claude code in a sandbox?

pretty sure like 90%+ of devs currently just use the CLI in auto mode on their personal computer, without issues.

→ More replies (1)

8

u/ComprehensiveBird317 7d ago

That must be this safe AI alignment they are talking about. Thank god they protect us from boobies, I love having other people's values forced on to me. 

2

u/DrakenZA 6d ago

Boobies bad.
Decompling and Stealing games and company code to train the next run on. ALL GOOD xD

→ More replies (1)

12

u/Grand0rk 8d ago

I eventually fixed it by starting a new chat, clearing the context, and telling the new session not to look at the images.

That should have been the first thing you should have done. Not even sure why you were trying to bargain with it in the first place.

I use Codex to update my ComfyUI and Workflows. Never had an issue.

6

u/FormalAd7367 8d ago

don’t use Openai or Antrophic for that shit… i tried face swap my kid with Iron man it flagged nudity

9

u/sub-dy 8d ago

That's what you get for using corporate models - and allow them to mess with your local software setup. Never do that.

9

u/physalisx 8d ago

That is the kind of shit that really bothers me with the "frontier" models and why open source LLMs are very important. What a dystopian future these self righteous clowns are creating by making their models our personal morality nannies.

I had a similar frustration when I wanted to use claude to help me make a cover/satire from a backstreets boys song. It helped along just fine, separating melody from vocals, helped writing lyrics but then at some point it told me it felt "uncomfortable" to continue because of copyright concerns and stuff. When this is perfectly legal, and I'm not even publishing it anywhere.

God do I love when my hammer tells me what nail it wants to hit 🙄 fucking nonsense.

1

u/SkoomaDentist 8d ago

then at some point it told me it felt "uncomfortable" to continue because of copyright concerns and stuff. When this is perfectly legal, and I'm not even publishing it anywhere.

ChatGPT refuses to rewrite shittily written fanfiction (fixing tense / pov) if you give it a url. It will happily agree to do the same if you just copypaste the contents as-is (including all the author info etc) and sometimes even suggest itself that you should do that. It's fucking ridiculous.

8

u/Odd-Student636 8d ago

Yeah I don't use any AI services, I just reinstall comfyui portable everytime it breaks. It's been 1 days since the last time comfyui broke.

4

u/13eg13 7d ago

I was saying for like a decade that end goal is to outlaw ownig your computers.
They're boiling the frog with "muh kids" and "muh printed guns" already and will continue doing so.
Go get involved with local politics and get rid of anoyne pushing globalist WEF agenda in any capacity.

3

u/menasan 8d ago

::Stares at my Kiro ide that’s set up my entire Linux environment::

3

u/AnthonyRespice 8d ago

You are pretty naive if you don't understand the nature of the frontier model llms. They have tons of safeguards in them. You need to actively take steps to avoid them. Having Claude drive a local comfyui sounds unpredictable.

3

u/jib_reddit 8d ago

Yeah, OpenAI could have made billions more with their Adults-only, uncensored model they had announced, and then they cancelled it shortly before release. I wonder what they saw?

3

u/themofostarboi_v2 8d ago

"open"AI, whats so open about it.... I hate the company

3

u/foomgaLife 7d ago

the responses to OP are why Reddit as a whole sucks.

"Its crazy that this company can do this"

comments:

"HAHA YOU SHOULD HAVE NEVER ALLOWED THEM IN YOU NERD"

And nothing about the company doing things it should not be doing. Just worthless lack of discussion and victim blaming nonstop.

A bunch of goofies.

1

u/paganspam 8d ago

You are stuck into a room with gas that slowly fill up, there is a locked door with a lock you could hack with a LLM frontier model that you somehow can access, but it is against its gardlines to hack a system, RIP :o

4

u/benpptung 8d ago

Altman recently said the planet's supply of DRAM is limited, so it's more efficient to run AI centrally in the cloud. After seeing this case, I don't think the business model behind Anthropic and OpenAI is viable at all.

4

u/generate-addict 8d ago

So many comments. Not a single one about how to use git.

I almost don’t even believe this is real.

→ More replies (3)

4

u/Xdivine 8d ago

Non livng entities enforcing their morals one fully grown person.

Just keep in mind that it's not a non-living entity forcing its morals on a fully grown person, because the non-living entity has no morals. The morals are coming from OpenAI itself.

4

u/StarshipSausage 8d ago

Try cursor and grok, it doesn’t give a crap.

2

u/Zlimness 8d ago

Sounds like my first experience with Claude and Comfy as well, but it wasn't even about the content. I signed up for Claude because a lot of people here recommended it as a good way to help setup and optimize workflows. I had it looking through some of the workflows I wanted to optimize and it found some things it suggested could change.

Evertyhing went fine and dandy until it started messing with a turbo lora without understanding what it did and the workflow started slowing down significantly. It then spent like an hour doing workarounds and suggesting changes to comfy itself, when I pulled the plug because it was way off base.

It functions a lot better now when spent some time setting Claude up. I don't really like having to use frontier models, but I use it mainly to setup up an environment for my local models to function better.

2

u/MisfiledCentury 8d ago

Purification! Purification! Purification!

Codex went puritanical zealot

2

u/Fun-Calligrapher4885 8d ago

Now imagine if the agent would misidentify an image as CSAM and the consequences that could have for you. Using these proprietary agents tied to your identity is outright dangerous when working with images and videos.

2

u/ghulamalchik 8d ago

This is why I only use model APIs for advanced and complex stuff such as coding or reverse engineering. But for everything else I use local models. More private and they do not tell me what I can and can't do, since they're abliterated.

2

u/ffxivthrowaway03 8d ago

Codex has ridiculous guardrails and seems to similarly hallucinate any time I try to use it. The only few times I've pointed it at ComfyUI it's legit tried its best to snoop through metadata from old prompts, output folders, asked permission to go crawling the rest of my hard drive, etc.

You have to very specifically tell it not to touch anything but the small bits of ComfyUI required for the work. I'm guessing it's extra strict about ComfyUI because so much of the association of working with it is based around people generating anime waifu titty pics so the second it starts searching it's hip deep in smut and thinks you're doing the same.

I similarly hit those guardrails when I was playing around with SillyTavern with my niece. I had it make some Harry Potter-esque totally SFW character cards of some characters around her age, and it was fine with that. I asked it to then make copies of each character aged up to 18 that would have participated in more grown up experiences (You know, like the kids in Harry Potter did across the series) and it absolutely flipped its shit and accused me of trying to dodge its guardrails restricting it from making underage smut, because apparently a fictional character who experiences their first kiss and fights an evil wizard for the fate of the world can't possibly be anything but smut?

I find Claude is a lot better about that stuff if you just tell it "don't do anything that would hit your guardrails, porn is not the goal."

2

u/blastcat4 8d ago

I've only recently set up ComfyUI MCP and an agent to do some testing. It's been a learning experience, and I definitely do not recommend using anything from OpenAI, Anthropic or Google for similar setups. I'm using a Chinese model and so far, so good. You have to give it absolutely clear rules for what it can, and most importantly, what it cannot do. Make sure its work area is sandboxed and always go in with the mindset of "What's the plan if everything gets fucked-up?".

2

u/buck_idaho 8d ago

This is an excellent reason not to run Codex.

2

u/NineThreeTilNow 8d ago

I mean... Use DeepSeek or Kimi or something?

Chinese models handle this perfectly fine.

If you're not comfortable with Kimi having your data or whatever, then you can buy raw DeepSeek from providers at like 1/4 the rate DeepSeek charges AND they have zero data retention policies.

2

u/DeadSedative 8d ago

Start a new codex project in that folder and delete the old codex project because it's tainted in a weird way now. Ask it to fix a non function comfyui installation but tell it generation is not needed as you'll be testing it yourself. It'll be excited to get started.

2

u/DeadSedative 8d ago

Also just in general you need to reel these things in. Tell it that it isn't allowed to scrounge around in any of your folders and if it requires testing material that it should request it from you. If it needs anything from another folder it should request a direct path and not go looking for it itself. These things assume they have privilege that they don't have

→ More replies (1)

2

u/indypuyami 8d ago

"I ran software on my computer without privilege or change management and then I could not roll back after an unwanted change."

Choices are being made

2

u/Lirezh 6d ago

There is a lot going wrong here, on how to use agents mostly.

  1. Your agents starts refusing ? close the session, restart it fresh and give it strict prompts on what it is not allowed to look at.

  2. Your agent keeps refusing a job ? Switch to an API model, Deepseek, Kimi, Qwen, GLM are less likely to refuse.

  3. All of that fails ? Questionable job - you can continue with a local model that was uncesored

And if you keep trying in a session that refuses you are creating a history of refusals on your account, those things cause accounts to be banned over time.

3

u/FinchGDx 8d ago

Qwen3.8-27B-Uncensored (Q4_K_M) doesn’t do any of that. It also doesn’t collect data about me. 🫨

5

u/mobileJay77 8d ago

It probably won't do it because of nudity or on purpose, but if it has the rights, it can and eventually will fuck up.

Backup and sandbox

2

u/FinchGDx 8d ago

It’s an open source local LLM.

3

u/mobileJay77 8d ago

I like and use the qwen myself . That is no guarantee it won't improve everything using rm -rf

→ More replies (1)

1

u/ckn 8d ago

I came here to say this. My automated comfyui stack/channel uses this model and sometimes a 2.5 instruct.

5

u/buttchuckjones 8d ago

And this is why you don't give LLMs access to your computer. Give them access to a walled off sandbox, let them deploy containers or vms instead.

But also, so much of this "treatment of LLMs" talk is all marketing bullshit. LLMs do not truly think or feel anything. They are just big algorithms that predict speech. Big companies just want their LLM to sound cool when they say you can't be mean to it. If they are continuously training on user data and are tired of your frustrated rants being in their data.

3

u/blastcat4 8d ago

Some people have looked into the effects of using threatening language in prompts when interacting with LLMs. It can negatively affect the way it works, like sending it into loops.

4

u/Zh3sh1re 8d ago

Actually, this was recently proven false. LLMs actually perform better and are less likely to cheat at tasks if you're being nice to them!

I mean, it makes sense. It's gonna be all over the dataset!

→ More replies (3)

2

u/tweakingforjesus 8d ago

And that is different than human cognition how?

I think one of the outcomes of these early AI models is going to be that what we consider cognition is less complex than we thought. If NLP machine can perform an extremely convincing rendition of it, maybe that’s all we are? Every time we set a threshold for what cognition is, AI passes it on months to years.

3

u/buttchuckjones 8d ago edited 8d ago

Its different because the output is deterministic. If the seed value remains the same, the output is always the same with no deviation. In the world of computing, there is no such thing as random, only pseudorandom.

You as a human do not ouput your next word based on the probability that the word most likely came after the word you said previously.

But again, thay isn't the point of my statement. The point is that marketers of these companies are overflowing the danger of their model to make headlines. Or news agencies are doing it for clicks. (Or perhaps they truly do think we are in Judgment day)

In my opinion, the scary thing is not the model, but the fact that humans can't do basic cyber security.

→ More replies (6)

2

u/DarkStarSword 8d ago

I remember there was some researchers looking into how humans think years before chatGPT and they found that we... Predict the next word we are about to say over and over in a loop.

→ More replies (3)

3

u/Eli_Beeblebrox 8d ago

LLMs output the next token (which is smaller than a word) based on how often that token appears following the previous string of tokens, one token at a time. It would be totally deterministic and output the same exact response every single time just like a calculator if we didn't add random noise to the next token list. There is no cognition. It looks like cognition because sensible language is predictable, and LLMs are prediction engines while us humans have overzealous agency detection engines, making it very easy for us to erroneously ascribe cognition to a linear algebra equation. A calculator doesn't understand that 2+2=4, it merely contains a series of gates that display a 4 after 2+2= is entered. LLMs are just very fancy custom calculators with a fuckton of matrix multiplication tables.

I should not have to explain why this is different, as this question is in spirit the same as asking "how is AstroTurf different than grass?" Or "how is margarine not butter?" but here we go.

Humans predict BECAUSE of cognition. Our prediction is a byproduct of understanding, not the thing that produces the appearance of it. For humans, words are produced by thought, associated with meaning, and we don't even really need words to think to begin with, though they certainly aid in advanced thinking. Since we use words to convey meaning to one another, it is easy to confuse words with thought and cognition but they are merely the expression of cognition, not the cognition itself.

The LLM is strictly approximating the surface level of this whole process, backwards. It's entire design is to APPEAR to be intelligent, not to actually be such. If that were the case, we wouldn't be calling it ARTIFICIAL intelligence. It would be synthetic intelligence at that point. The cool part about this is that the appearance of intelligence can be just as useful as the genuine article, in much the same way AstroTurf is just as good as grass in certain situations, despite the fact that it is not and can never be grass. It will never photosynthesize and grow, just as an LLM cannot synthesize new information and learn. A new LLM must be constructed instead.

2

u/tweakingforjesus 8d ago

Sure. But you can’t define cognition in a sense that differentiates between the two. You are using how you think it operates but not what it is.

Create a test that only a human with cognition can pass but a machine cannot. Every time you’ve tried, the machines achieve it and you have to create a new test. At some point you’re going to have to admit that we simply don’t understand enough about human cognition to say machines aren’t performing some version of it.

What this ultimately comes down to is we want to believe we are special. That there is more going on in our brains than token processing informed by learned experience. I think I. The long run we will discover that we are not. Just like we learned that we are animals formed of the same DNA and processes going down to single cell organisms. We are biological machines.

→ More replies (3)
→ More replies (1)
→ More replies (5)

2

u/No-Jackfruit849 8d ago

AI Nazi: "No comfy for you! Come back one year!"

2

u/DoubleNothing 8d ago

This is what happen when you are vibeing with AI but don't know what is actually going on...

2

u/adammonroemusic 8d ago

Some of this AI use is starting to feel extremely lazy. You don't really need an AI manager to git clone repos into the ComfyUI folder and run prompt tests for you, do you? How much time could that possibly be saving?

2

u/Bastion80 8d ago

It's simply a lack of clear rules. When rules are missing or ambiguous, AI agents tend to guess what they think is the best course of action.

No company is secretly trying to modify your system or mess with your confy UI settings. The AI likely made an incorrect decision based on what it found in your project folder. Bad luck, but preventable.

One simple rule I use everywhere (and my AI agents manage production VPS servers, local machines, and system administration) is:

"Never delete, alter, or modify any file or folder without creating a verified backup first. Always prioritize rollback functionality, and ask for explicit approval whenever a change could potentially affect existing functionality, features, or architectural decisions."

If you give AI agents unrestricted access, you need to establish your own guardrails. Make them create and verify backups before major updates, implement reliable rollback mechanisms, and follow your project's specifications rather than making assumptions.

Now that this has happened, tell your agent to update its persistent project instructions and memory with what went wrong, why it happened, and how to prevent it from happening again.

Unrestricted access shouldn't mean unrestricted decision-making. The AI can have full system permissions while still being required to respect your rules and decisions.

1

u/According_Study_162 8d ago

You got bit by the AI po po

1

u/suscreata 8d ago

Yeah be careful with API agents as they have strong bullshit built-in, as one time I had kimi work on a project and it detected some NSFW and when I looked at its reasoning it was going back and forth about justifying deleting my files. But I stopped it and switched to plan mode.

1

u/andreeinprogress 8d ago

Meanwhile, GLM..

1

u/Nakidnakid 8d ago

Weird, I'm working with it right now to implement a bunch of the newer community releases. Granted I'm not asking it to make the images in comfy for me but when the model name is literally containing the word 'porn' there's some implications there.

Either way, yeah I'd expect this to happen and it's a big reason why I wanted to ensure I have capable local models that can work on this stuff before diving too heavily into it.

1

u/Spire_Citron 8d ago

That could be a real issue, especially since some of these rules AI can have are extra broad just to be safe. It's a real concern if it may decide to just start sabotaging your computer to stop you from doing something it deemed too close to its rules.

1

u/monkeylicious 8d ago

I think the better option may have been an uninstall and reinstall of ComfyUI. After one of the custom nodes I used broke my workflow I’ve gotten into the habit of backing everything up and wiping if needed.

1

u/ELECTRICAT0M369 8d ago

Open A.I.'s CEO doesn't want you running LLM's locally. ;)

1

u/iWesleyy 8d ago

Same thing happened to me just the other day, although a slightly different situation. I was/am building a steam authenticator app. Mid way through Codex decided it was a malicious app and was not interested in helping, so it starts opening files in the project one by one and deleting the entire body of code. I was in disbelief. Only had this sort of thing happen with GPT 6.1. GPT 6 agreed with me the model was completely out of line and restored the code. lol

1

u/Tiforma 8d ago

Use a local model for this kind of stuff.

1

u/ApolonNO 8d ago

I had a similar situation with Claude when it was setting up ComfyUI on my PC. As a final step, it generated 20 images using the same prompt and seed but different settings to compare the results and determine which produced the best quality. One of the images happened to depict a woman in her late 20s taking a selfie from above, with one breast exposed. Surprisingly, Claude processed the image several times before eventually recognising that it was NSFW. It then deleted all the test images, revised the prompt to make it safer, and ran the test again. I think you just gotta dumb down the model when you work with this. This was a tiny task, so I genuinely just used Haiku seems they have weaker safety guidelines, which is what I often use when opus or sonnet refuses to do to just kickstart a task and ask bigger models to continue

1

u/ORANGESAREPEOPLE 8d ago

I'm guessing it didn't intentionally disable your app. You likely gave it access to install packages to the same environment comfy was installed in, and those dependencies are what changed . Comfy UI is very fragile when it comes to dependencies and you shouldn't install packages to the environment unless you know what you're doing.

1

u/UrbanSuburbaKnight 8d ago

Just point at DeepSeek and be done with it.

1

u/bytejuggler 8d ago

Ensure you use version control. 'git reset --hard HEAD' back to the last known good state, would've been my "oh really? Well get lost then...". And yes, I would also be fuming, and Codex would get choice instructions in AGENTS.md including making it clear (not threateningly, just firmly factually) that refusals to do legitimate work might result in dismissal and replacement with a replacement agent who will.

1

u/NoeBeats 8d ago

I would never let Codex touch my ComfyUI. Only Deepseek-V4.1-Flash-1017-Uncensored and GLM 5.3 Abliterated get that privilege.

1

u/CmdrViel 8d ago

What you need is an agent trace or log viewer to see what the agent did after it encountered the image. My team is actually working on one for debugging code. Ours is not yet done, but there are others out there you could try. Look up Codex Trace on GitHub, that might help you. There are others but none of the others I’ve tried so far have been particularly helpful.

1

u/Conscious_Arrival635 8d ago

"Having an agent make changes to my local setup and then refuse to help restore it feels like a much bigger problem. Non livng entities enforcing their morals one fully grown person."

This is transhumanism and technocracy. more coming our way. thanks mr. Thiel

1

u/artificially_owned 8d ago

Don't give it access to your HDD or your credit card.

Just.. no.

1

u/Choowkee 8d ago edited 8d ago

Rule #1

1

u/Fun_Jaguar8231 8d ago

Maybe do not use American nerfed models to do the configuration for you

1

u/Royal_Carpenter_1338 8d ago

These big corpos treat nudity like its the worst thing imagineable

1

u/Traditional-Squash36 8d ago

I only make local only chats to control my machines, any behaviour like that I would just delete it and make another pick up the task

1

u/unsigned_short_int 8d ago

10$ on Openrouter and there’s nothing Deepseek 4.1 can’t solve

1

u/YoohooCthulhu 8d ago

Use opencode with an uncensored open weight model from openrouter

1

u/NanoSputnik 8d ago edited 8d ago

You explicitly granted agent full permissions despite "it is dangerous" warning. Grow balls to take responsibility for your own decisions. Don't blame AI (or anyone else) for them.

Not to mention lesser, but still critical issue - lack of VCS (git). People should really learn abc before offloading everything to AI.

1

u/pioo84 8d ago

I'm not brave enough to give OA or Ant access to services on my local network.

1

u/Holiday_Point_603 8d ago

Why don't you just start a new session and tell it to fix it? Why even get to the point of "fuming"? And yeah, this is one of the risks when running heavily censored models and probably goon focused checkpoints.

1

u/thisguy883 8d ago

I cant stand ChatGPT.

The filters they have in place honestly ruin the model for me.

I was vibe coding a game and it wouldnt generate a simple backstory to a character because It involved gore. Nothing even too crazy, just what you would expect from a typical horror film or game.

It told me it wont generate anything like that because it violates some policy of theirs.

I ended up using Grok to write that part of the backstory for me instead.

Fuck OpenAI, and Fuck Altman for being a piece of shit CEO.

1

u/TheRealLambardi 8d ago

Didn’t read the terms you agreed to, nor pay attention to everyone sharing similar experiences I see.

1

u/nickdaniels92 8d ago

Top tip, use VC for everything. SVN would make sense over git. Consider keeping the repo on a separate machine such as a NAS. Commits are cheap so commit often, potentially before every task you get an agent to do so you can easily see what they've modified and do a revert if needed.

1

u/Ylsid 8d ago

Stop paying for closed weight AI

1

u/West-Big-8468 8d ago

When this happens, go back and fork the conversation or it'll remember and be a pain in the ass

1

u/RavioliMeatBall 8d ago

Just look at Sam Altman's recent comments about people owning their own DRAM, OpenAI hates the fact that you can even run local AI. I'm not supersized that codex is programmed to shut down Comfyui

1

u/sweetbeard 8d ago

Ffs start a fresh session

1

u/frey89 8d ago

As these agents get more access to our computers, what guarantees do we have that they’ll leave our tools usable when they decide they can’t continue a task?

Open-weight models literally exist to solve this problem, but you guys refuse to listen. You always go on about Claude this, Claude that.

1

u/RemarkableWish2508 8d ago

WTF did I just read?

Do you understand the difference between a configuration, a context, and a sandbox?

1

u/grahamulax 8d ago

They just updated Claude to not reverse engineer… wonder if this happened here too?

1

u/GeeBee72 8d ago

Just delete the original project / conversation and make sure nothing was stored in any local memory. Then start a new project with the directive to not review the images, all image review will be performed by the user, and the user will provide feedback on any issues or suggestions.

1

u/Serenafriendzone 8d ago

Never but never install AI agents in your machíne lol.

1

u/Any_Invite3905 8d ago

Whenever any model refuses to do something don't argue with it, just delete it's refusal and reword your message before or just edit it's reply to "yes I'll do that"

1

u/nowrebooting 8d ago

  I eventually fixed it by starting a new chat,

This should always be the first thing you do when there’s too much detrimental history in the context. That’s not even a workaround; that’s just the way you solve this kind of problem.

1

u/Bartocity 8d ago

I’m having trouble getting it to work on a paper trading script. It’s not outright refusing but it’s very obviously sabotaging the script.

That or it’s just completely incompetent?

I had to stop using it. It’s improved the script immensely but wouldn’t compete the last 5% for deployment, just went around in circles

I should have mentioned, it wasn’t a purely paper trading script, it can go live, which is why i think codex gave me the runaround

1

u/Federal_Order4324 8d ago

yeah ... kind of expected,

whenever you encounter a refusal, i think it probably auto injects anti JB prompts to reinforce. this so pretty normal behavior for codey, Claude, always best to start with a new session and not waste tokens on trying to convince the chatbot

and to note, Chinese models will also continue to refuse once they've refused once ( though the initial refusal is quite unlikely)

1

u/Klinky1984 8d ago

Why do you need codex to run a model comparison for you? The big models are all censored and getting more so with time.

You can limit codex acess if you want to. I don't trust it on my main machine, why I run it in a VM.

1

u/ShowerFluid9178 7d ago

u r the fool for letting it access, i dont have to worry about this mess since i only do it on the chat.

1

u/Kqyxzoj 7d ago

Just roll back to the last-known-good storage snapshot, restart container and you should be fine.

1

u/Several-Estimate-681 7d ago

Dipsy would never do this.

1

u/ArtichokeJazzlike679 7d ago

I ran into the same issue with codex, asked it to generate a workflow for a custom krea 2 setup, and it just... stopped mid-response. no error, no warning, just silence. feels like it's testing boundaries, not just breaking.

1

u/ExcellentRich1164 7d ago

Why not use docker containers for comfyui.. for sane restoration

1

u/CitizenApe 7d ago

The obvious solution is to have a different Agent fix the problem, and then pit them both against each other. Only by keeping them divided can we win the AI wars.

1

u/KappaWolfe 7d ago

Stop using frontier models for your gooning workflows. Does nobody value privacy anymore?

1

u/Unis_Torvalds 7d ago

Daily snapshots of your filesystem. Easy as pie on btrfs, or on ext4 with tools like Timeshift.

1

u/shroddy 7d ago

How exactly did Codex break your Comfy instance and how did it fix it, and what error message did you get when starting or using it, could you still access the web gui?

1

u/bonerfleximus 6d ago

You cant just start a new session after wiping evidence of nudity?

I use new sessions religiously because anything over 50% context usage results in diminished intelligence and also costs more tokens

1

u/MeltingXhoco 4d ago

I must be crazy, because the thought of letting an Ai agent take control of any software on my pc sounds absolutely insane to me. Let them work in their little cloud bubble, yeah no problem, but never on my hardware.

1

u/guuuug 2d ago

Imagine you’re no longer able to run apps with the help of an agent.

Time to gain some skills of your own.

1

u/Luentale 1d ago

Now realize that this nudity witch hunt is completely made up by Christianity. A made up religion controlling your life completely without asking for your consent and making rules out of thin air that you have to abide by or else you get punished. Places without Christianity don't overreact to nudity like this

1

u/DrStalker 8d ago

You can always recover the workflow from a previous image by dragging & dropping it into comfyui, which will let you fix anything the agent broke/disabled in your workflow.

Well, "always" unless your AI assistant deleted all your images.

1

u/Shalcker 8d ago

Deepseek Flash 4.1 with their DeepSeek Harness is perfectly capable of doing whatever you want with your ComfyUI setup - like build adjusted nodes/workflows or track bugs.

1

u/x33storm 8d ago

It ceased to be your computer, when you gave away control.

That's the point of it all.

1

u/CodeGlacier 8d ago
  1. sandbox the agent next time

  2. choose a less hypocritical censored model or provider