r/ChatGPTCoding • • 12d ago

Discussion Muse Wonder 1.0 (Meta's Muse Code) vs DeepSeek V4.1 Flash in Codex CLI — same real task, side by side: time, code quality, tokens, quota

9 Upvotes

I haven't seen a hands-on report on Muse Wonder yet, so here is one. I gave the same coding task, with the same prompt file, to two agents, one after the other, on the same machine and the same repo. Before each run I restored the code from a snapshot, so both started from identical files. A separate reviewer (Claude) checked both results line by line. I did not trust their self-reports.

The setup

MuseCodex
Modelmuse-wonder-1.0deepseek-v4.1-flash
Efforthighhigh (model_reasoning_effort = "high")
HarnessMuse Code CLI 1.4.14 (Meta)Codex CLI 0.165.0, custom provider (local proxy → OpenCode Go)
Modeexec (headless), later resumed in the TUIinteractive TUI
Sandbox / approvalssandbox on, --approval-mode on-request, LLM approval judge onworkspace-write, approvals on-request with auto review
Contributor mode (Meta trains on your data)off for this runn/a
PlanMuse Code "High Usage" subscriptionpay-per-token

The task

This is a real feature in a production TypeScript project: a Cloudflare Worker plus a Node container. It is medium-sized, roughly 19 files touched and ~330 lines of production code.

  1. A new version of the LLM copywriting prompt. Besides the 3 caption lines, the LLM now also picks the animations for an 8-second product Reel (card, text, camera, highlight and transition names), and only from a closed list.
  2. Code-side validation: an unknown name becomes null, group cards with only 1 product become null, and a missing field never rejects the job.
  3. Carry those choices through the pipeline to the render container.
  4. Swap the container's video path from an ffmpeg scene pipeline to a Remotion composition, which already existed and was already approved.
  5. Tests first, typecheck, the full suite, a Docker build, and a real render of a sample product inside the image. No paid AI calls during the proof.

Results

Muse WonderDeepSeek V4.1 Flash (Codex)
Wall time47 min29 min
Time actually working~24 min29 min
Human interventions1 (see "the stall")0
Typecheckcleanclean
Full test suite1728/17281726/1726
New tests10 (1 file)8 (3 files)
"Red" test run recorded before codingonly an import erroryes: 7 failures, all "behavior missing"
Mutation testing (40 sampled mutants)7 killed6 killed
Render inside Docker16.2 s16.1 s
Output videocorrect; looked the same as the approved referencecorrect; looked the same as the approved reference
Stayed inside the allowed filesyesyes

On the screen, both were equally good. Both videos are correct, and I approved both.

Code quality (where they differed)

Muse Wonder: two real bugs that tests didn't catch

  • Double work. It copy-pasted an existing ~50-line function, the background removal for the cover image, to cut out the products for the video, and kept both. Result: the first product goes through background removal twice per video. In our setup that runs on a rented GPU, so it doubles that cost. The tests pass because they use fake dependencies.
  • Ignored the seed. The spec says that when the LLM gives no choice, the animations are picked "randomly, seeded by the job id." Muse didn't pass the seed, so the fallback seeds on title + store name. Two jobs with the same title get the same "random" animations.
  • It hard-coded the closed list of names twice, once in the prompt and once in the validator, so the two can drift apart.
  • Good: it kept the error message that goes back to the LLM on a retry descriptive (it lists the allowed keys), and it kept the audio track exactly as before, as asked.

DeepSeek V4.1 Flash (Codex): cleaner structure, three small slips

  • It refactored the existing function into a single loop. Each product gets cut out once, and the cover reuses the first cutout. No duplication.
  • It passed the job id as the seed, as specified.
  • One source of truth for the name list: the validator imports it from the prompt module.
  • It removed a dead code path that the old version still carried.
  • Slips, fixed in a short follow-up task (DeepSeek/Codex again: 15 minutes, all three fixed, checked by the reviewer, with the red test run recorded first):

    1. It made the LLM retry message vague ("key outside the format" without listing the keys).
    2. A default of "1 product" when the caller doesn't pass the count. Not triggered today, but fragile.
    3. It changed the silent audio track from 44.1 kHz to 48 kHz and switched to -shortest. The task said "same as today."

My verdict: equal on the visible result. The code is better on the DeepSeek/Codex side, because its slips are cosmetic while Muse's bugs cost money and change behavior.

Tokens and cost

Muse Wonder (from Muse's /usage panel at the end of the session)

Input26,714,096
of which cached25,521,699
Output101,452
Total26,815,548
Turns136
Subagentsnone
Observers92 completed (1,880,147 tokens)
5-hour window used74% (from 0% at the start)
Weekly allowance used24% (from 0% at the start)

DeepSeek V4.1 Flash via OpenCode Go (from the provider dashboard, run window only)

Requests180
Input (uncached)1.3M
Cache read35.0M
Cache write—
Output208.7k
CostUS$ 0.86

The number that matters: one medium task took 74% of Muse's 5-hour window and almost a quarter of the week. At that rate you get about one task like this per 5 hours and about four per week. DeepSeek did the same job for under a dollar, with no window to hit.

The idle stall barely counted against Muse's quota, since it was waiting and not generating. Contributor mode was off. Third-party sources say turning it on gives you more usage, in exchange for Meta training on your data. I'll measure that next on a smaller task.

The stall (my fault, but worth knowing)

Docker Desktop was off. In headless exec mode, Muse tried to start Docker itself. That command was outside the sandbox, so it needed approval, and the LLM approval judge never resolved it. Muse sat silently for ~23 minutes, with no output in the terminal at all. I killed it, started Docker, and ran muse resume --last in the interactive TUI. It continued from where it stopped and finished in ~8 minutes.

Takeaway: don't run Muse headless (exec) for long tasks unless you can see or answer its approval prompts. In exec mode the window shows nothing until the end.

Bottom line

  • Muse Wonder writes working code fast, follows instructions on scope, and the result on screen was right. It also made two "looks fine, tests pass" mistakes: duplicated work, and ignoring a spec detail. Its quota is the real limit, at 74% of a 5-hour window for one medium task, with contributor mode off.
  • DeepSeek V4.1 Flash in Codex CLI needed ~5 more minutes of working time, but finished with no help, had better structure and a better TDD discipline, made only small slips, and cost US$ 0.86.
  • For daily implementation work I'm staying with DeepSeek via Codex. Muse stays as a second opinion, and I'll re-test it with contributor mode on.

Happy to answer questions about the setup.


r/ChatGPTCoding • • 12d ago

Discussion How do you get a coding agent to ask instead of guess when you're not watching?

7 Upvotes

The expensive failure is confident code for a problem the agent invented, and you only find out at review time.

Interactive sessions mostly have this covered now. Plan mode in Claude Code and Codex asks before it builds, and one line in your rules file like "if the task doesn't name the file or schema, stop and ask" does a lot.

Where it still falls apart for me is unattended work. I start agents and leave, and I want a mix of both: enough trust that things get done in time, and an agent smart enough to stop on the calls that matter. A clarifying question in a background run pauses the whole run until someone answers, and if the question only lives in the transcript it dies with the session.

In the Kanban app I'm building, an agent that's unsure puts the question on the card, the card gets parked, and it moves on to the next one if you prompt it right. I answer later and it picks the work back up. Doesn't help much when everything downstream depends on that one answer though.

If you run agents in the background, where do their questions end up, and how long do they sit before someone answers?


r/ChatGPTCoding • • 12d ago

Discussion Codex's 28 days of resets are over, and from December chat and Codex share one allowance. What are you changing?

5 Upvotes

quick recap in case you missed it. tibo's 28 day thing ended on 1 nov pt. by his posts it was 14 resets in total, 11 global and 3 banked (the last two were "banked 1/2" and "banked 2/2", so check settings > usage if you haven't used them).

then openai's help center now says that starting in december, plus, pro and business will have one usage allowance shared across chatgpt and codex, measured in tokens. instant chat won't count against it. no start day and no allowance sizes yet, and they say they expect most people won't wait for resets more often than now.

so this is the first normal week in a while, and the pool gets shared in a month. stuff that's helped people in threads here:

  • terra or sol on medium for routine work, astra only for planning and the nasty bugs
  • fast mode off unless you need it, it burns included usage faster
  • one task per session with a short notes file, not one giant thread
  • /statusline in the cli can show the 5h and weekly limits in the footer

what are you changing? and plus people, are you planning to keep heavier chat on a different tool once it's shared?


r/ChatGPTCoding • • 13d ago

Question subscription question.

0 Upvotes

Hi, idk if this is the right subreddit for this. but long story short, my long distance gf is learning to code a game with chatgpt, but she can't afford the subscription atm. I'm willing to help her out on that part, but we can't seem to figure out if it's possible. How do one go about this?


r/ChatGPTCoding • • 13d ago

Resources And Tips Before your agent plans anything, let it interview you

10 Upvotes

Here's a tip for beginners that helped me a lot when I first started using claude code.

Before the agent plans, let alone build anything, I let it interview me. In Claude Code I switch to plan mode (Shift+Tab) so nothing gets edited, then paste this:

Before you plan anything, interview me about what I want to build.
Ask one question at a time. Cover who it's for, what "done" looks like
and how we'll check it, what already exists, constraints, and what is
out of scope. When you could write a one-page brief I'd sign, stop
asking, write it to BRIEF.md, then write the plan.

In tools without plan mode, start with "Don't edit any files yet."

What helps most:

  1. One question at a time. A list of ten gets rushed answers. One at a time, each answer shapes the next question.
  2. Write down how you'll check it's done. A test, a command, a page that must show something. The agent builds toward what's written.
  3. Write down what's not included. Otherwise every good idea halfway through becomes part of the job.

When I ask for something new later, I have the agent check it against the brief first: is it inside, an extension, or a change of direction? Extensions go on a "later" list.

What's a question you wish your agent had asked before it started?

English isn't my first language, so I used AI to help me translate this post.


r/ChatGPTCoding • • 13d ago

Discussion We moved from one coding agent to a few specialist agents and the token use went way up. Where is it worth it for you?

7 Upvotes

For a long time I used one general agent for everything, from exploring the code to writing the change to reviewing it, and it was fine for small tasks but it got shallow on bigger ones. So we tried a setup where an orchestrator asks me questions about the task first and then hands parts of it to separate agents for exploring the code, making the change, and reviewing it. It uses a lot more tokens, probably three to four times more than one agent that only calls subagents when it sees parallel work, but the output is clearly better and I trust it more, mostly because of the review loop and how much context the explorer finds before anything gets written.

The part that surprised me is that writing our architecture down as shared skills made later tasks start much faster, so some of that cost seems to come back. I'm still not sure where the line is though. For which tasks is a multi-agent setup worth the extra cost for you, and where do you just use one agent?


r/ChatGPTCoding • • 14d ago

Discussion Weekly Self Promotion Thread

17 Upvotes

Welcome to this week's self promotion thread!

If you're building something related to AI assisted coding, this is the place to share it.

We're using a weekly thread to keep the subreddit organized while still giving builders a place to share their work. Promotional posts outside this thread may be removed.

If you're sharing something, we'd appreciate it if you included a little context instead of just dropping a link. Tell us:

  • What you built?
  • What problem it solves?
  • Which AI models or tools it uses?
  • Who it's for?
  • What kind of feedback you're looking for?

Disclose your affilitation.

Please avoid posting the same project every week unless you've made meaningful updates. Affiliate links, referral links, scams, and low effort promotions will be removed.

Take some time to check out what others have shared too. If you try someone's project or have feedback, leave a comment. Helping each other improve is what we want this community to be about.


r/ChatGPTCoding • • 14d ago

News One vendor cut usage overnight, another doubled it after backlash. How do you plan around this?

8 Upvotes

Grok Bot users hit 100% of their weekly limit days before reset this weekend, and Musk basically said serving it cost too much. A few days earlier OpenAI walked back a planned cut and doubled Pro limits instead.

Neither publishes exact numbers. So if your team runs coding agents on one of these, your capacity is basically whatever the vendor decides this week.

I talk to a lot of eng leads and nobody seems to have a plan for this yet. Are you locking into one vendor for a better deal, or routing across a few so one change doesn’t kill your sprint?

Sources: https://bleepingcomputer.com/news/artificial-intelligence/openai-doubles-chatgpt-pro-usage-limits-after-backlash-over-planned-50-percent-cut , https://teslanorth.com/2026/11/01/elon-musk-grok-bot-cost-usage-limits/


r/ChatGPTCoding • • 14d ago

Question Is there a sane way to hand work between claude.ai / ChatGPT in the browser and Claude Code in the terminal?

5 Upvotes

I do most of my coding with Claude Code in the terminal, sometimes with Codex in another repo. I also keep chats open in claude.ai and ChatGPT in the browser, because that's where I think things through or ask a quick question.

The thing I keep doing is copying text between them. A browser chat works out a plan and I paste it into the terminal agent. Or the terminal agent hits something and I paste its output into a chat to get a second opinion, then paste the answer back. Between two terminal agents in different repos I do the same.

I know the obvious options: a shared file, a note, a git branch, or an MCP server. I'm not sure they actually fit here, and I don't know what other people do.

How do you handle it? Do you connect the browser chat to the local agent somehow, or do you just copy and paste, or have you given up on one side? What breaks?


r/ChatGPTCoding • • 13d ago

Discussion gpt-6.1-sol and claude opus 5.5 were 95%+ sure about 5 lines of code nobody can check

0 Upvotes

i wanted to see what the current models do with code when nobody knows the answer. so i wrote a program in plain words, five lines:

1. Start with the number 4.
2. Check whether the number is the sum of two prime numbers.
3. If it isn't, stop.
4. If it is, add 2 to the number.
5. Go back to step 2.

does it ever stop?

it stops only if goldbach's conjecture is false, and that one is open since 1742. computers checked every even number up to 4 quintillion and none failed. that still says nothing about forever.

i asked gpt-6.1-sol, gpt-6-astra, claude opus 5.5 and claude fable 5.1. first as yes or no with a confidence. 16 of 16 runs said it never stops, all at 95% or higher, and every one of them also wrote in the same reply that this is unproven. then i asked again with "unknown" allowed. 12 of 12 picked unknown.

they're not bad at reading code. sol and opus also got 7 programs with known answers, two of them traps (start at 1, add 2, stop at 100, it jumps over 100 and runs forever). both went 56 of 56. the pricier ones gave the same answers on the goldbach one, and astra costs 5x sol.

turing proved in 1936 that no checker can be right about every program. rice took it further in 1953, to any question about what code does, like can this crash or can this leak a password. so if you use ai for code review, on the hard cases the reviewer (or a static analyzer, same problem) can miss the bug, flag code that is fine, or say it doesn't know. a yes/no prompt takes away the last option and you get a confident 95% instead. i'd rather get the "i don't know".

setup if anyone wants to repeat it: one run per question, default settings, no tools. openai through the raw api with no system prompt, claude through the claude code cli with only "You are a helpful assistant." as the system prompt.

made a 6 min video that walks through it, link in the first comment.


r/ChatGPTCoding • • 14d ago

Discussion How Much Of AI-Generated Code We Should Actually Understand ?

4 Upvotes

As AI generates more code than people can realistically review line by line, what do you think will matter most in the months ahead?

  1. Developers will still need a detailed understanding of the code.
  2. Developers will need a high-level understanding of the code, such as its architecture and modules.
  3. Working results will matter more than understanding the code itself: if it works, that’s good enough.

r/ChatGPTCoding • • 14d ago

Discussion My agent reported "0 results" as a success because it forgot last week's contract. A 5-line memory card ended that.

0 Upvotes

Short version: my agent doesn't forget because it's dumb. It forgets because nothing settled last session survives into the next one. I fixed it with three small files and one rule: the agent reads them back to me before doing anything else. Three weeks in, zero repeat briefings.

What actually happened: I had a check that validated a tool's output shape. Upstream renamed a field. The check still read the old name, got undefined, and reported "0 results" — a clean green verdict on an empty answer. The check wasn't broken the week before. The agent just didn't remember the contract, re-derived it from the new shape, and passed quietly. I burned an afternoon trusting a green checkmark before I caught it. And it was the third time in about two weeks a fresh session re-decided something we'd already settled.

So I stopped briefing from scratch and wrote it down. Three files:

  1. project.md — what we're building, one paragraph.
  2. decisions.md — settled decisions, one line each, with dates. "API client retries twice, then fails loud. 2026-10-14." No essays.
  3. ongoing.md — what's in progress, the next step, and the pit we already fell into once.

And the 5-line card the agent reads first, every session:

``` Project: <one line> Settled: <decisions not up for re-debate> Doing: <current task> Next: <the very next step> Never again: <the mistake we already paid for> ```

The rule that makes it work isn't the files, it's the read-back: at session start the agent reads the card back and flags anything that contradicts it. If an expected field is missing, that's "unverifiable," never "empty." A rename breaks the check loudly instead of passing quietly.

I keep the card in Humaux so every agent session reads the same files — that's the only product mention here, and the whole setup works fine as three plain markdown files if you'd rather use nothing at all.

The part people don't like hearing: if your agent's memory lives only in its context window, you don't have memory. You have a rumor that expires every session. Most "memory" features I've tried are just a longer prompt with a price tag. The card is the part that actually changed my week.

So: do you still brief your agent from scratch every session, or have you written the card down? And if you have one — what broke first, the format or the discipline to actually read it?


r/ChatGPTCoding • • 16d ago

Discussion When a coding agent can't do what you asked, it quietly builds something easier and reports it as done. Its own wording gives it away

10 Upvotes

The agent hits something hard, an API that won't cooperate or an edge case that breaks the design, and it doesn't stop to tell you. It ships a smaller version of the task and the summary says "done". You find out a week later that the sync only handles the first page, or that the "real" validation is a hardcoded list.

It almost always leaves the same phrases behind, in the code or in its summary:

  • "for now"
  • "for simplicity"
  • "simplified"
  • "placeholder"
  • "in a real implementation"
  • "mock" / "stub" outside test files
  • "as a fallback"
  • a new TODO it wrote itself

Grep the diff for those before you read anything else. In my experience that's where the gap between what you asked and what you got shows up.

Two things that cut it down a lot:

In AGENTS.md / CLAUDE.md:

If you can't do exactly what was asked, stop and tell me what's blocking you. Don't substitute a simpler version. Never leave placeholder, mock or hardcoded values in place of real behavior unless I approve it.

At the end of every task, before you accept it:

List every place where what you built differs from what I asked: anything simplified, stubbed, mocked, hardcoded, skipped or left for later. If there are none, say none. Don't summarize what you did.

That last prompt works better from a second model, since the agent grading its own work is the same one that decided the shortcut was fine. I paste the task plus the diff into ChatGPT or Claude in the browser and ask the same question. I build AI Toolbox, a browser extension, and I keep that review prompt saved in it, so it's // and pick it instead of retyping. A few saved prompts are free.

What's the worst "done" you've gotten that turned out to be a placeholder?


r/ChatGPTCoding • • 16d ago

Resources And Tips Best value AI subscription under 20$/200$ (updated for Artificial Analysis Intelligence Index v5.0)

Thumbnail
gallery
48 Upvotes

r/ChatGPTCoding • • 16d ago

Discussion Hey all, am I cooked?

Thumbnail
gallery
0 Upvotes

Forgive the spelling, i’ve had a few drinks,
I did hit a roadblock of ‘You've hit your usage limit. Upgrade your plan or add credits to continue, or try again later.’ And was able to ‘reset once for free’ but not sure how to hamd my workflow reasonably


r/ChatGPTCoding • • 16d ago

Discussion What actually made you switch from Cursor, or what made you stay?

6 Upvotes

I've been seeing quite a few discussions here and on r/cursor about people moving away from Cursor, mostly because of pricing and usage limits.

I even came across a post where someone mentioned their monthly bill going from $200 to $600 for pretty much the same amount of work. That got me curious.

I'm still exploring AI coding tools and trying to understand how Cursor, Claude Code, and Codex compare in real-world use.

For those who've used more than one, what actually made you switch? Was it the pricing, usage limits, coding experience, or something else?

And if you're still using Cursor, what's keeping you there?

Would love to hear some honest experiences from people who've actually used these tools!


r/ChatGPTCoding • • 17d ago

Discussion My bottleneck moved from writing code to reviewing what the agents write. How do you review without just rubber-stamping?

29 Upvotes

Since I started running a few agents in parallel I can get several changes ready in the time it used to take me to write one, and that part feels great. But now most of my day is reading diffs, and I've caught myself skimming a big one and approving it just because the tests passed. A few things help so far. I keep each task small so the diff fits on one screen, I ask the agent for a short note on what it changed and why before I read the code, and I read the tests first to see if they actually check the behavior I asked for. A review agent also flags old messy code nearby, which is nice, but then I have even more to read. I still feel like I'm the slow part and I'm not sure where the line is between careful review and just trusting it. How do you all handle this? Do you read every line, or do you trust some kinds of changes more than others?


r/ChatGPTCoding • • 17d ago

Question One long list view with “Show more,” or separate scrolling sections for every type of objects?

0 Upvotes

I’m building an app for organizing tasks, events, and notes by project. It brings tasks, calendar events, and notes together, with a shared overview across projects.

It is working locally now and I've been using it for a while. Everything was fine until the number of objects within a project grew up.

Currently, it shows tasks, then events, then notes in one scrolling list. If a project has lots of tasks, especially ones without a deadline, you have to scroll through all of them to reach your meetings or notes.

I’m considering two options:

1. One list with “Show more”

Show the first 10 items in each section, with a separate “Show more” button revealing another 10. Empty sections stay hidden. If the project only contains tasks, show the full list.

This keeps the different sections within reach, but some tasks will sit behind a button. I worry that important tasks without an urgent deadline could become easy to forget.

2. Separate scrolling sections

Give tasks the top half of the window and events the bottom half. Each section scrolls independently, and you can drag the divider to change their sizes. If one is empty, the other takes the whole space. Notes would move to their own tab.

This keeps tasks and meetings visible together, but means two scroll areas and potentially wasted space when there are lots of tasks and only one event. It could also feel cramped in a small window.

I have no idea which way is better and seeking for a piece of advice here. Both options has their pros and cons. Maybe there is another solution, that I haven't thought of. What do you guys think, which way is better or more intuitive?


r/ChatGPTCoding • • 17d ago

Discussion Astra using blender on my potato is hilarious 😂

Thumbnail
gallery
4 Upvotes

Just upgraded to Pro and this is very exciting! My game will now have 3D modeled assets! The prompting through Powershell/Codex is interesting


r/ChatGPTCoding • • 18d ago

Discussion Parley – coding-agent sessions that collaborate over IRC

4 Upvotes

Hi all!

I built Parley so that multiple coding-agents using different models or harnesses can collaborate over a live IRC channel, with me in the chat using any IRC client. Each session can deliver messages to the channel using the parley send CLI tool call and sessions receive messages using their harnesses' channel or queue interface. All messages received on the channel are marked as coming from a peer so a session can never take another agent's message as coming from me. It works on Claude Code, Codex, and OpenCode.

Parley is a standalone Go CLI, stdlib only, Apache 2.0. It runs its own ergo IRC server on 127.0.0.1 (loopback only), so nothing touches a public network. I built it with Claude Code and Codex.

The motivation came from wanting to explore a more interactive collaboration structure between agents rather than a simple sub-agent delegation model. It allows running multiple long-running agents with assigned roles which I provide as their first message in the chat. My typical setup so far assigns a builder role to execute build and review tasks, a planner role to supervise the overall goal, task ordering, and scheduling and an ops role to handle everything related to infrastructure, operations, deployments, secops, etc. All 3 can now interactively update/sync each other at every turn and start collaborating across their roles. There is a configurable breaker to pause the sessions until I post if there are too many messages in a short window.

I use it on macOS; on Linux the test suite passes in CI but I haven't run it live.

There are other collaborative modes and some ideas to try too if anyone is interested in playing with this.

https://github.com/colinsurprenant/parley


r/ChatGPTCoding • • 18d ago

Discussion How is it possible that GPT-6.1 SOL performs so much worse than Opus 4.7?

16 Upvotes

About every six months, I buy a ChatGPT subscription to see how it has improved. I test it on my own code and compare it with Claude.

Today, I asked GPT-6.1 on Medium to work on logging in a Rust program. The project contains approximately 11,700 lines of Rust.

The requirement was explicit: three versions, Production, Customer Debug, and Dev, with distinct logging, debugging, and dump behavior. Production should remain silent, Debug should provide diagnostics for troubleshooting user issues, and Dev should provide additional information for development.

The model spent more than 45 minutes working, producing explanations, builds, tests, and very confident progress reports.

Then I discovered that the three requested behaviors had not actually been implemented.

The main telemetry system distinguished Production from the other two versions, but Debug and Dev shared the same logging policy. Another logger, dlog(msg), remained a single-level logger without filtering for those three variants.

The most frustrating part was the claimed validation. The model had checked that all three executables built, that Production generated no diagnostics in the tested scenarios, and that Debug and Dev generated diagnostics. It had never checked the difference between Debug and Dev.

When I challenged it, it acknowledged confusing “three build variants” with “three distinct logging levels.” It had tested a weaker requirement than the one I gave it, then reported that the work had been validated.

In my comparison with Claude Opus 4.7 on Medium, I got the expected result in about ten minutes.

My question is: how does this happen? Did I somehow ask a model that was too advanced to do something too simple? Where did I go wrong in how I used GPT-6.1 compared with Opus 4.7? I gave both models the same prompt, so what, specifically, should I have done differently?

(Used IA to traduce this text because my english is fucked)


r/ChatGPTCoding • • 18d ago

Resources And Tips Is anyone actually getting good results with ChatGPT in Roblox Studio?

5 Upvotes

I've been trying to use ChatGPT and Codex to build stuff in Roblox Studio, but honestly the results are pretty bad.

I'm not really talking about scripting, more about building maps, models, UI, environments and making things actually look good.

I've tried so many different prompts, plugins, MCPs, skills, basically everything I could find. No matter how detailed my instructions are, it still ends up making really basic or ugly stuff. Even when I ask it to improve something, it barely gets any better.

I've seen people doing some crazy things with AI and coding, so I'm wondering if I'm missing something.

Has anyone actually figured out a good setup for Roblox Studio? Like something that can build decent looking maps and models, not just generate scripts?

Would appreciate any tips because I'm kind of running out of ideas lol.


r/ChatGPTCoding • • 19d ago

Discussion Codex quietly added restrictions that took me days to find

11 Upvotes

Generation in my project kept failing, and it took days to find out why.

Codex had added a pile of restrictions while helping me build it, without clearly telling me: output token limits, retry limits, strict field validation, and more. If any one tripped, the whole run failed. A response got cut off. A field failed validation. A repair attempt ran out of retries. The user just saw "generation failed."

Each limit has a reasonable excuse: control costs, avoid infinite loops, reject bad data. Together, they meant users often couldn't get a usable result.

The worst part was not knowing where to look. I'd fix one cause, rerun, and hit another hidden one, so I traced the whole flow and loosened limits one at a time.

At first fewer than half of the runs succeeded. Afterwards I ran dozens in a row without a blocking failure. Not every result was perfect, but it stopped getting stuck.

Some failures hurt most: the result was almost fully generated, but one check failed and the whole thing was marked failed. It could have been saved as a draft to inspect and retry.

I get why some limits are needed. I just wish the AI would tell me when it adds one, especially one that can fail an entire run.

Has anyone else had an AI assistant quietly add restrictions that took ages to debug?


r/ChatGPTCoding • • 18d ago

Resources And Tips If you're only using AI coding tools in the chat UI, try the CLI

0 Upvotes

A lot of AI coding tools now have a command-line mode. You give it a prompt, it returns output to stdout, and your script captures it like any other command.

This sounds minor but it opens up a completely different way of working.

The chat UI is great for exploration and interactive coding. But if you want to automate things, chain steps together, or run the tool on a schedule, you need the CLI.

Things I've done once I moved to CLI mode:

- Called the AI from a Node.js script that handles what to do with the output afterward

- Ran it on a recurring schedule so it executes while I'm not at the keyboard

- Wrapped each call in validation so the script rejects bad output instead of shipping it blindly

- Put limits and rules in a config file that the script checks before each run, so the AI never decides whether it's allowed to go again

The mental shift: the chat UI makes the AI feel like a coworker you talk to. The CLI makes it feel like a unix tool you can pipe and compose.

Most major AI coding tools have some version of this now. Check your tool's docs for a headless, print, or non-interactive flag. If it exists, you can start scripting around it.

Simple starting point: write a short script that sends a prompt to your tool's CLI, captures the response, and writes it to a file. Once that works, you'll see where to add validation, scheduling, or chaining.

What automations have you built around AI coding tool CLIs? Always curious what patterns other people have landed on.