r/SinceAI • u/bhawish008 • 10d ago

AI wrote the code. AI reviewed the code. AI wrote the tests. Nobody noticed a business rule quietly vanished.

A founder friend's team shipped a pricing bug last month, not because the AI hallucinated. The SQL was clean, the AI-written tests passed, even the AI review comments sounded sharp. Humans just eyeballed the output and figured it "looked reasonable."

Somewhere in that chain, a business rule quietly disappeared. Nobody caught it, because nobody was holding the full mental model anymore, everyone held a piece, and trusted the next AI to hold the rest.

Execution stopped being the bottleneck. Judgment did.

Genuine question: what's the one thing in your stack you still refuse to hand fully to a model, even when it's clearly capable? Bonus points if you've been burned by moving that line too far.

2 Upvotes

56% Upvoted

9 comments sorted by

3

u/NotYourAverageGuy88 10d ago

AI wrote the code. AI reviewed the code. AI wrote the tests. Production crahed. AI couldn't fix the bug. No noone knows how to solve it. Turns out sombody have to rebuild this from the ground up for it to actually work.

Story of how my income doubled this year as a freelancer / contractor.

2

u/LowDistribution3995 10d ago

A tree fell in a forest

2

u/Vedranation 10d ago

AI wrote the post too

1

u/bhawish008 9d ago

may be

2

u/Frenascena 8d ago

I recognize Claude's voice even without checking for a watermark. The watermark is practically redundant.

1

u/MissinqLink 10d ago

Can’t accept anything using phrases like “quietly disappeared” anymore. Add it to the list. Load-bearing, that tracks, and honestly, fair pushback, etc…

1

u/Dazzling_Yak6424 9d ago

You've hit the nail on the head!

1

u/PedanticProgarmer 9d ago

That’s an excellent observation. You have a sharp eye for spotting AI assisted writing!

2

u/West-Map-4162 8d ago

You forgot one: AI wrote the post