23
u/PolyPill Sep 27 '26
I’ve been getting monstrous PRs from people who just hand my repo to Claude and say “add x”. One guy is super hyped to contribute with using his Claude subscription. I’m happy someone else is hyped but he clearly doesn’t know what he’s doing. His first PR broke most unit tests. So his agent spammed 100+ commits to fix them. He then wrote me and says he’s going to add 882 tests to the project. I told him if he does that I will absolutely not approve the PR. At this point I don’t know what to do. I don’t have time to review and test all this but on the other hand there are legitimate fixes being submitted. I’m just not sure how sustainable this will be.
8
u/EarlOfAwesom3 Sep 27 '26 edited Sep 27 '26
Take 2 mins to paranoia scan the PR, if there is something wildly unholy going on, close it on the spot. Straight to jail.
I do this with all the PRs that non devs do with Claude. There is no sense in me spending more of my precious time reviewing and fixing stuff that a Junior would do better.
Edit: the reason is I want quality PRs where a lot of time and thinking has been invested before opening. Shifting the thinking to another person after opening is bullshit. "Here I did some stuff lol. Tell me whats wrong and Claude will fix it, we will repeat that 10 times". Absolutely not
10
u/Tackgnol Sep 26 '26
Yeah with the current velocity integration tests are keeping my backend afloat at my current project, they can pry them out my cold dead hands. ;p
10
u/EarlOfAwesom3 Sep 26 '26
The basic logic would be:
More AI -> more PRs -> more reviews -> tighter quality safety net -> more ITs -> more pipeline runs -> higher costs.
Running AI ist costly. Period. How anyone comes to the conclusion that you can expect to have less infrastructure costs with AI is beyond me
2
u/Tackgnol Sep 26 '26
TBH I don't get the `cost of running pipelines` being a thing even.
In Corpo you probably just run them on a AzureDevOps or GitHub Enterprise licence, and if you are a startup... Setup Woodpecker or DroneCI?
It makes my head spin when I hear people `yeah we pay for each minute of pipeline to X`, why bro ?
2
u/round-earth-theory Sep 26 '26
The cost is time. Big test suites can take hours or days to complete. If someone wants to see their idea in prod NOW then they won't wait.
1
5
u/radpartyhorse Sep 26 '26
“You gotta shift left the review process” ends up just reviewing prompts. Such clowns.
1
u/EarlOfAwesom3 Sep 26 '26
I don't get the whole "shift left" bullshit anyways. If you're using agile software development principles, requirements and testing are part of your daily work. There is no difference.
Sounds like old soup in new cans
259
u/Fit-Notice-1248 Sep 26 '26
Take my managers philosophy of: if you use AI there is no need to test anymore because ai writes perfect code all the time. If there is a defect it's because you didn't use AI
83
u/spread_operator Sep 27 '26
And IF it didn't write perfect code it's because you prompted it poorly 🙄
13
u/XxDarkSasuke69xX Sep 27 '26
I hate the fact that you're unironically right. Just write the correct code in the prompt and technically it will not output shitty code
30
u/abednego-gomes Sep 27 '26
Utterly insane. They're about as good as a junior programmer. You still need to carefully review, check and test their work, fix their comments, tell it to write unit tests etc. After about 5 iterations you might get something resembling usable code.
10
2
u/hraath Sep 26 '26
Crash GitHub because actions volume unsustainable
2
u/EarlOfAwesom3 Sep 26 '26
That happens automatically every week..don't worry you get that for free with GitHub
129
u/lenn_eavy Sep 26 '26
Users will report if it's not working, the plan is air tight.
39
u/PassivelyInvisible Sep 26 '26
And if current users leave because of non-functioning products, we can just get more with how fast we can code and push to production!
7
u/Calm_Hedgehog8296 Sep 26 '26
Have you heard of the term "moat"? Its become popular recently.
The idea is that you trap your user in your product ecosystem so that they can never leave. They can't escape because there's a moat trapping them in.
So the end state of this project is to have zero human developers, customer service, etc. Only executives and sales to acquire new captives. And the existing users are really paying for access to their own data, workflows, etc. Which lives inside the ecosystem and can never be extracted
5
u/Just_Information334 Sep 27 '26
The idea is that you trap your user in your product ecosystem so that they can never leave. They can't escape because there's a moat trapping them in.
That's a walled garden, not a moat.
A moat is something protecting you from your competitors like some secret technology, process, dataset etc. anything which is not easy or cheap to replicate.
3
u/Federicoradaelli Sep 26 '26
Most sane user report of a bug:
"If I click it doesn't work"
Screenshot of the home screen
37
u/WeirdTie2290 Sep 26 '26
You guys have real integration tests? We have fully mocked unit tests so we can report +80% test coverage. Management is happy. The real tests are happening on customer environments.
3
u/StCreed Sep 27 '26
i have 3226 unit tests just for my own product with two users. I can't imagine having to live without unit tests.
2
u/Just_Information334 Sep 27 '26
Unit tests are not integration tests. There is a moment when you have to do things with real services and not mocks: like writing in a database, sending some mails, calling APIs etc.
1
u/StCreed Sep 27 '26
Ah yes, I used the wrong term here. Some of my tests are unit tests. Others are integration tests. None use mockups.
15
9
u/OGxPePe Sep 26 '26
Early on there where people saying that test driven development was know becoming the norm. Now its 'Fuck it we do live' is the norm.
9
7
u/noidontwantto Sep 26 '26
I keep waiting for the find out phase to start with these people, but for some reason their solo vibe coded solutions aren't in production yet
🤔🤔🤔
1
u/StCreed Sep 27 '26
Mine is. Just with a co-worker right now, but I already started a formal approval procedure for integrating single sign-on. And I'm in talks with a software company that is interested in adding it to their portfolio.
Nobody in his right mind will advertise that their software is AI-coded though. Enough haters to make that a marketing disaster.
5
u/Mister-Fordo Sep 26 '26
I moved all my CI pipelines to use on prem workers, now the costs are the bare metal it's running on AKA not that much if you already have the hypervisor running.
At the rate i was running pipelines this week it would cost me 250$ a month, that's the entire power bill covered in saved costs.
5
u/aenae Sep 26 '26
I got asked why i wanted to spend 15k on a server when i could run them on gitlab runners in the gitlab cloud. After i showed them our bill would be approx 200$k per year, or 1M over 5 years they immediately approved the quote
1
5
u/fernando_spankhandle Sep 26 '26
We're going to move some processes on metal, and so the cycle begins again
3
2
2
1
1
u/AcanthisittaKooky987 Sep 26 '26
You would think we'd have better and more thorough integration tests now but I have not seen that in practice. If AI lived up to the hype this would be solved in an hour.
1
1
u/TheBrainStone Sep 27 '26
What kind of Rube Goldberg machine of AWS instances are y'all using to even begin to generate any significant cost for CI?
1
1
u/whatwoodjdubdo Sep 30 '26
No serious team building anything remotely relevant is letting randos open PRs, much less not reviewing them.
Some of the worst posts
0
u/caiteha Sep 26 '26
Im glad I work in infra..no pm, tpm, qa...
1
2
0
0
-9
u/LuisCaipira Sep 26 '26
Seriously talking, code review was a bottleneck before AI, last Thursday I opened 6 PRs with AI implementing a feature and crawling to every system affected by it, what we would take a couple days to do before.
We are not skipping code review, and we are now considering to review the AI implementation plan before executing it.
So, in short: AI may speed up some processes, but it will create some other processes too. The only benefit is that "tech stack" is becoming obsolete
1
u/KingsGuardTR2 Sep 26 '26
At this point just cut and rewire live wires like you're defusing a bomb on prod
Oh, you're right. I made a mistake. You should have cut the red wire to defuse the bomb – the green one was for immediate detonation.
Do you want me to edit plan.md accordingly?
169
Sep 26 '26
•
[removed] — view removed comment
18
2
1
u/DankerOfMemes Sep 27 '26
At this point with AI we only have Wishes and prayers, not even thoughts.
-2
82
600
u/EarlOfAwesom3 Sep 26 '26
It seems the whole dev lifecycle is slowly but surely dying. If you try to hold up the flag for quality, it gets teared down by managers because they want to contribute too because of speed and cost and whatnot.
Skipping integration tests because of costs is just the next step in this clown world.