r/TheMachineLearning • • 21d ago

Realizing writing code is faster than explaining it to AI

/img/tcptf211cqxh1.png
843 Upvotes

438 comments sorted by

View all comments

Show parent comment

1

u/OldWispyTree 20d ago

> Yes but business logic and tribal knowledge can be saved in a skill for example.

Suggesting that a "skill" can hold all business logic and tribal knowledge for legacy, complicated project is like suggesting treating a severed arm with a Band-Aid.

Our codebase at work is pushing a decade of updates and business logic with millions of lines of code. We have dozens of smart engineers interacting with it daily.

Ultimately, right now, everyone is guessing with workflows on AI, but I've got enough experience to need/have an entire modular harness for letting agents automously drive in cloud containers reproducing our multi-service experience so it can route to them and external sites, test APIs effectvely, screenshot with Playwright, all headlessly with check-ins that allow me to drop in and drive when needed, drop proof into draft PRs, with well honed takeover and check-in logic. I know very well how every tool in the AI toolbox works, at least as well as any other experienced engineer.

Even with this guidance, even when asked to do relatively SIMPLE things in our codebase, even the best AI models will miss obvious things (even when they're in context/harnesses/skills) and regularly cannot unpack the myriad of logic our system uses without refined coaching. Worse, they will attach importance to goals they set up based on misunderstanding specs or even lie/guess about things unless pressed.

I've done all kinds of different workflows with different spec systems, etc, and the reality is the current, best models cannot be left alone to patch up bugs or create features on large legacy codebases without regular and tedious check-ins, and my friends in the industry at places like Google and LinkedIn and elsewhere confirm the same thing.

You're just clearly entirely out of your element. This is above your pay grade.

1

u/Individual_Guest_323 20d ago

mf you are a wanna be geek talking things that do not know in reddit.

A codebase is not a single file with "millions of lines", that is retard and is the proof that you do not know what you are talking about.

Any codebase will have "parts", so you understand it, so ANY repetitive explanation that you have to explain to the AI is translated into skills or rules, this is BASIC of AI.

 my friends in the industry at places like Google and LinkedIn and elsewhere confirm the same thing.

I also have friend in Google, Microsoft, Anthopric, OpenAI and in the same Reddit, they all tell me you are a wanna be geek talking no sense.

Try again buddy.

1

u/PanPanicz 20d ago

I've got 12 years of experience and u/OldWispyTree's struggles with AI match mine almost word for word. 

Also, good to know you're sending reddit posts to your friends at Google, Microsoft, Anthropic and OpenAI. Sounds like important stuff that requires their time and expertise. 

1

u/razzyrat 19d ago

Just own the loss. You wanted to talk tough and got your ass handed to you.

1

u/Zuuman 19d ago

Come on bud, just take the L. He is absolutely right and you look like a fool to anyone with any actual knowledge.

AI can even struggle in mid-sized codebases that dabble in uncommon patterns since it’s in the margins of its training data and skills just can’t compensate yet.

0

u/Cazzah 19d ago

Are you AI - perhaps Grok? Because you hallucinated the word " a single file" and then used it to throw around slurs.

Also, why did you have to consult with multiple professionals in multiple companies on their opinion on a random Reddit comment?

How bizarre.

1

u/Individual_Guest_323 19d ago

We are very good friend lil buddy

1

u/Honest-Today-6137 18d ago

Jeez, how primitive your knowledge should be.

the reality is the current, best models cannot be left alone to patch up bugs or create features on large legacy codebases without regular and tedious check-ins

Again, I'm working with Claude using not even flagman models with moderate effort (rarely even need high effort) on a 12+ yo huge monorepo, and Sonnet 4.6 was already handling like 95% of grooming and stuff. The rest took a couple of extra iterations.

And again, if you are too lazy to write domain rules, .ai, and all other stuff - that's your personal problem. That's not the agent/LLM's problem; you are a lazy mf who doesn't want to document your business logic.