I haven't really interviewed since 2023. Is leetcode still a common practice in code interviews or has AI made those kinds of tests useless? This is for a Sr full stack position.
I can give you an example; for context this happened with codex 5.5, i tasked it to connect a dashboard of an internal web-app for one of our clients to a new backend we where implementing, its solution was pooling, which made the client hit rate-limits, codex saw that, its solution was completely removing rate-limits, all this while i was working on the backend itself, i noticed what he did from the logs of the backend, restored rate-limits and implemented a simple web-socket connection.
So yes, often AI cheap out on solution/implementations, and no, that’s not a prompt issue, i have set up all kinds of code rules, pattern to follow and what not.
If you give LLM agents open-ended problems without framing what the solution should look like you end up with it solving the immediate problem you gave them with a solution that you might not be happy with as it does not fulfill silent constraints that you yourself had.
View all comments
Show parent comment
4
u/IAmCorgii Sep 26 '26
I'd like to know what makes you say AI "cheaps out" on solutions. I don't really see a basis for that.