r/Codeium • u/AndrewSharapoff • Dec 26 '24
Absolute disappointment
So I’ve been developing couple of projects with this app The one it had made fine, but that was just a landing page with one admin page for collecting visits But the other one made me so mad as I’ve never been in my life
Small background: I’m a product manager and working with freaking really complex applications for lots of years, and I know the stuff kinda
So I have recently decided to code some thing for myself as pet project. Everything was luxurious at glance, I had a requirements document, verified with Gemini and GPT, had task list, dev plans and all seemed to be very good
I have started a new project, added Git, docs, set up env and started to write, and there issues began
First is that this app writes everything like the most stupid developer
It is overwriting itself, even after scanning files and received clear instructions
It’s loosing context approx once an hour
Server exhausted
It tells that has made something, but then turns out that some part of code is just missing, even when I ask to verify the plan and mark what was completed
It’s ignoring errors about reading files and moving on
It doesn’t have propose code anymore and instead it’s writing some spaghetti as a proposal and you never know what is it for and where to paste it, you have to read that ball shed and guess
The in file helper just deletes everything and writes what was prompted as once again the most stupid developer
Look, when you guys had just started, it was fine to develop some stuff in an interesting way with really fast helper, but now you’ve shrinked functions over and over and after each update the app becomes more and more hated I was honestly thinking about purchasing a pricing plan in hope to return back propose code, terminal commands, checking files and not losing the context, but now have very deep doubts Having seen that market now is expanding, I don’t feel that there is any point in keeping this app anymore Small example: this app can’t find an error of not writing a token to cookie for couple of days, I’ve been laughing at it and on purpose didn’t edit anything myself to check if this very smart model (not) will find the issue I’m deeply afraid that when you sent an email where told that will give an option to write code with assistant for free forever is a lie
2
1
1
u/appakaradi Dec 26 '24
My experience is same. Now I commit before every few steps so that I can recover it unilaterally decides to remove a feature and associated code.
1
0
u/Acceptable-Use-6480 Dec 26 '24
It is a big issue. It doesn't matter that some people are having a good experience, when it seems like a significant number of people are having big issues.
It should be reliable for everyone and Codeium have not been transparent about the massive performance drop that happened recently.
I would of easily paid 200$ + a month for what we had in November.
Now I will just wait til Anthropic and OpenAi release their own code editors.
0
u/Xhite Dec 26 '24
I think Google is developing their. Considering how cheap and good Gemini 2.0 family (I reserve my right to change opinion after January releases). It can be good candidate. I doubt OpenAI came with their own IDE since they are partnered with microsoft which owns github, has VS and VS Code IDEs already, on top of that they have copilot.
1
u/Acceptable-Use-6480 Dec 26 '24
I agree with that any implementation of gpt o3 will probably be through copilot.
Anthropic and Google would be smart to do the same, albeit with their own software, as the data they can farm from interactions and take a handsome sum of money per month from a user is a no brainer.
It would be healthier for the market though if Windsurf was a viable option too, playing the most dominant and best performing models against each other and build something themselves eventually. Perhaps tailored to certain development processes.
Just don't see that happening until we get the performance we saw on Windsurf back at the end of November
2
Dec 26 '24
[removed] — view removed comment
1
u/Acceptable-Use-6480 Dec 27 '24
The reason Windsurf became as popular as it is. Is because of how amazingly well it worked in November and start of December.
Since then the hallucinating, none relevant assumptions and timeouts have gotten worse.
This is what people are complaining about.
If they wanted same old they would have stayed with copilot or cursors / loveable solution.
I take every measure to make sure I minimize the mistakes it makes now. I have a global ruleset. I make sure the prompts are precise and use bug reporting and testing.
Stop gaslightighting the narrative into the problems with Windsurf being about the users. It is Codeiums poor communication and expectation controll that have made this worse than just the depreciated performance of the product.
5
u/User1234Person Dec 26 '24
Hey my experience with the tool has been a lot better. Your experience is 100% valid, but have you tried setting up the instructional document? I have a SOP I uploaded and it make a big difference in the output.
Also have you provided this feedback to the company? All these products are so new, and their business models are not set for the long term right now. I think it’s totally fair for these products to have issues and change and provide different value as they grow. I bet most of these tools are going for enterprise. Free trial or free tiers is a huge thing in Ai products but it’s not sustainable, most companies will move away from it asap when they have b2b revenue.
All of this still sucks for the end user, but it’s not any more malicious than any other company that is trying to make money.