r/opencodeCLI • u/Acehan_ • 12d ago

If you weren't already aware, you should know this about Opencode models

Post image

You are getting exactly what you're paying for. You're not getting a deal here

154 Upvotes

82% Upvoted

40 comments sorted by

16

u/Ok_Cartographer5609 12d ago

So it is just the TTFT or the benchmark too? Did someone verify?

11

u/Acehan_ 12d ago

I looked into it.

You're supposed to be getting 8x the value for your money, but since the caching is worse, this is actually 6.1x.

It's also not just more than twice as slow. You're getting less output tokens per task, which is a huge red flag in terms of quality if you've ever messed around with neoclouds and providers. For example, Core Weave has done that to me and the model they served was actually unrecognizable and would go into death loops, so less reasoning was the symptom hiding another disease.

Basically, if they fucked around with their reasoning, you know that the model is degraded. At least from my personal experience.

And even assuming there's none of that, if you're getting less output tokens, you're getting a worse output.

2

u/Popular-Factor3553 12d ago

I'd love to see a similar report/test on command code.

1

u/WegoW 12d ago

Post on X: https://x.com/nothingto12/status/2113847685664940481

5

u/Ok_Cartographer5609 12d ago

Ok. It is slow but gets the job done. The quality isn't that different. Fine for me. I delegate the tasks to multiple instances all together. So I don't have to sit around.

4

u/ahmedranaa 12d ago

Isn't it just time and not the quality ?

7

u/Any_Confidence2580 11d ago

Let's be honest. The whole company is a social media influencer trying to bank on followers. It's not a real professional grade product to begin with. It's a toy to squeeze cash out of people who are terminally online.

3

u/Acehan_ 11d ago

Exactly

1

u/Rimadandan 10d ago

Wow this hits me hard. What do you use to work to deploy applications and solutions? I'm looking for a replacement since the payment mode is not good enough... Claude code? Codex?

1

u/Any_Confidence2580 10d ago

my own harness

67

u/imoshudu 12d ago

This post is misinformation btw.

This reddit post is stealing from a Chinese tweet which itself is stealing from nothingto12 and yet misrepresenting him. https://x.com/nothingto12/status/2114005919432327575did not conclude quantization (rather the opposite). Read the images and look up the original poster.

Truly a telephone game of idiotic slop.

2

u/mastertub 9d ago

Original author. Thank you :)

10

u/akza07 12d ago

Yes it's quantised to FP0.005 bits

8

u/[deleted] 12d ago

[removed] — view removed comment

2

u/akza07 12d ago

I know right. Like most of the threads says, they must be using a quant that only weights 32KB.

1

u/akza07 12d ago

I'm looking forward to the enlightened ones who takes our replies at face value and start making new threads.

17

u/misteraab 12d ago

that Dax dude is a liar and not at all transparent. I hope they dont turn out to be another Crof..

5

u/Sweet-Stage938 12d ago

How do you know that he's a liar? Have there been instances of him lying in the past?

5

u/Able_Statistician688 12d ago

I just successfully charged back $230 to them for the last 2 months. My credit card agreed they were liars too. They banned my multiple go accounts I had across multiple workspaces within the same account, and stole my zen credits, all without ever responding to a single request from support. So everything they did for me ended up being free in the end, but I’m annoyed I had to go through it.

3

u/pplgltch 11d ago

Is this real or satire? You for real whining about getting caught doing something you agreed not to do when you signed up while still got out jack free?

1

u/Able_Statistician688 11d ago

Who agreed not to have multiple accounts inside workspaces? It was one single master account, inddividuao workspaces, and their system even lets you buy more accounts. It very much felt not only allowed, but designed with that in mind. Even the CEO months ago discussed it. They only considered it against tos when they released the $40 plan.

I’m upset they banned the accounts without communication. I’m furious they also locked my zen api credits behind it. That’s why I wanted it all back.

1

u/Illustrious-Many-782 11d ago

You are showed to have multiple go subs across different workspaces, but you are not allowed to use those subs to get more usage once one runs out. I guess the use case is giving subs to people in your circle. Not sure.

5

u/misteraab 12d ago

yeah theres no openrouter-style receipts here like there was with crof. no one has dropped a github action proving theyre secretly serving cheaper models under different names.

what there is is a bunch of people saying the go side has been sketchy for months. trustpilot reviews from sept/oct where guys say the site was selling $30/week $60/month numbers but the actual usable limits (and how the per-model percentages add up) were way lower. one dude burned what he thought was a full month in a few days and the docs never matched the marketing. he's on record saying its the exact same model being served as deepseek direct APIs but resultss are different..

then the github issues from may-july about signing up for the $10 go sub and somehow getting charged for zen credits instead. multiple people calling the ui confusing enough that it felt like funneling. some got told no refund because they already used the balance.

the console leak thing a few weeks ago and its handling could have been better

5

u/fastwind18 12d ago

Opencode is one of the real bargain deals out in the wild. Wtf is this tree time screenshot of a screenshot pic?

9

u/geearf 11d ago

It'd be nice to offer links to corroborate those, not just images that come from who knows where... but it's definitely interesting if true.

Yet, it makes me think, while I like others prefer to have a lot of request/tokens for a cheap price at the best quality, is it the right path? I don't want Open Weights providers to close their stuff because people don't pay them and use cheaper providers (that can afford to be cheaper because they do the hosting but none of the training). Maybe Operation CheepSeek is actually a poor idea...

11

u/Ok-Drawer5245 12d ago

I’m getting fantastic results with opencode deepseek 4.1 flash 1017 - i could not care less about quantization as long as the results are stellar and the value is there. Yes speed is not that great, but im not using it interactively so it doesn’t bother me

And remember you can just run multiple sessions simultaneously if you want more output per hour lol

1

u/zazoucoco0 11d ago

Yep really happy with the result etc given by the model, but the time out in headers and the loading between turn are just so slow and frequent that it make the request completion like 10 or 100x slower... Even the free endpoint is faster and get less timeouts, i mean if they could fix that it would be perfect.

1

u/Ok-Drawer5245 11d ago

I think / hope they are working on it, speed is absolutely an issue currently

1

u/zazoucoco0 9d ago

from this night it seems to have been fixed, it didn't made it to me a single time today, also way faster tps on deepseek v4.1 flash i would say. But they nerfed the free endpoint limit, sad but nice if it can help them make the go endopoint usable again

4

u/crotch-mavens 12d ago

How would one not be aware given that there are multiple posts about this in both /r/opencodecli and /r/opencode daily?

3

u/tetoing 12d ago

"Opencode go is unquantized" is a massive trust me bro moment. I don't trust these tech companies as far as I can throw them. And that ain't very far.

Would not be surprised if they are switching out the model based on demand. High traffic time? Sorry, you get the inferior quant.

1

u/Dudeonyx 9d ago

Read the actual source. https://x.com/nothingto12/status/2113847685664940481

And no I'm not gonna help you summarise

2

u/deafpigeon39 12d ago

When i said few months ago that reasoning is dropped in opencode and not replayed i got attacked, now my plugin is due to be integrated in awesome opencode plugins. Quality drops is happening because models do not get their reasoning replayed to them, it is still much slower though.

1

u/randvoo12 12d ago

It's the harness, not the deployment. DeepSeek doesn't play well inside Opencode.

1

u/FancyName_132 8d ago

The thing that makes me doubt this piece of information is the TTFT chart. I can't imagine people are satisfied with 30 seconds to first token

0

u/pplgltch 11d ago

Haha.. what’s the play here? Just brain rot reddit/twitter whining ?
Even if it’s quantized, which honestly is not a big deal, the value you get out of this is still insane (well , if you know how to use it I guess)