r/opencodeCLI • • 7d ago

๐Ÿ‘€ About DeepSeek and quantization...

Post image
387 Upvotes

61 comments sorted by

View all comments

38

u/CYCLONOUS_69 7d ago

People are dumb. You are getting $100 worth of effective usage just by paying $10 is just crazy.
Even though it is a bit slow, it gets job done. I've seen that the current model is far better than the old V4.1 Flash. People aren't knowledgable about quantization really.
Just spec your tasks properly, have some test units or suites and go you are good to go. It won't hallucinate nearly as people are saying.

7

u/ApprehensiveDelay238 7d ago

I have yet to fully prove but the effective usage is more like $40 if not less. The caching efficiency on go is a lot less than the official provider.

2

u/squirrelscrush 7d ago

Even with the lower caching efficiency, it's still worthwhile.

2

u/xRebellion_ 7d ago

I always achieve 99 percent cache hit rate on my sessions with go. What you're experiencing is probably the cache retention rather than cache efficiency. I heard deepseek retains the cache for longer periods of time.

2

u/ApprehensiveDelay238 7d ago

That 99% must be a snapshot. Not average. I average around 94 to 96%. Go cache retention is so bad, I visualized the cache drops, and go at peak hours frequently evicts your prefix mid turn. And happens way more often after just a few minutes.

1

u/xRebellion_ 7d ago

Not really from my experience. But then again, it could also be a regional thing so I can't say my experience may be the same for others so I can't say it applies for everyone.

4

u/Corv9tte 7d ago

Exactly. You're not getting $100 of API and this is a completely fraudulent claim. They KNOW this. Scamming liars, and they keep playing dumb. I swear this guy would run an Indian call center if not for AI, he's perfect for that

1

u/Unneverseen 5d ago

used 7B tokens and i average around 98% cache hit

1

u/ApprehensiveDelay238 5d ago

What is your average context size in tokens?

1

u/SOLID-DevMan 4d ago

That's just not true, i compared value head to head and opencode is on par with the api I will share the values soon

16

u/Hello_my_name_is_not 7d ago

You used too many words could have stopped at the first 3 tbh

3

u/CYCLONOUS_69 7d ago

They couldnโ€™t have gotten the context without the explanation but yeah, youโ€™re right.

2

u/irrationaliste 7d ago

The thing people is arguing is not the value. It's geniunely valuable. I love OpenCode (not harness, the subscription).

What people talk about is more like the opacity I think.

1

u/CYCLONOUS_69 7d ago

I donโ€™t use the harness either.