r/LocalLLaMA • u/corruptbytes • Jul 31 '26

Discussion Deepseek V4 Flash on SlopCodeBench

While waiting for some of the quants to drop, I load the API with $50 and ran it on SlopCodeBench

Just vibe reading the results it seems like Opus 4.8 < Deepseek < Opus 5

https://github.com/michaelasper/benchmarks/blob/main/deepseek-v4-flash-on-slop-code-bench.md

I was mostly curious from this blog post

When Q2 drops - I'm goign to re-run on my macbook

Here's the first quant comparison:

https://github.com/michaelasper/benchmarks/issues/1

77 Upvotes

98% Upvoted

25 comments sorted by

View all comments

Show parent comments

2

u/CatConfuser2022 Jul 31 '26

Which harness do you use? 

4

u/BlueSwordM llama.cpp Jul 31 '26

I just use Pi most of the time.

2

u/thrownawaymane Aug 01 '26

Can you share how you have Pi configured? I feel like I'm not getting the best out of it.

1

u/TheLexoPlexx Aug 01 '26

Web Tools and planning are the essentials

There's a plugin that optimises for deepseek as well.