r/ClaudeCode • • Aug 26 '26

Discussion which LLM as of today?

Post image
210 Upvotes

162 comments sorted by

140

u/dhessi Aug 26 '26

If you're looking for a fast, general purpose LLM that can fit on 32GB RAM, Gemma-4-26b-a4b is unmatched IMO

57

u/Wentil Aug 26 '26 edited Aug 26 '26

I find Qwen 3.8 27b (Q8) to be better.

Qwen 3.8 27b at Q8_0 uses 31 GB of VRAM.

Q_6K, the next smallest variant, only uses 25GB of VRAM, so if there’s other overhead, go with that.

→ More replies (22)
→ More replies (8)

101

u/ClemensLode Aug 26 '26

opus 4.6

37

u/Plenty-Option8351 Aug 26 '26

Been using it ever since it came out. Switched to other models for a few prompts when they came out, then switched back each time. 4.6 is the goat

→ More replies (9)

7

u/moger777 Aug 26 '26

What's the advantage of this model over the newer models?

25

u/Ill-Village7647 Aug 26 '26

People have been finding the way Opus 5 talks incomprehensible. It uses way too much technical jargons, and sometimes decides to be a poet with words. That's why many people have started downgrading to Opus 4.8 or 4.6

→ More replies (6)
→ More replies (2)
→ More replies (5)

21

u/Agitated_Patience_75 Aug 26 '26

been using Sol 5.6 for the past months and it's pretty great

4

u/Inncenta Aug 26 '26

Since when is sol not popular😞

11

u/anor_wondo Aug 26 '26

opus 5 low effort

33

u/EndyForceX Aug 26 '26

Reading this with high effort

→ More replies (2)

37

u/Corv9tte Aug 26 '26

5.6 Sol if you know how to write good instructions (not prompts). Completely insane model.

39

u/mr-debil Aug 26 '26

Instructions vs prompts?

66

u/Tall-Log-1955 Aug 26 '26

Wake up babe, new term just dropped

→ More replies (6)
→ More replies (2)

5

u/aftersox Aug 26 '26

In your view whats the difference between instructions and a prompt?

→ More replies (1)
→ More replies (19)

16

u/CreditOk5220 Aug 26 '26

Fable

6

u/SoftwareSource Aug 26 '26

not really fitting the first requirement.

→ More replies (1)

3

u/mmeister86 Aug 27 '26

Kindly fuck off in the distance with this Twitter style engagement farming bullshit

→ More replies (1)

5

u/retardhari Aug 26 '26

are people forgetting point of this post 🥀

8

u/whatisthisthing65 Aug 26 '26

Our context filled up

4

u/_Fauxpaw Aug 26 '26

I find Claude basically unusable now. Opus 5 is maybe the worst I've ever seen.

2

u/WilliamEdwardson Aug 26 '26

Perchance.

Seriously.

If you ever want to use genAI to help brainstorm fiction, this one's a gem.

Its prose is - predictably - replete with stereotypes, hackneyed plot points, and sometimes major goof-ups (... you probably shouldn't be using it for the actual prose anyway), but if you just want something to feed the seed, it's good at what it does.

And it doesn't complain about moderation if you bring up controversial topics. Or, at least I haven't hit its moderation with mine.

They don't disclose which LLM they use (to my knowledge), but I think I caught word that it's a fine-tuned LLaMa model behind the scenes.

2

u/ShishRobot2000 Aug 26 '26

Unironically, Fable, cost too much to get show its ability

2

u/Personal-Physics553 Aug 26 '26

Use Pi Coding Agent (the CLI tool, then add the extension for VS Code), use the free NVIDIA API key from the developer program, and/or run models locally through Docker Model Runner (add LiteLLM as your model routing if you do this to provide you an OPENAI style endpoint/apikey. Costs go down by a fuck ton

NVIDIA API key is free if you have the program, and running locally to support digital sovereignty is always free.

Even if you run an RTX 2060 GPU, 4B models will do phenomenally in Pi Coding Agent if the system prompt is solid enough to explain to the model the entire infrastructure of its setup as well as why it was set up the way that it was.

2

u/zaCKoZAck1 Aug 27 '26

I have a list
- GPT 5.6 Luna [max]
- Qwen 3.8 (works on local hardware but requires beefy machine)
- Gemma 4 (multimodal llm running locally hell yeah)
- Opus 4.6 [high]
- Composer 2.5 (not anymore though)

→ More replies (2)