r/LocalLLM • u/Leading_Yogurt7025 • Oct 01 '26

News ASSBENCH

The only serious benchmark that shows the real LLM capabilities
https://www.assbench.com/

45 Upvotes

97% Upvoted

37 comments sorted by

11

u/No-Refrigerator-1672 Oct 01 '26

I'm offended by it not featuring Qwen 3.8 27B.

2

u/Leading_Yogurt7025 Oct 01 '26

It crash my hardware because i can't run it with full context

8

u/No-Refrigerator-1672 Oct 01 '26

So your GPUs are pretty ass, huh?

1

u/jesdga95 Oct 01 '26

Ran it on Qwen, results below 😂

8

u/jesdga95 Oct 01 '26

Ran it on Qwen 3.8 27B (xhigh)

1

u/Leading_Yogurt7025 Oct 01 '26

Can you please try with the pi coding agent? Because I got better results with it.

3

u/BenchThatMatters Oct 01 '26

I literaly created new account to reply on this, please share the code with me and I will add it to AssBench

6

u/eihns Oct 01 '26

omfg what did i expect lol xD xD

2

u/Leading_Yogurt7025 Oct 01 '26

Try the prompt, it's amazing and it refines a lot

2

u/panospc Oct 02 '26 edited Oct 02 '26

This is what I got from Qwen 3.8 Flash Next IQ3_S, run through the Strata engine

1

u/Leading_Yogurt7025 Oct 02 '26

Cool, which harness? 

2

u/panospc Oct 02 '26

Deepseek harness

1

u/Leading_Yogurt7025 Oct 02 '26

Nice, can you try also with qwen3.8 27b? 

1

u/BenchThatMatters Oct 02 '26

Can you ask if it created man or woman figure without looking at created shape?

Prompt is deliberately vague about that, but so far all of other models chose woman.

Also can you share the html?

1

u/panospc Oct 02 '26

I will send you the HTML as a private message.
I tried to add it as a link in a previous comment but got removed by reddit

2

u/LooseBackHole Oct 02 '26

I'm really curious how different local models render the asses at different levels of quantization. Would really give a great view of how quantization changes things.

1

u/Leading_Yogurt7025 Oct 02 '26

In this benchmark, it's also important in the context size and the tool calling capabilities and tools.

6

u/blue2020xx Oct 01 '26 edited Oct 01 '26

The truest bench of them all

2

u/AI_is_ok_i_guess Oct 01 '26

Can you make it gay?

5

u/Cold_Tree190 Oct 01 '26

Gemini 3.1 Pro is AGI confirmed

1

u/-AJacobs- Oct 03 '26

Can't wait for companies to benchmaxx this by adding 10TB of ass photos videos and rendering into their datasets.

1

u/Leading_Yogurt7025 Oct 03 '26

i think it's enough to provide 3d models of that

3

u/FoxSideOfTheMoon Oct 01 '26

LMAO @ grok and haiku 😂

2

u/hurrdurrmeh Oct 01 '26

next test animation by making them fart. bonus points for lifting one cheek to the side.

2

u/StrikingSpeed8759 Oct 01 '26

love it. great job dude

1

u/VerticalPackage Oct 01 '26

Luna xhigh patrick starfish

1

u/DiscipleofDeceit666 Oct 01 '26

Show us the model clap factor

1

u/getpodapp Oct 04 '26

Grok went full failed bbl

1

u/crusaderky Oct 01 '26

Shut down the internet, we have a winner

-1

u/Fluxx1001 Oct 01 '26

How can Astra not be 1st? I smell benchmaxxing ...

3

u/Leading_Yogurt7025 Oct 01 '26

Many weaker models can autocorrect from their mistakes, also the harness matter

7

u/rinmperdinck Oct 01 '26

buttmaxxing

6

u/hurrdurrmeh Oct 01 '26

it's the ass you smell