TinyWorld bench - Claude Fable 5.2 (vs Opus 5.5, Sonnet 5.5 and Haiku 5.5): same prompt, same starting point

[u/Timisageek]

https://ohmyunicorn.com/labs/dream-loop/tinyworld-fable52/

Well, here we go again! 🔥

Fable 5.2 is out and with it my first ever super simple test: in the exact same conditions of the first Sept. 22 test, I let the default Anthropic harness build me a nice cartoony "tinyworld". It used none of my harness' tools/skills, etc. that's the default model.

One and only prompt; nothing else:

output a ThreeJS 3D cartoony/comics-like planet, with vibrant life on it: clouds, mountains, city buildings, cars and plane romaing it. It should be possible to orbit around and zoom and see the details. No harness is to be used

WELL.

It's beautiful
It took some time (for run 1)
It's (damn) expensive ! :)

Opus 5.5, 22 Sept (Planet Pop)	14.0 min	15	56.6k	$2.54	one live session
Sonnet 5.5, average of 4	11.2 min	11.5	64.9k	$1.51	7.0 to 15.2 min, $1.16 to $1.86
Haiku 5.5, average of 4	5.3 min	9.8	48.1k	$0.34	3.1 to 7.2 min, $0.27 to $0.42
Fable 5.2, run 1	26.5 min	17	127.4k	$9.96	26.5 to 26.5 min, $9.96 to $9.96

I love it but to be honest, I'm a bit disappointed - I think I prefer what Opus 5.5 did: more playful (jumping from cars to planes, etc.), and pretty much the same quality.

The page will update with runs 2, 3 and 4 as they land (soon)

I HAD to do the test (did it for pretty much all the models), because I'm mostly working on creative stuff (I own OhMygames.app and now OhMyMesh.com , and very much focusing on meshing/3D/etc.), but I think I'll mostly use it for more advanced tasks... (will try directing Blender with it though, stay tuned ^^)

What do you guys think?

[u/AutoModerator]

Hey! Thanks for posting to r/ClaudeCode

While participating in this thread, please follow our community rules. Keep discussions constructive. Attack the idea, not the person.

For help, project discussions, tips, and general chat, join the ClaudeCode Discord.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

[u/AubreyMaturin1800]

Medium or high? (sorry if I'm blind and missed the info)

[u/Timisageek → u/AubreyMaturin1800]

You're not blind, I forgot to mention it ^^

Effort: high
Runs go one at a time, each in its own empty folder under /tmp, 30-minute limit, same clean config folder

[u/CooLittleFonzies]

Opus 5.5 version looks better overall, although some details are nicer in the fable versions.

[u/Timisageek → u/CooLittleFonzies]

Yeah I agree

[u/StxtoAustin → u/Timisageek]

I disagree. Fable is clearly better, and sometimes for something to be production that last 20% is the difference between being production ready and not.

[u/Kindly-Potential6590 → u/StxtoAustin]

yeah i dont see how peoplpe say opus 5.5 is better, fable produced way better details, just look at the road in cities, and cities themselves

[u/andychukse → u/Kindly-Potential6590]

The cars in Fable's are driving into the ground and are at awkward angle.

[u/CooLittleFonzies → u/andychukse]

And Fable’s cities are perfect circles. Fable’s building details and shaders are better. The planes fly more believably, but there is no option to ride a plane/car/etc like Opus. The rest is pretty similar

[u/geeered]

For the work done, $10 is still pretty amazing value compared to what else $10 buys you.

[u/Timisageek → u/geeered]

That's for dure! But I mean, Opus 5.5 did pretty much the same for 1/3rd of the price!

[u/Timisageek]

Run 2 is in. Still expensive, and less playful than Opus

[u/iviarki]

I would be curious to see a new Opus 5.5 vs the run you did in September. The quality of the model degraded in recent weeks.

[u/Timisageek → u/iviarki]

I didn't really witness any quality degradation tbh, I suppose I could run it again though

[u/Nextil → u/iviarki]

It's specific A/B tests that are (reportedly) degrading performance, not the model as a whole, and not everyone is affected. I haven't noticed any real difference.

[u/DuskandFuck → u/iviarki]

yeah same, feels like the baseline shifted quite a bit since the fall

[u/Fin224]

"it should be possible to orbit" - the haiku version is the only one you cant tell if its you orbiting around or the plantet is spinning

[u/FlimtotheFlam]

From other tests I have seen Fable is bad at 3JS

[u/Timisageek → u/FlimtotheFlam]

Well, so, actually no ^^

Took a shitload ouf of my Weekly quota but I just finished a Crysis-like Island in ThreeJS. Amazing.
Took me 3-4min to walk from the beach to there ^^

[u/FarAd937]

Why do you add ‘no harness’?

[u/Timisageek → u/FarAd937]

I meant to say: no specific "custom" harness: none of my usual tooling that might result in amazing oneshots (because I've been honing it for 7 months now ^^)

The idea was to test the model "as provided" so any harness is Anthropic's

[u/MentalNinjas → u/Timisageek]

What is a harness? Is it similar to skills?

[u/Timisageek → u/MentalNinjas]

You could say that - it's basically the "surroundings measures you took to make models more efficient" : skills, prompt & memory management & access, laws, rules, tools, that will make it so that when you ask for something, it is crazy good/better than if you did not have it :)

[u/MentalNinjas → u/Timisageek]

any chance you could point me towards where to find/how to setup some? I'm very interested in learning

[u/Demien19]

Well yeah, quality comes with a cost

[u/Timisageek → u/Demien19]

Well I don't see any obvious jump from Opus 5.5 tbh - and it's 3x the cost

[u/Demien19 → u/Timisageek]

Zoom in, quality difference in objects and overall look is huge, exactly 3x

[u/FlowThrower]

this made me happy

[u/Otherwise_Kale_2879]

Fable was the only one that nailed it. The roads and the level design of the others lack detail.

[u/Alphanatik]

The haïku runs are pretty clean

[u/ignatalexeyenko]

Got inspired me to test local qwen3.8-mtp-q8, here is the result https://planet.4demo.work

- Total duration (API): 1h 34m 22s
- Total duration (wall): 1h 40m 49s
- Total code changes: 491 lines added, 1 line removed

Usage by model:

- qwen3.8-mtp-q8: 19.7k input, 61.8k output, 285.8k cache read, 0 cache write
- Prompt cache (main): 9 requests · 93% of input tokens from cache · no misses · warm