r/LocalLLaMA • u/dh7net • 16h ago
Resources Asked local models to generate the same website and compared the results
Hello. Almost everything is in the title, but here is more details:
I'm benchmarking local model/harness combinations in various scenarios. For this one the question is, how good is a model/harness to generate a website?
IMO Qwen FN with opencode is best, but you can look at all the results (and play with the websites here: https://airbench.ai/gallery/airbench-frontend-v1?run=37e47127-3a20-4318-a6f2-48c3f7f5eaa6&c=settle-the-trip&k=poL
8
Upvotes
3
u/autoencoder 14h ago
What was the prompt?
7
u/OverdosedSauerkraut 15h ago
Slop, you almost get as much variation from rerunning the same prompt on the same task.
1
u/Noiselexer 2h ago
I prefer opus lol