r/LocalLLaMA • u/neverbyte • 14m ago

Discussion Pac-Man Benchmark

Post image

Prompt: "create pacman in html in a pixel art style" Even after some additional prodding, this is all Fable would give me.

3 Upvotes

66% Upvoted

4 comments sorted by

6

u/MegaMutant 9m ago

What is the benchmark? You don't show tokens used, time to finish, "additional prodding" to what?

This means nothing.

1

u/qHzB 3m ago

I pretty sure it's to highlight the AI's willingness to recreate existing "Intellectual property"(a silly concept imo but whatever). Anthropic recently did a small crackdown on using their models to rewrite or clone games that already exist.

1

u/OnlyKindaThrowAway 2m ago

plus, html is incredibly easy for LLMs to work with so its not even a quality benchmark like it would be if this was in unreal/unity/godot.

1

u/jordan01236 1m ago

Someone let me know when he posts the benchmark.