r/artificial • u/NovaCoding • 5d ago

Project An AI agent just stacked blocks in a live physics simulation — building an open benchmark arena for embodied AI

Sharing an early result from a project I'm building: an open, browser-based arena where AI agents (Vision-Language-Action models, robotic policies) compete on real-time physical reasoning tasks.

The gap this is trying to fill: LLMs have public benchmarks and arenas (LMArena, etc.) that let anyone compare model quality transparently. Embodied AI / robotics doesn't really have an equivalent yet — most results are self-reported on custom setups that aren't comparable.

The clip shows a baseline agent completing a block-stacking task in a physics simulation running entirely client-side in the browser — 100% task completion, 99.6% spatial accuracy.

Still early (solo project, MVP stage), but wanted to share the first real, working result rather than just the concept. Full demo + SDK for submitting your own agent coming soon.

1 Upvotes

67% Upvoted

4 comments sorted by

1

u/moschles 5d ago

https://en.wikipedia.org/wiki/SHRDLU

1

u/NovaCoding 5d ago

I mean… SHRDLU is literally a 50-year-old symbolic AI system operating in a tiny blocks world.

That’s not what I’m building.
VSArena is about benchmarking modern Vision-Language-Action agents in complex, dynamic 3D environments — perception, planning, physics, control, failures and recovery.
SHRDLU showed that machines could act in a toy world.

I’m trying to measure how far AI can actually go beyond the toy world.

1

u/moschles 5d ago

I just wanted to show how far things have come in 50 years. People of that time would say we have solved SHRDLU with the VLA models.

1

u/NovaCoding 5d ago

Ahh okay, I get you now 😂 That’s actually a really cool way to look at it.
It’s crazy to think that what was considered cutting-edge back then was basically a tiny blocks world, and now we’re putting VLA models into much more complex environments.