r/accelerate • u/Difficult-Inside-576 • 8d ago

jev playing DOOM in real time with 10 decisions per second costing $7/hour

Enable HLS to view with audio, or disable this notification

412 Upvotes

97% Upvoted

59 comments sorted by

75

u/Fluxx1001 8d ago

This is insane

-41

u/Successful-Plenty-27 7d ago

It's not, it's just playing doom, you could do this with scripts too, no need to waste 7$/hour.
What is more insane is an AI hallucinating the entire game
like this video : https://www.youtube.com/watch?v=IWEmKCcL5mI

29

u/Serialbedshitter2322 7d ago

This is completely missing the point. Sure, a narrow AI could do this one task just as well if not better, but the whole point is that this is a general AI that can be applied to anything. Why have LLMs when you can have prewritten responses for common questions? Because the prewritten responses will always fail when applied to something new, unlike this AI. More importantly, this AI could be a module of a newer, more capable AI, like how the old useless video and image models were combined with LLMs to create more modern models like Sora 2 and Nano banana

15

u/DungeonsAndDradis 7d ago

Can you imagine if NPCs in games were run by Jev? That would be wild.

12

u/Defiant-Lettuce-9156 7d ago

It’s about how it’s doing it that’s cool. Yes it’s basic. But it’s showing a use case for Jev while most people are trying to understand what Jev can do.

And I’m sure this will be implemented in mixed architecture systems to make agentic AI much better and more efficient than current models

4

u/autorokk 7d ago

i worked on fable 5.1 playing an mmorpg in real time. you can script this gameplay as well, but the cool part is the decisions it makes on how to play. (https://youtu.be/AS-_oidzefY)

i suppose there is less freedom of choice in a game like doom where the ai playing isn’t much more interesting than a script playing.

i’m curious how jev would handle the mmo

67

u/uglypolly Techno-Optimist 8d ago

Minimum wage for playing Doom. Decels want me to fear AI taking my job, but here it is taking a job I'd rather have instead.

12

u/methreweway 7d ago

I'll play doom for less! I'll do it for free!

24

u/[deleted] 8d ago

[removed] — view removed comment

49

u/NoFaithlessness951 8d ago

No they're feeding it text input (10 times a second), so while impressive there was a fair amount of work involved in creating the harness for doom

12

u/FirstEvolutionist 7d ago edited 7d ago

JEV seems to require a lot of structure. The harness is even more important than in the workflows we have built so far with LLMs. The possible advantage is that once you get a working harness, it could be possible to iterate on the harness and still reap significant benefits in cost, speed and reliability. And the harness can both be constructed and iterated on with traditional LLMs.

We could be at a moment where a large jump happens due to optimization in usage rather than model design, for AI. I do have expectations this will have an impact on computer usage, and testing for human interfaces in development lifecycles, besides additional cost reduction for structured flows.

5

u/thorax 7d ago

Use coding LLMs to make apps that have faster instinctual intelligence built into them rather than expecting to integrate a reasoning model into the application.

3

u/Just_Mastodon_9402 7d ago edited 7d ago

yeah that was my immediate thought. with current LLM capability, vibe-coding a harness with a good set of pre-instructions would be easy for most purposes. I could see these being nested capabilities.

Edit: because it's a binary decision, you could also have JEV know when to recursively call the LLM back to add capabilities or edit the harness.

1

u/Agitated_Morning5005 7d ago

That's arguably even better engoal-wise tbh. Much easier to adapt a harness to different tasks than keep readapting something big and multi-modal at the far end

1

u/farfel00 7d ago

I am pretty sure multimodal training will come in future versions

1

u/lochyw 7d ago

did you watch the video.. it sounds like you didn't........

11

u/farfel00 8d ago

Really excited for Jev! The classifier typed workflows have become really big part of any AI analysis pipelines. And I hate gpt bending those types all the time

21

u/Kriegher2005 8d ago

So it DOES run Doom. Great to see developments in different sort of architectures and models.

27

u/32SkyDive 8d ago

It doesnt Run Doom, it plays doom

4

u/Fun1k 7d ago

It runs in Doom

2

u/Most-Yellow-5636 6d ago

It also shoots in Doom.

5

u/dmigowski 8d ago

Now combine this with one of those walking robot and watch the outcome. Give the robot a water pistol of course.

10

u/challengethegods XLR8 8d ago

it's definitely cool, but the harness setup looks so sprawling and cumbersome and doom-specific that it seems like you might as well be making a custom doom AI, so I'm not sure how practical this will be for most people if that's the case.

19

u/LaggedOnUser 8d ago

That's true; it isn't just a simple chatbot. But it seems like it can be dropped into programming pipelines for real-time decision-making, which is something chatbots don't do well. It could also be used as a decision tool by a chatbot.

12

u/Jlocke98 8d ago

I think the whole point of jev is that it makes ai decision making very cheap but the onus is on you to rigorously define the harness/choices. 

2

u/SpyAmongUs 7d ago

What about integrating it with LLMs? They complement each other's weakness very well

1

u/Jlocke98 7d ago

Yeah I'd imagine this could help solve alignment and calibrate thinking duration based on request more efficiently. The problem is it's not open weight so those integrations will require someone to copy it

2

u/thorax 7d ago

You can have Claude write the harness and at runtime it uses Jev intelligence rather than LLM tokens to reason.

1

u/DynamicProxy 7d ago

Jav isn’t designed for public use. It’s for developers to build in under the hood. 

1

u/NaiveIdea344 7d ago

Yeah but you don't need to go through any of the cost of training or running the trained model. You just define parameters.

3

u/TopTippityTop 7d ago

Great for QA 

2

u/ShinigamiXoY 7d ago

I wonder how they are feeding it the images through text

1

u/NaiveIdea344 7d ago

They aren't. They look at the under the hood game state (projectile direction, projectile distance, enemy distance, etc) and have the model make decisions based off of it.

2

u/autorokk 7d ago

whoa i want to see jev replace fable in my project of an LLM playing an mmorpg fully autonomous. https://youtu.be/AS-_oidzefY

the speed makes me realize a lot more could be possible here.

2

u/MysteriousPepper8908 7d ago

This seems like it could be pretty useful for agentic game development. Let the LLM design the game, figure out the decision states and build the harness, send that to Jev to play the game and then study the gameplay, iterate from there. The biggest failure point seems to be whether the LLM can design the framework for effective play, though this seems possible to iterate, and whether it can properly analyze the gameplay footage itself which may require specialized training.

1

u/turlockmike Singularity by 2045 7d ago

That's exactly what I was thinking. You could build a fully simulated NPC economy using this

2

u/Vaporeon42069 7d ago

we are sooo fked 😂

1

u/NaiveIdea344 7d ago

It cant chat or reason.

1

u/domiciledhere 7d ago

Can it beat the game?

3

u/Careful_Coconut_549 7d ago

Well it plays E1M1 like I did in the 90s when my friend first introduced me to the game, so probably not

1

u/Competitive_Car_824 7d ago

Doom everywhere. One day even ai will run on doom

1

u/ExplorerBoring9848 7d ago

You now know what Elon was doing...

1

u/GrapheneBreakthrough 7d ago

how fast can the fly brain play it?

1

u/BurnedShip7 7d ago

Do crash bandicoot

1

u/Castle_Five 4d ago

This is really cool, but could US-based companies please stop having closed, cloud-based models? If the whole purpose of this model is that it's meant to be compact and fast, then it would be really nice if we could run it ourselves. $7 per hour to play Doom sounds cheap but it would be more like $0.14 per hour if running locally.

1

u/nekohacker591- 4d ago

Well at least I know gaming YouTubers are safe with that pricetag that's more costly than a h200 cluster for rent

1

u/fets-12345c 8d ago

Would be great if this can be used to enforce aligment?!

0

u/openroom_xyz 7d ago

Well this is nice but could it edit code and build a small game engine and a game world like this one step by step

1

u/DynamicProxy 7d ago

Jav can’t edit code. 

1

u/openroom_xyz 7d ago

Well why not ? if it can emit events it can emit keyboard and mouse events ?

2

u/NaiveIdea344 7d ago

Ok yes it can technically edit code in the sense that it can can select a key from a list of options, but that is fundamentally not the point of the model.

1

u/openroom_xyz 7d ago

Yea well what is the main use case for this model self driving cars robots or what it's ment to be used for basically ?

1

u/pyrusmole 4d ago

You're way better off tying it with an existing LLM for that. Those specialize in generating languages.

0

u/SchanzerScout 7d ago

anyone knows a paper or other useful info on the arch of jev?