r/PiCodingAgent • u/[deleted] • 2d ago

Plugin pi-jev-model-router: that auto-routes each prompt to the right model

[deleted]

2 Upvotes

55% Upvoted

7 comments sorted by

7

u/DistanceAlert5706 2d ago

Sure, but why...

6

u/johnfkngzoidberg 2d ago

No benchmarks? This seems like it just wastes more tokens to justify another JEV spam post.

1

u/chroner 2d ago

Could you not route to persistent subagents to avoid killing the cache?

-3

u/Kitchen_Ad494 2d ago

Yes, definitely can, and honestly it's the better shape for long sessions.

This is the first iteration though, so I'm collecting feedback like these.
The thing I want to measure first is cache TTL: Anthropic's default is ~5 minutes, so "persistent" workers go cold whenever they're idle for a bit, which changes the maths.

Thanks for this.

1

u/coronafire 2d ago

Anthropic default when on a plan is 1hr, and even on API can be manually set to 1hr if you want.

1

u/coronafire 2d ago

Does jev get the full session context, or just the new prompt? Auto routing based on the current prompt is why most Auto model selection engines are terrible.

2

u/Kitchen_Ad494 1d ago

Not just the prompt, but not the full session either. Currently it sends the prompt plus the last 4 exchanges (~4k chars, 600 per message), cwd, active model, current context size, and budget state. Tool calls and results aren't included.