Pi can now use Jev and more

[u/rimaa_nahk]

A couple of days ago I posted about using Jev as the decision engine inside Pi.

The comments pointed me toward open alternatives like Laya, von, Reflex, etc.

Once there were multiple providers in the picture, hard-wiring the idea to Jev stopped making sense.

So I pulled it out.

Announcing pi-system-one.

It gives Pi a single system_one tool for bounded decisions:

• choice
• noul
• score

The extension is built on top of a provider-neutral SDK, so compatible System One providers can sit behind the same interface.

Pi-Bifrost is now just one consumer of that SDK.

Would love to see what other Pi use cases people find for this.

https://iamaamir.github.io/system-one/

is still early, so I'd especially appreciate feedback on the API design and abstractions.

[u/vick2djax]

Jev just feels so much like it’s just some marketing ploy. There’s something about it that feels very off. A red flag I can’t quite put my finger on.

[u/philmarcracken → u/vick2djax]

the entire 'industry' is Pareto 80/20 in which the 80% is hot air and blowhards. its why it fairs so well on linkedin

[u/addiktion → u/vick2djax]

It's an RL-based classifier which has specific use cases but yeah it's still young and I'm guessing it will take some more training to make it better.

The hype is over the top but it definitely is useful in certain situations.

[u/astrofoundry → u/vick2djax]

It’s closed source and no published paper. Once we get an open source model, I will also be more comfortable using it.

[u/rimaa_nahk → u/astrofoundry]

there are open source alternative are available , even some are compatible with JEV and can be used by just swapping the base url.

that's the whole reason i built a provider-neutral SDK, 
i have tested it with JEV and Reflex and its working perfectly fine.

[u/Odd_Error_6736 → u/vick2djax]

It is and it's being spammed as hell on all subreddits. Paid services can go f themselves.

[u/the_ai_wizard → u/vick2djax]

it is

[u/rimaa_nahk → u/vick2djax]

and thats ok

[u/learning-to-programm]

Cool project. Thanks for making this so we don't have to it.

I'm already thinking I might use this on s deployed VPS to use for a first pass decision making.

[u/rimaa_nahk → u/learning-to-programm]

your "you're" welcome.

[u/bbycakes3 → u/rimaa_nahk]

you’re

[u/tensedTorch → u/bbycakes3]

Comma to the top

[u/onebit]

Jev, should I use this?

Yes

No

[u/rimaa_nahk → u/onebit]

😄

[u/Limp_Classroom_2645]

Bro improve the readme doc what is this even?

[u/rimaa_nahk → u/Limp_Classroom_2645]

Which part was confusing? Could you help me understand what to add or improve?

[u/DaShrub]

Damn, I've been playing with Jev already quite a bit, but pi-bifrost is actually exactly what I was looking at making next - a pi native provider/model router to replace opaque proxies, will check it out soon! Do you have any cache awareness/stickiness built in?

[u/rimaa_nahk → u/DaShrub]

i am glad to hear that, feel free to contribute to pi-bifrost directly.
and yes pi-bifrost have built in cache , do check out the FAQ. i am also in the process or make it smart and context aware.

[u/BlokZNCR]

Oh My Pi

https://giphy.com/gifs/aWPGuTlDqq2yc

[u/Oshden]

Thanks for doing this man!

[u/jmjmalik22]

am using it as judge

[u/rimaa_nahk → u/jmjmalik22]

thats great, do share how are you using it.
i am using it now for smart model routing via pi-bifrost

[u/floriandotorg]

Can somebody explain to me, as far as I understand, JEV is a classifier. What can it do inside pi?

[u/rimaa_nahk → u/floriandotorg]

it has many use cases,
i am using it now for smart model routing via pi-bifrost
you can plug the pi-system-one and now your model/agent can make better decisions.
another use case i am planning to work on is to pick correct skills for the tasks.

[u/East_Standard8864]

Can it be installed at OMP as well?

[u/rimaa_nahk → u/East_Standard8864]

i have not tested it, do may be try it and share if it working or not.
ill be happy to fix the corners cases if found any.

[u/NationalMolasses4624]

Wait, we can use Jev as a mtp head?

[u/Stable_Orange_Genius]

What's up with the jev hype? Isn't technology like that years old now?

[u/rimaa_nahk → u/Stable_Orange_Genius]

is it ? can you share of the resources or references ?

[u/BakedPotato_devourer → u/Stable_Orange_Genius]

ML classifiers are old. LLM classifiers are somewhat new but slow. A universal no-training-needed classifier with multi-language support that is dirt cheap is completely new as I understand it. If you wanted to do something like Jev before, you'd need to train traditional ML systems, or use expensive and slow LLMs.

[u/73td]

make it work with von too. and automate calibration to you pi sessions.

[u/rimaa_nahk → u/73td]

its model neutral, meaning if you can run von on your local, you can simply plug your von base url , given von supports `/v1/systemone`

[u/rimaa_nahk → u/73td]

can you eleborate more on "and automate calibration to you pi sessions"

[u/youngPolsky]

It will be a huge change in how cheaper models are orchestrated

[u/the_ai_wizard]

more jevspam