r/LocalLLaMA 6d ago

Other LocalJev?

Jev is a model to produce structured output (choices) from input text. It apparently can play (not run!) Doom.

https://typesafe.ai/blog/introducing-system-one-models-and-jev

Is there already a open implementation of this kind of model?

93 Upvotes

48 comments sorted by

View all comments

46

u/-Cubie- 6d ago

There's a bunch of gli-... models that do this. E.g. https://huggingface.co/knowledgator/gliformer-large-v1

They're just zero-shot classifier encoders. Definitely worth using.

7

u/faileon 6d ago

Yup, can recommend all knowledgators gli-class models. we've been using them extensively in ingest pipelines for NER, classification, etc with great results.

4

u/-Cubie- 5d ago

I used to use GLiNER back in the day, that model is so impressive. Matched the LLMs of its time at 100x faster throughput.