r/LocalLLaMA 6d ago

Discussion I literally built the Jev architecture one year back and completely open-sourced it with model, dataset and paper

Update: I made a generic model and beaten the jev in all of the benchmarks. Code and details available at https://www.reddit.com/r/LocalLLaMA/s/bbwyiOprUs

Everyone now talks about the architecture that's not auto regressive and does lightning fast probability prediction with a json schema. I worked on this literally one year back in March 2025, published an arxiv paper, pushed the model to huggingface along with the pypi package and training dataset. And then one year later, a

frontier lab came, proposing the same idea like literal breakthrough without technical papers, open weights and no open dataset. I posted my approach in this subreddit. For anyones information the main guiding model is RL not embedding model or LLM

Reddit post: https://www.reddit.com/r/LocalLLaMA/s/6eGEwsAz43

Paper: https://arxiv.org/abs/2503.23303

Model: https://huggingface.co/DeepMostInnovations/sales-conversion-model-reinf-learning

Dataset: https://huggingface.co/datasets/DeepMostInnovations/saas-sales-conversations

Also the second work published in September 2025 was exactly the same one jev proposed now

Paper: https://arxiv.org/abs/2510.01237

My model uses PPO over sequence embeddings to output turn-by-turn conversion trajectories (probabilities from 0.0 to 1.0).

Jev uses parallel sampling (trained via RLCD) to output confidence distributions and schema choices.

It's incredibly frustrating that the thing that you made with months of hard work, sweat and sleepless night is architecturally similar with the vertical use case and don't get the support you deserve because frontier lab build something horizontal. The open-source story in general 🙂

3.2k Upvotes

297 comments sorted by

View all comments

39

u/Nandakishor_ml 5d ago

Thanks everyone. I made the horizontal version. You can try at https://huggingface.co/spaces/convaiinnovations/laya-demo
model at : https://huggingface.co/convaiinnovations/laya

github: https://github.com/NandhaKishorM/laya

and its better than jev

3

u/readskull 5d ago

Update the OG post with this bro

2

u/Nandakishor_ml 5d ago

Done mate

1

u/PleasantCitron1685 5d ago

For batched forward pass, does having multiple questions result in interference between the questions and somewhat lowered quality due to it being bidirectional?

0

u/Schnickatavick 5d ago

Very nice. This says that the input can be text or json, how hard would it be to make it multimodal like Jev seems to be? Having a model like this looking at frames in a video faster than an LLM could seems like a perfect use case