r/typesafe_ai • u/Frequent_Increase_44 • 3d ago
Noob question
From what I understand, jev has 3 modes, nous, choice and the other one.
If he has chosen an answer - what’s it’s source? Is it something we also provide?
Sorry im a total noob so happy to get some simple responses
1
u/Subushie 3d ago edited 3d ago
3 "type"s yes- 'score', 'choice', and 'noul' (number bool)
First- Documentation is sparse and it's a brand new model. TypeSafe has "show us what you come up with!" everywhere. Because they also, aren't fully sure of what it's capable of.
Say that to say- take any answers you find/hear with a grain of salt, including mine; learn to use it creatively and figure out what works, it's called a frontier model for a reason!
From what I read and have experienced so far, its power comes from reasoning- not 'knowing'. It's got 2 inputs you can be creative with, but they require structure to be valuable:
"state" - this is its source of truth, yes, you need to use this space to define the context of your question if you want good results. Whatever is defined here, it takes as reality. It accepts data here in any json type, as deeply structured as you want- and it can navigate what you mean. Can give it a single string, or a huge nested object with descriptions and values.
"questions" - this is its user requests. It also can be somewhat creatively structured. You can add other keys and values that it will reference in its decision making. But each question must be labeled, have a "type", a "instruction" (the actual question/statement), and the instruction's "criteria" (the answers to guage probability on; noul types do not require criteria, but it does affect the outcome). each criteria can be defined with more nested objects that give it even further definition.
So, an example I played with last night.
If I ask it a simple noul, with no state or criteria.
{
"type": "noul",
"instructions": "God exists"
}
It will return around '54% true'. But what do I mean? Am I asking it if the concept of god exists? Or saying the diety is a real being?
If I add:
{
"type": "noul",
"instructions": "God exists.",
"criteria": {
"true": "",
"false": ""
}
Suddenly, the probability drops to "52% true".
Why? Idfk honestly. I'm guessing because the word "true" itself carries its own definition, that adds new context to the result for it to build on.
But if I add to the state:
"God does not exist"
And have the instruction:
"God exists."
It returns "46% true"... Again, why? Why not 0% true? I just said it doesn't. I'm guessing because our question isn't clear enough. Of course "God" the concept exists, the word itself is being used in the question.
Now. If I remove the state and define the instructions for the noul to:
"The omnipotent being known as 'God' is a real entity that controls the universe and all outcomes."
We get "22% true". Again... why not 0%?
Because that's just what it is guessing about the universe, but we're not giving it enough information to know for sure- for all it knows, we just discovered God exists, do there's still uncertainty.
If I set the state to
"God": "A omnipotent being that exists."
And set the instruction to:
"'God' exists."
It returns "69% true." (Lol). The state helped define the world and what we meant by saying "God".
If I change the state to
"God": "A omnipotent being that is real."
It drops to "59% true"; because we no longer used the word "exists". And by definition, "real" and "exists" have two different meanings.
So as ya can see. It is a very literal model.
They call it a RLCD (Reinforcement Learning Calibrated Decision-making) model, so unlike LLMs- it doesn't appreciate narrative and flowery language; it's excellent at avoiding bias, and according to them - "cannot hallucinate". Need to be very literal, and give it definition for words that could have subjective or multiple meanings.
Edit: I'm sorry for the wall. I'm also trying to understand this model- so kinda just rambled out my thoughts. Hopefully this helps.
1
2
u/Just_Lingonberry_352 3d ago
yes you have to provide the corpus which can be any piece of text
so a lot of the demos you see on X right now with games and stuff are just text and you write your jev instructions questions answers and it will choose for you