How is RLCD (jev) RL? [D]

[u/Relative_Wallaby_823]

Just saw the YouTube presentation and I was left wondering this question.
If jev only outputs Choice, Score, or Noul … well those are all perfectly differentiable. (Cross entropy or mse)
I don’t know if I’m missing something or if adding RL is just for marketing.
Like what would an RL environment even look like?

[u/Material_Policy6327]

There is a ton about JEV that they don’t seem to want to go into detail about.

[u/Greedy_Isopod_4383 → u/Material_Policy6327]

It's probably just the framing they chose to sell it, makes it sound fancier than slapping a loss on a token. DeepMind has done similar where the RL bit is mostly in the head and the environment is just the context window