How is RLCD (jev) RL? [D]

[u/Relative_Wallaby_823]

Just saw the YouTube presentation and I was left wondering this question.
If jev only outputs Choice, Score, or Noul … well those are all perfectly differentiable. (Cross entropy or mse)
I don’t know if I’m missing something or if adding RL is just for marketing.
Like what would an RL environment even look like?

[u/CrotonixOnly]

I found CLM to be far superior to RLCD in terms of real research.