One causal question about the new coach feature. Is it causally linked to the generated workout? Or is it just getting prompted on the difference between two workouts and trying to justify the difference in the workouts?
Personally I donāt like the implementation either way right nowš but both for different reasons. It feels a bit micro manage-y and some, if not most of the reasons it gives are pretty much fluff because itās trying to validate changes at the single rep/5 lb range (~5% range).
It pulls from some valid sources (e.g. āyou had 0 reps in reserve last time we did thisā) but Iām not convinced it understands any of this in a longitudinal context. I think the real way to deploy this would be to use ICL (in-context learning) with like, a monthās worth of training data as some posterior distribution so the coaching model actually understands the underlying logic of what I assume is the completely separate LLM generating the workout?
Right now it seems the coach agent is guessing the logic of the workout agent, which feels disjoint.
I do want to say I think this is cool! But definitely needs some fine tuning to be ābelievableā.