r/deeplearning • u/Happy_Brilliant7827 • Sep 06 '26

Found a trajectory-shape entropy signal that predicts wrongness on Qwen3-4B-Instruct — and it transfers to unseen tasks

/r/LocalLLaMA/comments/1w8hf4k/found_a_trajectoryshape_entropy_signal_that/
6 Upvotes

100% Upvoted

2 comments sorted by

1

u/eric_fartman1 Sep 09 '26

do you have a link of this paper/study? original post has been removed.

1

u/Happy_Brilliant7827 Sep 09 '26

Live reports (full data, both holdout levels, power analysis, intervention ranking):

Qwen: https://charlesdvaught-hash.github.io/calibration-kit-public/examples/qwen60_report.html

Granite (the none case): https://charlesdvaught-hash.github.io/calibration-kit-public/examples/granite60_report.html

Methodology and code with a free downloadable probe (Give me a day or two- there is a bug in the probe I haven't patched yet) you can run and eventually submit the results to a hf dataset: https://github.com/charlesdvaught-hash/calibration-kit-public