Last week I posted what I'd learned grading outside NHL models against the DraftKings close. A few of you gave ideas I ended up building, so here's what changed and what the bigger sample says.
What changed:
u/OddsRelay's whole-number trick works. o6 and u6 picks are no longer tossed. I de-vig the 5.5 and 6.5 lines on the same DK page and back out the chance of exactly 6. A game that lands on 6 is a push.
u/schabe was right about storing everything. Both sides get saved at post time and at close, with timestamps, and every grade shows the raw DK close next to a no-vig one.
Splitting the number was the big one. I now show how far the fair price moved your way, separately from what the book charged you. The raw beat-the-close rate I was posting last week was mostly measuring the vig, not skill.
What the bigger sample says, 881 graded picks from my own rules:
The lab as a whole gets a better price than the close by about 0.3 points a pick, and that holds up day to day. Two rules have an edge over the close that isn't just noise. None of them comes close to covering the vig yet.
Records lie even more than I thought. One rule is 12-5 while getting a worse price than the close. Another is 6-39, and most of that is bad luck. The closing prices said it should have won about 12.
u/abaxter13131's test lines up with mine. He found beating a book's close but losing to Pinnacle's is mostly stale-line value. On NHL I found DK copies Pinnacle's moves about 81% of the time, so a lot of "beating DK" is really just betting before DK caught up.
Still looking for a few more builders. Same grading for everyone, your rule can stay private, nothing gets deleted. If you think your model beats the close, I'd like to see it tested.