← Game Model / Model Performance

Model Performance — The Honest Scoreboard

Live Pick Record

Every pre-kickoff pick, graded against the line at prediction time and frozen — never regraded. Break-even at standard −110 pricing is 52.4%; a win rate below that loses money even while above 50%.

Bucket Totals W–L–PWin % Spreads W–L–PWin %
All picks 0 50.9% 0 50.5%
Edge ≥ 2 0 49.7% 0 52.5%
Edge ≥ 4 0 46.9% 0 48.6%
Edge ≥ 7 0 50.0% 0 51.1%
By week
SeasonWeekMarketW–L–P
20268total 3–1–0
20268spread 2–2–0
20267total 27–26–0
20267spread 30–23–0
20266total 29–26–0
20266spread 28–27–0
20265total 21–27–0
20265spread 27–20–0
20264total 26–29–0
20264spread 27–28–0
20263total 28–13–0
20263spread 23–18–0
20262total 20–16–0
20262spread 16–20–0
20261total 14–24–0
20261spread 13–25–0

Every experiment reports the model's RMSE against actual outcomes on held-out seasons next to the closing line's RMSE on the same games. If the closing line wins, there is no edge — regardless of how good training loss looks. Validation is walk-forward by season (never random k-fold). Confidence intervals come from a 10,000-resample bootstrap of the RMSE difference.

Total 2020 excluded

Model RMSE 16.51 vs Closing Line RMSE 15.79 · diff -0.72 [-0.89, -0.55] · n=3944

The closing line wins. No edge on this market overall.

Holdout Seasonn Model RMSEClosing Line RMSE Diff (95% CI)
2021 770 17.50 16.00 -1.50 [-1.97, -1.02]
2022 776 16.50 15.34 -1.16 [-1.56, -0.76]
2023 792 16.28 15.84 -0.44 [-0.78, -0.10]
2024 798 16.35 16.21 -0.14 [-0.43, +0.15]
2025 808 15.94 15.55 -0.39 [-0.71, -0.07]
Segment breakdown (potential bet filters)

conf_tier

Segmentn Model RMSEMarket RMSEModel wins?
G5vG51641 16.94 16.22 no
P4vG5594 16.57 15.87 no
P4vP41709 16.07 15.34 no

week_band

Segmentn Model RMSEMarket RMSEModel wins?
wk1-41234 16.75 16.10 no
wk5-91338 16.39 15.46 no
wk10+1372 16.41 15.83 no

wind_band

Segmentn Model RMSEMarket RMSEModel wins?
calm3215 16.61 15.99 no
10-15599 16.25 14.94 no
15-20118 15.25 14.52 no

total_band

Segmentn Model RMSEMarket RMSEModel wins?
<45552 15.41 13.84 no
45-521249 16.39 15.90 no
52-591316 16.30 15.69 no
59+827 17.70 16.96 no

fav_band

Segmentn Model RMSEMarket RMSEModel wins?
pickem-3827 17.07 15.89 no
3-71028 16.96 16.21 no
7-141015 16.81 16.35 no
14+1074 15.32 14.74 no

Margin 2020 excluded

Model RMSE 16.43 vs Closing Line RMSE 15.29 · diff -1.14 [-1.33, -0.95] · n=3944

The closing line wins. No edge on this market overall.

Holdout Seasonn Model RMSEClosing Line RMSE Diff (95% CI)
2021 770 17.14 15.59 -1.54 [-2.03, -1.07]
2022 776 16.48 15.28 -1.20 [-1.66, -0.76]
2023 792 16.06 15.20 -0.86 [-1.27, -0.46]
2024 798 16.49 15.38 -1.11 [-1.49, -0.73]
2025 808 16.01 15.01 -1.00 [-1.39, -0.62]
Segment breakdown (potential bet filters)

conf_tier

Segmentn Model RMSEMarket RMSEModel wins?
G5vG51641 16.60 15.61 no
P4vG5594 17.52 14.98 no
P4vP41709 15.87 15.09 no

week_band

Segmentn Model RMSEMarket RMSEModel wins?
wk1-41234 17.14 15.15 no
wk5-91338 15.88 15.09 no
wk10+1372 16.32 15.60 no

wind_band

Segmentn Model RMSEMarket RMSEModel wins?
calm3215 16.41 15.25 no
10-15599 16.66 15.56 no
15-20118 16.43 15.11 no

total_band

Segmentn Model RMSEMarket RMSEModel wins?
<45552 15.85 14.84 no
45-521249 16.39 15.45 no
52-591316 16.40 15.23 no
59+827 16.93 15.45 no

fav_band

Segmentn Model RMSEMarket RMSEModel wins?
pickem-3827 15.99 15.16 no
3-71028 16.23 15.07 no
7-141015 16.39 15.50 no
14+1074 17.01 15.40 no

Model Registry

VersionTargetTrained PromotedSpec hash
model_2026-10-11_v1total 2026-10-11 12:09:20 yes 4ac109ff2f4e
model_2026-10-11_v1margin 2026-10-11 12:09:20 yes 4ac109ff2f4e
model_2026-09-27_v1total 2026-09-27 12:08:35 yes 4ac109ff2f4e
model_2026-09-27_v1margin 2026-09-27 12:08:35 yes 4ac109ff2f4e
model_2026-09-20_v1total 2026-09-20 12:08:29 yes 4ac109ff2f4e
model_2026-09-20_v1margin 2026-09-20 12:08:29 yes 4ac109ff2f4e
model_2026-09-13_v1total 2026-09-13 12:07:45 yes 4ac109ff2f4e
model_2026-09-13_v1margin 2026-09-13 12:07:45 yes 4ac109ff2f4e
model_2026-09-06_v1total 2026-09-06 12:07:49 yes 4ac109ff2f4e
model_2026-09-06_v1margin 2026-09-06 12:07:49 yes 4ac109ff2f4e