Chapter 4
Ridge Regression
Least squares believes the data completely, and Chapter 3 showed where that leads: a player with 15 possessions rated +90. What we want is a rule that believes the data in proportion to how much of it there is, trusting 5,000 possessions of Nikola Jokić and shrugging off 15 of Colby Jones. The rule is one extra term in the objective, and this chapter is about what that term does and how to choose it.
4.1 A penalty
Definition 4.1 (Ridge regression). For a penalty \lambda > 0, in possessions, and a vector m of prior ratings, the ridge estimate minimizes
The penalty charges for every point of rating a player is given away from their prior. For now take the prior to be zero, an average player; Chapter 6 replaces it with a guess from box-score statistics. The intercept isn’t penalized: nothing pulls the league’s average toward zero.
The effect is clearest with one player. Suppose everyone else’s ratings are known, so the only unknown is player i’s offensive rating o, and let \bar r be the possession-weighted average of what’s left of the segments’ rates after everyone else is accounted for, over the n possessions player i played on offense.
Theorem 4.2 (Shrinkage). With one unknown rating, the ridge estimate is
a weighted average of the data’s estimate and the prior, weighted by possessions: the data counts as n possessions and the prior as \lambda.
Proof. The objective is \sum_s n_s (\rho_s - o)^2 + \lambda (o - m)^2, where \rho_s is segment s’s residual rate. Its derivative is -2\sum_s n_s(\rho_s - o) + 2\lambda(o - m), which vanishes when (n + \lambda) o = \sum_s n_s \rho_s + \lambda m = n \bar r + \lambda m.∎
So \lambda has units: it’s the number of possessions of data that it takes to move a rating halfway from the prior to what the data says. Figure 4.1 shows the weight on the data for three penalties. With yarapm’s \lambda = 3{,}000, Colby Jones’s 15 possessions get weight 15/3{,}015 = 0.005, and Jokić’s 5,322 get 0.64.
4.2 What the penalty does to the matrix
With all the players at once, setting the gradient of Equation (4.1) to zero gives normal equations with one change:
where the identity is zero in the intercept’s position. Adding \lambda I adds \lambda to every eigenvalue of the players’ part of A.1 If Av = \alpha v, then (A + \lambda I) v = (\alpha + \lambda) v: same eigenvectors, eigenvalues shifted. A symmetric matrix with every eigenvalue positive is positive definite, v^\top A v > 0 for every v \ne 0, which makes it invertible and makes L_\lambda a strictly convex bowl with a single minimum. That disposes of both problems from Chapter 3 at once. The two zero eigenvalues of Proposition 3.3 become \lambda, so the solution is unique: among all the ways of shifting ratings, the penalty picks the one closest to the prior. And the smallest eigenvalues, which Proposition 3.5 said were the noisy directions, rise from 3.8 to about 3,000, the dashed line in Figure 3.1. The condition number falls from 80,000 to about 100.
Figure 4.2 shows this for the pair from Section 3.6. Least squares sees a long valley: almost any split of Denver’s success between Jokić and Braun fits nearly as well, as long as the sum is right. The penalty tilts the valley toward the origin and rounds it into a bowl, and the minimum moves to where the data and the penalty balance. Jokić, who has far more possessions without Braun than Braun has without Jokić, keeps more of the original rating.
4.3 Ridge as a prior belief
There’s a second way to read Equation (4.1), and it explains why the penalty is a sensible thing to add rather than a trick.
Proposition 4.3 (Ridge is a posterior mode). Suppose the noise in Equation (3.1) is normal, and that before seeing the data we believe each rating is normal around its prior with variance \tau^2: o_i \sim N(m^o_i, \tau^2). Then the most probable ratings given the data are the ridge estimate with \lambda = \sigma^2/\tau^2.
Proof. The log of the posterior density is, up to constants, the log likelihood plus the log prior: \begin{aligned} & -\frac{1}{2\sigma^2} (r - X\beta)^\top W (r - X\beta) \\ & -\frac{1}{2\tau^2} \sum_i \left[(o_i - m^o_i)^2 + (d_i - m^d_i)^2\right], \end{aligned} which is -L_\lambda(\beta)/2\sigma^2 for \lambda = \sigma^2/\tau^2. Maximizing one minimizes the other.∎
With \sigma \approx 110 points per 100 (Chapter 3) and \lambda = 3{,}000, this says that before any games, we believe a player’s offensive rating is within \tau = 110/\sqrt{3000} \approx 2 points per 100 of the prior, give or take one standard deviation, and the same for defense. That’s a strong belief, and it’s roughly right: among the 112 players with at least 4,000 possessions in 2026, the published offensive ratings have a standard deviation of 2.0 and the defensive ones 1.7.
4.4 Choosing \lambda
A larger \lambda trusts the prior more. Too small, and Figure 3.2’s funnel comes back; too large, and every player looks average, including the ones who aren’t. Rather than reason about it, yarapm tries several and keeps the one that predicts best, by the walk-forward testing of Section 1.5.
| \lambda = 1{,}000 | 2{,}000 | 3{,}000 | 5{,}000 | 10{,}000 | |
|---|---|---|---|---|---|
| half life 365 days | 13.749 | 13.702 | 13.717 | 13.787 | 13.962 |
| half life 730 days | 13.761 | 13.704 | 13.706 | 13.752 | 13.898 |
Table 4.1 is typical of tuning results: a broad, shallow minimum. The difference between 2,000 and 3,000 is a hundredth of a point, far less than the noise in four seasons of games, so the choice within that range doesn’t matter much. What matters is the order of magnitude: a few thousand possessions, about half of a starter’s season.
Figure 4.3 shows the 2026 ratings again, now with \lambda = 3{,}000. The funnel is gone. Every player with under 500 possessions is within a point or two of zero, and the spread grows with possessions, because only players with a lot of data can earn a rating far from the prior.
But the penalty has a cost you can see at the top of the figure. Jokić’s rating falls from +14.0 to +5.2, Wembanyama’s from +13.8 to +7.4. Shrinking toward zero is right for Colby Jones and wrong for Nikola Jokić, whom no one believed was average before the season started. The cure is not a smaller penalty, which brings the funnel back, but more data and a better prior: more seasons of games (Chapter 5) and a starting guess from each player’s statistics (Chapter 6). The published 2026 rating for Jokić, with both, is +11.4.
4.5 The other unknowns
The ratings aren’t the only unknowns. Each row also carries covariates, with their own penalties:
- An intercept, the league’s average, unpenalized.
- A season offset for each season in the fit, penalized by 20,000 possessions toward zero, which lets the league’s scoring level differ from season to season (Figure 1.1).
- Home court: +1 in the rows of the home team’s offense and -1 in the away team’s, 0 at a neutral site. Unpenalized. In the April 2026 fits, it’s 0.93 points per 100 possessions each way, so home court is worth about 2 \times 0.93 = 1.9 points per 100, or close to two points a game.
- Playoffs: 1 in playoff and play-in rows. Unpenalized, and -3.71 points per 100 in the same fits: playoff offense is less efficient, as the Finals clincher of Chapter 1 suggested.
One more detail. Segments with no possessions (Figure 2.2) get no weight, but they can contain points: free throws after a substitution. Dropping them would lose two-thirds of a point a game. Instead their points are spread over everything else, as a rate on the possessions that were fit, and added to the intercept.
4.6 Solving it
Equation (4.3) is a linear system with a symmetric positive definite matrix, and it’s big: a real fit, with eight years of games (Chapter 5), has about 1,300 players and 2,700 unknowns. yarapm solves it with conjugate gradients. It never factors the matrix; it only multiplies it by vectors.2 Conjugate gradients minimizes f(\beta) = \tfrac12 \beta^\top A \beta - b^\top\beta, whose gradient is A\beta - b, over a growing sequence of subspaces, each step adding the direction A times the last. In exact arithmetic it’s done in at most as many steps as there are unknowns, and after j steps its error has shrunk by at least 2\left(\frac{\sqrt\kappa - 1}{\sqrt\kappa + 1}\right)^j, so a smaller condition number \kappa means fewer steps. Shewchuk’s An Introduction to the Conjugate Gradient Method Without the Agonizing Pain is the classic explanation. Two things make it fast. The penalty keeps the condition number small, and the system is preconditioned by its diagonal: dividing each equation by its diagonal entry puts players with 5,000 and 500 possessions on the same scale.
The other is that yarapm refits every day, and today’s answer is very close to yesterday’s. Starting the solver from yesterday’s ratings, a warm start, cuts the work: in April 2026 a fit from scratch took 29 iterations, and the next days’ warm-started fits took 25 and 20.
In the code. The solve is rapm.fit. It forms A as a sparse matrix (line 165), preconditions with its diagonal, and calls
SciPy’s cg with a relative tolerance of 10^{-8} and the previous fit as the starting
point. The zero-possession points are added to the intercept at line 183.
Most of a day’s fit is forming A, not solving with it. On February 28, 2025, the fit had 566,721 rows and 2,692 unknowns, and A was 17% nonzero. Forming it took 0.6 seconds; each multiplication by it took 1.2 milliseconds, so 25 iterations cost 0.03 seconds. Two ways to cut the 0.6 seconds are open questions for the project. One never forms A, computing Av = X^\top (W (Xv)) instead, at 11.6 milliseconds a product. The other notices that a day’s decay (Chapter 5) multiplies every old row’s weight by the same factor, so today’s A is yesterday’s times a constant plus the new day’s rows, and could be updated rather than rebuilt.
Exercises
Exercise 4.1. A rookie plays 1,200 offensive possessions, and the residual of the segments they played in, after teammates and opponents are accounted for, averages +6 points per 100. With a prior of -1 and \lambda = 3{,}000, what is the ridge estimate? How many possessions would the rookie need for the estimate to reach +4?
Exercise 4.2. Derive Equation (4.3) by differentiating Equation (4.1). Then show that the substitution \beta = m + \delta turns it into ridge regression toward zero for \delta, with r replaced by r - Xm.
Exercise 4.3. For the twins of Example 3.4, who share all n possessions, find the ridge estimates of o_1 and o_2 with priors of zero, if their combined least squares estimate o_1 + o_2 is s. How is s split between them, and why?
Exercise 4.4. The published 2026 ratings
(yarapm.ratings_daily, the last as_of_date of
season 2026) include players with every number of possessions. Compute
the standard deviation of o_rating for players with at
least 4,000 possessions. How does it compare with the \tau
\approx 2 implied by \lambda =
3{,}000? Why should the two differ?