Cointegration and pairs trading — mean reversion you can hunt for

Correlated returns, drifting prices

Correlation (A2-08) lives in return space: do the two series zig together day by day? Cointegration lives in price space: is there a combination of the two prices that never wanders off? The two properties are genuinely independent:

• Correlated but not cointegrated: two tech stocks zig together daily (ρ ≈ 0.7) while one compounds 20% a year and the other 5%. The daily dance is synchronized; the price gap still goes to the moon.
• Cointegrated but weakly correlated: a stock and its dual-listed twin on another exchange can have noisy, modest daily return correlation while arbitrageurs yank the price gap back to pennies every time it opens.

If you trade the gap between two prices, return correlation is the wrong safety check. You need the stronger property.

Cointegration: a stationary combination of non-stationary things

From D1-03: individual prices are non-stationary — unit roots, no fixed mean to revert to, ADF fails to reject. Two price series $y_t$ and $x_t$ are cointegrated if some linear combination

$z_t = y_t - \gamma\, x_t$

is stationary. Each series wanders like a drunk, but they're two drunks handcuffed together: each path is unpredictable, the distance between them is not. The spread $z_t$ has a fixed mean, finite variance, and mean-reverts — everything the D1-03 toolkit certifies, and everything the D1-04 machinery can then exploit. Economically the handcuff is usually an arbitrage force: dual listings, share classes, an ETF versus its basket, refiner versus crude — someone with size gets paid to close the gap, so the gap closes.

Engle–Granger in two steps

The classic test for cointegration is almost embarrassingly simple:

1. Regress $y$ on $x$ by OLS (A2-06). The fitted slope $\hat\gamma$ is the hedge ratio — how many units of $x$ offset one unit of $y$.
2. ADF-test the residuals (D1-03). The residuals are the spread $z_t = y_t - \hat\gamma x_t$. If ADF rejects a unit root in $z$, the pair is cointegrated: you found a stationary combination.

One honest technicality: because $\hat\gamma$ was fitted — OLS chose the combination that looks most stationary — the ADF critical values must be stricter than the off-the-shelf ones (statsmodels' coint handles this). The two-step structure, though, is exactly regression plus the stationarity test you already know.

Trading the spread

Once $z_t$ is certified stationary, it's an AR(1)-style mean reverter and all of D1-04 applies to the spread: estimate its $\phi$, get a half-life — the practical timescale of the trade. Half-life of 8 days: tradeable. Half-life of 8 months: your capital ages while the spread thinks about it.

The playbook: compute the spread's z-score $(z_t - \bar z)/\sigma_z$. When it stretches beyond about ±2, short the rich side and buy the cheap side in the ratio $\hat\gamma$; exit near zero. The position is (roughly) market-neutral — you're long and short similar exposure — so the P&L comes from convergence, not direction. This is the cleanest expression in the whole curriculum of trading a statistical property rather than an opinion.

Honest warnings

• Cointegration breaks. The handcuff is economic, and economics changes: a merger, a business-model pivot, a regulation. The most infamous blowups in stat-arb history were "temporary" divergences that were actually regime changes (D1-10). A spread that is 6 sigma wide is either the trade of the year or a pair that has stopped being a pair — the statistics alone cannot tell you which. Use stop-losses sized to the possibility that the relationship is dead.
• In-sample hedge ratios overfit. $\hat\gamma$ fitted on 2019–2022 is not the true $\gamma$, and the spread built with it looks more stationary in-sample than it will behave out-of-sample (the D1-06 ratchet in a new costume). Re-estimate on a rolling basis and check stability.
• Scanning is multiple testing. Test 1000 pairs at the 5% level and ~50 "cointegrate" by luck (A2-05, and Harvey–Liu–Zhu's factor-zoo warning applies verbatim to the pairs zoo). Demand an economic reason the pair should be linked before the test, not after.

Try it

Build the two objects everything above rests on — the hedge ratio (a regression slope via the covariance formula from A2-06) and the spread:

Map it

On paper, draw a concept map linking: unit root (D1-03), return correlation (A2-08), OLS slope (A2-06), hedge ratio, spread, ADF test, stationarity, AR(1) half-life (D1-04), z-score entry, and regime break. Arrows should say things like "tested by", "computed as", "applies to", "kills".

Predict before the next lesson

Next is D1-10: regimes and structural breaks — the lesson every warning above has been pointing at. Predict: you fit one GARCH persistence and one pairs hedge ratio on 2005–2024 pooled data. Name two historical events inside that window that plausibly changed the true parameters mid-sample. What would the pooled estimate be a blend of?