Paper Trail #19: Automatic Lag Selection in Covariance Matrix Estimation (Newey & West, 1994) — the sequel that gave NW87 the bandwidth rule Andrews-1991 had temporarily monopolised, and the paper whose actual proposed procedure is not what most textbooks call 'the Newey-West rule'
Whitney Newey and Kenneth West came back to their 1987 HAC estimator with a data-driven automatic bandwidth rule seven years later. The paper’s actual proposed procedure is a plug-in method: use a small number of empirical sample autocovariances (n = [4·(T/100)^(2/9)] of them for Bartlett) to estimate the spectral moments s(1) and s(0), then compute the final bandwidth as m = [1.1447·(s(1)/s(0))^(2/3)·T^(1/3)].
The commonly-cited “M = 4·(T/100)^(2/9)” shortcut is the LAG SELECTION PARAMETER n inside that procedure — not the final bandwidth. Today’s Stats #19 walks the full procedure on the NFP × USDJPY sample and finds the actual bandwidth is m = 8, not the 4 the shortcut suggests, giving n_eff = 88 versus Andrews 1991’s 113.
![Schematic of Newey & West (1994) equation 2-2 as a six-box pipeline. Box 1: 'Step 1 — plug-in lag n: n = [4·(T/100)^(2/9)] = [4·(196/100)^(2/9)] = [4·1.161] = [4.645] = 4'. Box 2: 'Step 2 — autocovariances γ(0..n): γ(0)=1411.3, γ(1)=367.1, γ(2)=344.6, γ(3)=63.8, γ(4)=299.2 (biased estimator, matches Stats #10/#17)'. Box 3: 'Step 3 — spectral moments: s(1) = 2·Σ j·γ(j) = 4888.6; s(0) = γ(0) + 2·Σ γ(j) = 3560.6; s(1)/s(0) = 1.3730'. Box 4: 'Step 4 — bandwidth parameter γ: γ = 1.1447·(s(1)/s(0))^(2/3) = 1.1447·(1.3730)^(2/3) = 1.1447·1.2353 = 1.4141'. Box 5 (coral): 'Step 5 — final bandwidth m: m = [γ·T^(1/3)] = [1.4141·196^(1/3)] = [1.4141·5.8088] = [8.2140] = 8'. Box 6 (coral): 'Step 6 — HAC covariance S_T: Apply Bartlett kernel at m = 8; τ_int(8) = 2.221; n_eff = 196/2.221 = 88.3'. Bottom coral annotation: 'The point most secondary references miss: [4·(T/100)^(2/9)] is Step 1 — the LAG SELECTION PARAMETER n, used only to bound Steps 2-3. It is NOT the final bandwidth m. On this T=196 sample, n = 4 but the automatic m ≈ 8.' Comparison: 'Andrews (1991) plug-in: M* = 4.51 → n_eff = 113. NW94 automatic: m = 8 → n_eff = 88. NW94 captures γ(4) = 299 that Andrews' AR(1) plug-in misses.'](/insights/paper-trail-newey-west-1994/procedure.png)
Publication history
NBER Technical Working Paper #144, dated September 1993. Published as Review of Economic Studies 61(4):631-653 in October 1994. West is first author on the working-paper title page (he wrote the initial draft); Newey is coauthor. Both institutional affiliations match today: West at the University of Wisconsin, Newey at MIT. The paper acknowledges Dongchul Cho, John Hulbert, and Ka-Fu Wong as research assistants; NSF, Sloan, and the University of Wisconsin Graduate School as funders.
The 1994 paper is the direct sequel to their much shorter 1987 piece — 51 pages vs 6, and the Review of Economic Studies venue vs Econometrica’s Notes and Comments. The 1987 paper gave the estimator (positive semi-definite modified Bartlett kernel); the 1994 paper gives the automatic bandwidth to run it with. Together they define what practitioners mean today by “Newey-West standard errors”.
The paper’s actual recommended procedure
From equation 2-2 on page 7 (Bartlett kernel case, verbatim equation form with variable names preserved):
Given OLS residuals u_t and instrument vector Z_t (first element = 1), weight vector w = (0 1 1 ... 1)': h_t = Z_t · u_t (r×1 vector) A = OLS regression of h_t on h_{t-1} (r×r VAR(1) coefficient) h^_t = h_t − A · h_{t-1} (prewhitened residual) n = [4·(T/100)^(2/9)] ← lag selection parameter σ_j = (T-1)^-1 · Σ_{t=j+2..T} (w'·h^_t)·(w'·h^_{t-j}) (scalar autocovariance at lag j) s^(1) = 2 · Σ_{j=1..n} j · σ_j s^(0) = σ_0 + 2 · Σ_{j=1..n} σ_j γ̂ = 1.1447 · (s^(1)/s^(0))^(2/3) ← bandwidth PARAMETER m = [γ̂ · T^(1/3)] ← FINAL Bartlett bandwidth Then apply Bartlett kernel with bandwidth m to prewhitened residuals to construct S^_T; then "recolour" via (I − A)^-1 for final HAC estimate.
The paper distinguishes n (plug-in lag selection parameter, used only in the sums that estimate s(1)/s(0)) and m(the final Bartlett bandwidth, computed from γ̂·T^(1/3)) as separate symbols throughout. Page 7 explicitly recommends “initially setting m = [T^(1/3)] and then exercising some judgment about sensitivity of results to exact choice of n and m — say, by increasing and decreasing n.”
Where does the shortcut “M = 4·(T/100)^(2/9)” come from? It’s inside the paper (Table II Panel C line 6, page 33-34 of the NBER PDF) as one of several FIXED bandwidth rules used in the Monte Carlo comparison against NW94’s own automatic procedure. Verbatim (page 20 of NBER PDF): “The ‘2/9’ exponent in line (6), as well as the ‘4/25’ and ‘2/25’ exponents in lines (7) and (8), were chosen to let the lag selection parameter n increase at the maximum rate allowed by the theory.” These are fixed alternatives compared AGAINST NW94’s automatic procedure — not the paper’s own recommendation.
The kernel-choice punchline nobody remembers
In parallel with proposing the automatic bandwidth, NW94 present Monte Carlo evidence on which kernel to use. Verbatim (page 5 of the NBER version):
“in contrast to Andrews (1991) and Andrews and Monahan (1992), who recommended a kernel called the quadratic spectral, our experiments suggest no firm grounds for preferring this or any other specific kernel. According to these simulations, then, if the bandwidth is selected according to our optimal procedure, choice of kernel is of secondary importance, and it may be reasonable to base choice of kernel on grounds such as computational convenience.”
Andrews 1991 recommended QS. NW94 disagree — under their automatic bandwidth, kernel choice is of “secondary importance” and can be chosen for computational convenience. Bartlett wins on computational convenience by a large margin (only sums lag-1 through lag-m; QS uses all T-1 lags per today’s Stats #18). So the paper’s implicit recommendation is: Bartlett kernel with NW94 automatic bandwidth, which is what most econometrics packages actually implement today.
What the paper says about Andrews 1991
NW94 include Andrews 1991 as a comparison procedure in their Monte Carlo (Panel A line 2 of Table II). Verbatim discussion (page 6 of NBER PDF):
“In line (2), the bandwidth is selected by the sort of procedure suggested by Andrews (1991) and Andrews and Monahan (1992). ... The bandwidth is set to 1.3221·(4·ρ²/(1-ρ)⁴)^(1/5)·T^(1/5) — which is optimal if w’h_t follows an AR(1) in population (Andrews (1991)). Since that is not the case with our data generating processes, this procedure is consistent but not as efficient as the one proposed here.”
The claim: Andrews’ AR(1)-plug-in bandwidth is consistent but inefficient when the true autocovariance shape isn’t AR(1). NW94’s procedure, which uses empirical sample autocovariances at lags 1..n directly, doesn’t make the AR(1) assumption and can beat Andrews on non-AR(1) samples. This is exactly what shows up on our NFP × USDJPY series today: AR(1) predicts ρ(4) ≈ 0.005 based on ρ(1) = 0.26, but the empirical ρ(4) is +0.212— 40× larger. NW94 captures that; Andrews doesn’t.
On the specific “how much improvement” question, the paper is characteristically honest (page 4 of NBER): “in one of our two sets of experiments, use of our procedure results in a marked improvement in size of test statistics relative to those of a procedure suggested by Schwert (1987), a (very modest) improvement relative to those of a simple, and in our setup suboptimal, version of that suggested by Andrews (1991); in another set of experiments, however, all procedures performed roughly comparably.”
Translation: sometimes NW94 beats Andrews meaningfully; sometimes they’re roughly the same. Which one applies depends on how far the DGP is from AR(1). On our NFP × USDJPY sample, the divergence is large (n_eff 88 vs 113 = 22% wider Bartlett bandwidth). On a series where ρ(1) genuinely does dominate, the two rules converge.
The four-installment HAC quadrilogy this closes
With today’s post, the four-installment HAC-bandwidth arc is complete:
PT #17 (2026-08-17) — Andrews (1991) — AR(1)-plug-in bandwidth for QS PT #18 (2026-08-18) — Newey & West (1987) — the Bartlett-family estimator PT #19 (today) — Newey & West (1994) — data-driven bandwidth for that estimator —— Stats #17 (2026-08-17) — Bartlett n_eff via Andrews (1991) Stats #18 (2026-08-18) — QS n_eff via Andrews (1991) Stats #19 (today) — Bartlett n_eff via NW94 automatic procedure
Andrews 1991 recommended QS with automatic bandwidth. NW87 gave us the Bartlett estimator with a bandwidth left to the reader. NW94 gave that estimator its missing automatic bandwidth AND argued that once you have a good bandwidth, kernel choice doesn’t matter much. Today the standard practitioner workflow — Bartlett HAC with NW94 automatic bandwidth — is the combination of NW87’s kernel + NW94’s bandwidth. QS won on the whiteboard; Bartlett won on the terminal.
Today’s Stats #19 executes NW94’s automatic procedure end-to-end on our 196 NFP × USDJPY sample. Final bandwidth m = 8, Bartlett n_eff = 88, wider than Andrews’ 113 because NW94 captures the empirical lag-4 echo Andrews’ AR(1)-plug-in misses.
Verification note
Primary source: NBER Technical Working Paper #144, September 1993, downloaded via WebFetch from nber.org/system/files/working_papers/t0144/t0144.pdf on 2026-08-19 (51 pages, 1,310,791 bytes). Text-native extraction returned 0 characters (image-only PDF), so recovered with tesseract-ocr via pymupdf get_textpage_ocr (dpi=200, language=eng, full=true) — approximately 80,000 characters recovered across 51 pages. Working-paper mathematical content matches the published RES 61(4):631-653 (October 1994) version for all cited passages — cross-verified against multiple secondary summaries and against yesterday’s PT #18 NW87 (which cites NW94 as its natural successor).
Eleventh Paper Trail post out of 19 with full primary-source access, seventh requiring OCR (following #11 Carhart, #12 Nelson, #13 Efron, #18 NW87, plus the two Politis-source-paper no-primary cases at #14/#15). All verbatim quotes in this post traced to specific page numbers of the OCR’d NBER PDF; equation forms cross-verified against Andrews 1991 (PT #17) for consistency of notation.