Yule’s “nonsense correlation”: Moments, density, and tests of independence for non-stationary Gaussian processes
Speaker
Philip Ernst
Professor in Finance and Risk Engineering at New York University with a joint appointment in CUSP
Abstract
In 1926, G. Udny Yule considered the following problem: given two independent and identically distributed (random walks independent from each other, what is the distribution of their empirical (Pearson) correlation coefficient $\rho_n$? Yule empirically observed the distribution of this statistic to be heavily dispersed and frequently large in absolute value, leading him to call it "nonsense correlation." This led to a formulation of two concrete questions, each of which would remain open for more than ninety years: (i) Find (analytically) the variance of $\rho_n$ as $n$ tends towards infinity (ii): Find (analytically) the higher order moments and the density of $\rho_n$ as $n$ tends towards infinity. A straightforward application of the classical Donsker's theorem shows that the limiting law for $\rho_n$ is $\rho$, with $\rho$ defined as the empirical correlation of two independent Wiener processes. In 2017, Ernst, Shepp, and Wyner closed question (i) by explicitly calculating the standard deviation of the empirical correlation of $\rho$ to be approximately .5. This talk begins where Ernst et al. (2017) leaves off. I shall explain how Ernst, Rogers, and Zhou (2025) finally succeeded in closing question (ii) by explicitly calculating all moments of $\rho$ (up to order 16). This leads, for the first time, to an approximation to the density of Yule's nonsense correlation.
I will then turn to an investigation of the fluctuations around the convergence of $\rho_n$ to $\rho$ for both standard Brownian motion and long-memory fractional Brownian motion. I will present the key elements of a surprising result of Ernst, Viens, and Yan (2025) by which the fluctuations are of order $1/n$ rather than $1/n^{1/2}$. To the best of our knowledge, these results provide the first statistical test of independence for pairs of non-stationary and non-i.i.d. Gaussian processes. We shall conclude with a discussion of some concrete applications of our work to the study of weather and climate extremes. The latter is part of our ongoing collaboration with the U.S. Office of Naval Research (2018-present).
References
Ernst, PA, Rogers, LCG, and Zhou, Q. (2025) Yule’s “nonsense correlation”: moments and density. Bernoulli, 31(1): 412–431
Ernst, PA, Shepp, LA, and Wyner, AJ. (2017) Yule’s “nonsense correlation” solved! The Annals of Statistics 45(4): 1789-1809.
Ernst, PA, Viens, FG, and Yan, S. (2025) Tests of independence for pairs of paths of non-stationary Gaussian processes. arXiv: 2510.23563.
About Speaker
Philip A. Ernst recently joined NYU as a Professor in Finance and Risk Engineering with a joint appointment in CUSP. Previously, he was Chair in Statistics and Royal Society Wolfson Fellow in the Department of Mathematics, Imperial College London. He earned his Ph.D. in Statistics in 2014 from The Wharton School of the University of Pennsylvania. His research lies at the interface of applied probability, mathematical statistics, and operations research.
Ernst’s work has been funded by the U.S. Army Research Office (ARO), the U.S. Office of Naval Research (ONR), the National Science Foundation (NSF), The British Academy, and The Royal Society. Key research honors include a 2026 Institute of Mathematical Statistics (IMS) Medallion Award & Lecture, a 2023 Lebesgue Chair, a 2023 British Academy/Wolfson Fellowship, a 2022 Royal Society Wolfson Fellowship, a 2022 COPSS Leadership Academy Award, the 2020 (inaugural) INFORMS Donald P. Gaver, Jr. Early Career Award for Excellence in Operations Research, a 2018 U.S. Army Research Office (ARO) Young Investigator Award, and the 2018 IMS Tweedie New Researcher Award. He was elected an IMS Fellow in 2025.
Before joining Imperial College London in 2022, Ernst was Professor of Statistics at Rice University, where he was awarded the George R. Brown Prize for Excellence in Teaching, Rice’s most prestigious teaching award. He presently serves as Deputy Editor of Stochastics and as Associate Editor for six journals, including Journal of the American Statistical Association, Theory and Methods and Mathematics of Operations Research. He is an elected member of IMS Council (2024-2027) and a member of the IMS Committee on Special Lectures (2024-2027).