When Does a Track Record Prove Skill? The Math Most Traders Get Wrong
A trader shows a Sharpe ratio of 2.0 over six months. With thousands of traders active at any time, some will produce exactly that result by pure chance. The standard error of the Sharpe ratio is approximately 1/√T, and that's the optimistic version assuming IID returns.
The Data Is Corrupted Before You Even Test It
Five biases distort track record data: survivorship bias, favorable-start bias, cherry-picked windows, discontinuity (gaps during drawdowns), and self-reported data. If any of these are present, statistical testing is meaningless.
Sample Size Determines What You Can Conclude
6 months (~125 days): noise. 1 year (~250 days): directional only. 2–3 years: minimum viable. 5+ years: institutional-grade. SE(SR) ≈ 1/√T.
Why the Real Numbers Are Worse
The formula assumes IID returns. Real markets exhibit autocorrelation (Lo 2002: 1.5–3x SE multiplier), fat tails, volatility clustering, and regime shifts. Realistic estimates: Sharpe 0.5 needs 25–40+ years (not 16). Sharpe 1.0 needs 5–10 years (not 4).
What a Clean Sharpe Can Hide
500 trades do not mean 500 independent observations: correlated instruments and overlapping holding periods shrink the effective sample. A strong Sharpe can rest on a handful of outsized wins. Some strategies produce smooth returns until a specific tail risk materializes, giving back years of gains in weeks.
Rejecting Sharpe = 0 Is the Wrong Question
Sharpe > 0 means better than cash, an extremely low bar. The real question is Sharpe > benchmark. Bailey & López de Prado (2012, 2014) formalized this with the Probabilistic Sharpe Ratio and Deflated Sharpe Ratio, which adjust for non-normality, multiple testing, track record length, and a non-zero benchmark.
References
- Lo, A.W. (2002). The Statistics of Sharpe Ratios. FAJ 58(4).
- Bailey, D.H. & López de Prado, M. (2012). The Sharpe Ratio Efficient Frontier.
- Bailey, D.H. & López de Prado, M. (2014). The Deflated Sharpe Ratio.
- Christie, S. (2005). Is the Sharpe Ratio Useful in Asset Allocation?