RT Journal Article
SR Electronic
T1 A Data Science Solution to the Multiple-Testing Crisis in Financial Research
JF The Journal of Financial Data Science
FD Institutional Investor Journals
SP 99
OP 110
DO 10.3905/jfds.2019.1.099
VO 1
IS 1
A1 Marcos López de Prado
YR 2019
UL https://pm-research.com/content/1/1/99.abstract
AB Most discoveries in empirical finance are false, as a consequence of selection bias under multiple testing. Although many researchers are aware of this problem, the solutions proposed in the literature tend to be complex and hard to implement. In this article, the author reduces the problem of selection bias in the context of investment strategy development to two sub-problems: determining the number of essentially independent trials and determining the variance across those trials. The author explains what data researchers need to report to allow others to evaluate the effect that multiple testing has had on reported performance. He applies his method to a real case of strategy development and estimates the probability that a discovered strategy is false.TOPICS: Statistical methods, performance measurement