The Limits of p‐Hacking: Some Thought Experiments

Andrew Y. Chen

Journal of Finance, 2021, vol. 76, issue 5, 2447-2480

Abstract: Suppose that the 300+ published asset pricing factors are all spurious. How much p‐hacking is required to produce these factors? If 10,000 researchers generate eight factors every day, it takes hundreds of years. This is because dozens of published t‐statistics exceed 6.0, while the corresponding p‐value is infinitesimal, implying an astronomical amount of p‐hacking in a general model. More structure implies that p‐hacking cannot address ≈100 published t‐statistics that exceed 4.0, as they require an implausibly nonlinear preference for t‐statistics or even more p‐hacking. These results imply that mispricing, risk, and/or frictions have a key role in stock returns.

Date: 2021
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (3)

Downloads: (external link)
https://doi.org/10.1111/jofi.13036

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:bla:jfinan:v:76:y:2021:i:5:p:2447-2480

Ordering information: This journal article can be ordered from
http://www.afajof.org/membership/join.asp

Access Statistics for this article

More articles in Journal of Finance from American Finance Association Contact information at EDIRC.
Bibliographic data for series maintained by Wiley Content Delivery ().