October 9, 2009
To investigate whether observation 2) can be replicated the authors use a unique simulation methodology. They construct a parallel null-hypothetical data set of returns that are as much like the actual returns as possible, but in which—by construction—no fund has a positive alpha and no positive-alpha performance is ever persistent.
They do this by scrambling the months. There are 273 months in their time period January 1984 through September 2006. The authors construct 10,000 randomly-scrambled 273-month periods by sampling (with replacement) from those months. For example, the first scrambled series might be October 1993, February 2001, March 1988, …, etc.
Their new data set now contains the same monthly data as the original, but with the months scrambled. Also, each fund’s monthly alpha is subtracted from its monthly return to force each new fund’s alpha to be zero.
This artificially-constructed data set adheres to 1) and 2) above. Even so, funds will randomly produce alphas. The alphas for the randomly constructed data set will have a distribution.
The authors compare that distribution with the actual alpha distribution for the un-doctored data. If the two distributions are nearly the same, it can be concluded that 1) and 2) hold for the real-life data also.
Results
The authors find that the two distributions are almost the same, though not quite. The real-life data set has a slight tendency toward more negative alphas on the lower tail of the distribution, and an even slighter tendency for more positive ones on the upper tail. That is, there is a statistically insignificant tendency for poor performance to persist and an even less significant tendency for good performance to persist.
The authors reference and compare their study with some prior studies. Unfortunately they do not reference or discuss the Wermers et. al. study covered recently in this space. In that study, the authors found “a significant proportion of skilled (positive alpha) funds prior to 1996, but almost none by 2006.” It would be interesting to know if Fama and French found a similar progression in their time period.
The caveat
Relegated to an Appendix is an important detail. Fama and French performed the same bootstrap simulations again, but this time calculated alphas using only the CAPM model—that is, they regressed returns only against market returns. In this case, the tests “produce what seems like strong evidence that some fund managers have sufficient skill to cover their costs.”
The addition of the extra factors in the regression—for small stocks and value stocks—is what caused the resulting alphas to show little evidence of manager skill. Fama and French say, however, that adding the small stock (and momentum) factor has only a minor effect on the estimates of alpha. Therefore, the difference between showing that managers can beat the market and that they can’t lies in adding the value stock factor.
To put it simply, you would have achieved alpha relative to the CAPM model if you tilted toward value stocks. But you get no alpha if value stocks are considered to be merely an added risk factor. This effect has, of course, been documented by Fama and French before. The debate continues as to whether the value stock effect occurs because value stocks are risky in some way that is not revealed by their market betas, or whether value stocks are a true alpha play—and if the latter, whether this effect, observed robustly in historical data, can continue.
Display article as PDF for printing.
Would you like to send this article to a friend?
Remember, if you have a question or comment, send it to .