Morningstar Magazine - August/September 2018 - 45

EXHIBIT 4

Monte Carlo Simulation Results: Distributions of 15-Year LUPs
Percentiles

Incomplete

Complete

Average

5

10

25

50

75

90

95

Positive Skill

132

60

74

99

140

170

177

179

No Skill

142

73

88

115

154

174

178

179

Negative Skill

152

89

108

133

164

176

179

179

Positive Skill

115

50

60

81

114

150

170

175

No Skill

129

62

74

97

135

164

175

178

Negative Skill

140

74

89

115

148

170

177

178

Source: Authors' Calculations

This, then, is the nature of active management.
Even in the presence of skill, there can be long
periods of underperformance. To further
bolster this result, we extended the simulation
study to 100 years; here, the "skilled" manager
was very skilled indeed, with only a 5%
chance of underperforming the benchmark over
15 years. It turns out that even such an extremely
skilled manager would, on average, have
a 25-year-long stretch during the 100 years in
which they underperformed the benchmark.
It's a Long Game
These are unexpected results, both on the empirical
front and on the stylized simulation front.
Before we invest them with too much meaning,
let us clarify two things.

First, while it is true that even the good performers
can go through long stages of underperformance, this does not necessarily reflect
the experience of an investor. Even for an investor
who held a given fund through the whole
15-year period, a LUP of, say, nine years would
not be experienced as a continuous series
of worsening performance relative to the
index. There would almost certainly be ups and
downs along the way.
A more conventional analysis brings this out.
For the outperforming funds in our sample,
we calculated the percentage of three-year periods
(overlapping, with the three-year window rolling
monthly) that outperformed the index. Even
funds with an average LUP of 119 months (average

of complete and incomplete LUP averages)
outperformed their benchmark in some 65% of the
rolling three-year periods. Thus, long periods
of underperformance come with a good dose of
shorter-period outperformance within them.
Second, because of the very definition of LUP,
the severity of underperformance incurred over
the LUP is typically small. LUP is the longest
period of index underperformance. Hence, adding
just one month to the beginning or end of
the LUP would result in a period of outperformance.
Heuristically, one could say that the LUP's
cumulative underperformance is in order of
magnitude of one month's worth of a given fund's
outperformance. LUPs may clock in long
time frames, but the drawdowns incurred over
their duration are small.

given the results we presented. Investors should
not pick funds based on their three- or five-year
records. Asset-management firms should
not pay their managers based on the same periods.
And investors need to arm themselves with
a big dose of patience. Even funds with
Morningstar Analyst Ratings of Gold that beat
their benchmarks over long time periods
went through extremely long periods in which an
investor would have been better off with a
passive offering.
Active investing is a long game. K
Maciej Kowara, Ph.D., CFA, is a senior analyst with
Morningstar Research Services.
Paul D. Kaplan, Ph.D., CFA, is director or research with
Morningstar Canada. He is a member of the editorial board
of Morningstar magazine.

With all that said, the results presented here are
more than just a statistical curiosity and should
encourage investors to recalibrate their
expectations. It turns out they need to be even
more patient than we thought. Standard
performance evaluation periods-three, five, even
10 years-are far too short to make well-informed
judgments about a manager's skill or lack
thereof. Performance is just not a reliable guide to
assessing managers unless one extends the
time frame to decades.
Every prospectus and marketing piece out there
proclaims that "Past performance is
no guarantee of future performance." It seems
like no one believes it, but they should,

global.morningstar.com/Morningstarmagazine

45


http://global.morningstar.com/Morningstarmagazine

Table of Contents for the Digital Edition of Morningstar Magazine - August/September 2018

Contents
Morningstar Magazine - August/September 2018 - Cover1
Morningstar Magazine - August/September 2018 - Cover2
Morningstar Magazine - August/September 2018 - 1
Morningstar Magazine - August/September 2018 - 2
Morningstar Magazine - August/September 2018 - Contents
Morningstar Magazine - August/September 2018 - 4
Morningstar Magazine - August/September 2018 - 5
Morningstar Magazine - August/September 2018 - 6
Morningstar Magazine - August/September 2018 - 7
Morningstar Magazine - August/September 2018 - 8
Morningstar Magazine - August/September 2018 - 9
Morningstar Magazine - August/September 2018 - 10
Morningstar Magazine - August/September 2018 - 11
Morningstar Magazine - August/September 2018 - 12
Morningstar Magazine - August/September 2018 - 13
Morningstar Magazine - August/September 2018 - 14
Morningstar Magazine - August/September 2018 - 15
Morningstar Magazine - August/September 2018 - 16
Morningstar Magazine - August/September 2018 - 17
Morningstar Magazine - August/September 2018 - 18
Morningstar Magazine - August/September 2018 - 19
Morningstar Magazine - August/September 2018 - 20
Morningstar Magazine - August/September 2018 - 21
Morningstar Magazine - August/September 2018 - 22
Morningstar Magazine - August/September 2018 - 23
Morningstar Magazine - August/September 2018 - 24
Morningstar Magazine - August/September 2018 - 25
Morningstar Magazine - August/September 2018 - 26
Morningstar Magazine - August/September 2018 - 27
Morningstar Magazine - August/September 2018 - 28
Morningstar Magazine - August/September 2018 - 29
Morningstar Magazine - August/September 2018 - 30
Morningstar Magazine - August/September 2018 - 31
Morningstar Magazine - August/September 2018 - 32
Morningstar Magazine - August/September 2018 - 33
Morningstar Magazine - August/September 2018 - 34
Morningstar Magazine - August/September 2018 - 35
Morningstar Magazine - August/September 2018 - 36
Morningstar Magazine - August/September 2018 - 37
Morningstar Magazine - August/September 2018 - 38
Morningstar Magazine - August/September 2018 - 39
Morningstar Magazine - August/September 2018 - 40
Morningstar Magazine - August/September 2018 - 41
Morningstar Magazine - August/September 2018 - 42
Morningstar Magazine - August/September 2018 - 43
Morningstar Magazine - August/September 2018 - 44
Morningstar Magazine - August/September 2018 - 45
Morningstar Magazine - August/September 2018 - 46
Morningstar Magazine - August/September 2018 - 47
Morningstar Magazine - August/September 2018 - 48
Morningstar Magazine - August/September 2018 - 49
Morningstar Magazine - August/September 2018 - 50
Morningstar Magazine - August/September 2018 - 51
Morningstar Magazine - August/September 2018 - 52
Morningstar Magazine - August/September 2018 - 53
Morningstar Magazine - August/September 2018 - 54
Morningstar Magazine - August/September 2018 - 55
Morningstar Magazine - August/September 2018 - 56
Morningstar Magazine - August/September 2018 - 57
Morningstar Magazine - August/September 2018 - 58
Morningstar Magazine - August/September 2018 - 59
Morningstar Magazine - August/September 2018 - 60
Morningstar Magazine - August/September 2018 - 61
Morningstar Magazine - August/September 2018 - 62
Morningstar Magazine - August/September 2018 - 63
Morningstar Magazine - August/September 2018 - 64
Morningstar Magazine - August/September 2018 - 65
Morningstar Magazine - August/September 2018 - 66
Morningstar Magazine - August/September 2018 - 67
Morningstar Magazine - August/September 2018 - 68
Morningstar Magazine - August/September 2018 - 69
Morningstar Magazine - August/September 2018 - 70
Morningstar Magazine - August/September 2018 - 71
Morningstar Magazine - August/September 2018 - 72
Morningstar Magazine - August/September 2018 - 73
Morningstar Magazine - August/September 2018 - 74
Morningstar Magazine - August/September 2018 - 75
Morningstar Magazine - August/September 2018 - 76
Morningstar Magazine - August/September 2018 - 77
Morningstar Magazine - August/September 2018 - 78
Morningstar Magazine - August/September 2018 - 79
Morningstar Magazine - August/September 2018 - 80
Morningstar Magazine - August/September 2018 - Cover3
Morningstar Magazine - August/September 2018 - Cover4
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2024q2
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2024q1
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2023q4
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2023q3
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2023q2
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2023q1
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2022q4
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2022q3
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2022q2
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2022q1
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2021q4
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2021q3
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2021q2
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2021q1
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2020q4
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2020q3
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2020q2
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2020q1
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2019winter
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2019fall
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2019summer
https://www.nxtbook.com/nxtbooks/morningstar/magazine_2019spring
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20191201
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20181011
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20180809
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20180607
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20180405
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20180203
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20181201
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20171011
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20170809
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20170607
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20170405
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20170203
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20171201
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20161011
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20160809
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20160607
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20160405
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20160203
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20161201
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20151011
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20150809
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20150607
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20150405
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20150203
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20151201
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20141011
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20140809
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20140607
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20140405
https://www.nxtbook.com/nxtbooks/morningstar/magazine_20140203
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20141201
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20131011
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20130809
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20130607
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20130405
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20130203
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20131201
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20121011
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20120809
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20120607
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20120405
https://www.nxtbook.com/nxtbooks/morningstar/investorconference2012
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20120203
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20121201
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20111011
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20110809
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20110607
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20110405
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20110203
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20111201
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20101011
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20100809_lincoln
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20100809
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20100607_lincoln
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20100607
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20100405_lincoln
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20100405
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20100203
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20101201
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20091011
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20090809
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20090607
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20090405
https://www.nxtbook.com/nxtbooks/morningstar/advisor_20090203
https://www.nxtbook.com/nxtbooks/morningstar/advisor_2008fall
https://www.nxtbook.com/nxtbooks/morningstar/advisor_2008summer
https://www.nxtbook.com/nxtbooks/morningstar/advisor_2007spring
https://www.nxtbook.com/nxtbooks/morningstar/advisor_2007fall
https://www.nxtbook.com/nxtbooks/morningstar/advisor_2007summer
https://www.nxtbook.com/nxtbooks/morningstar/advisor_2008spring
https://www.nxtbook.com/nxtbooks/morningstar/advisor_2008catalog
https://www.nxtbook.com/nxtbooks/morningstar/advisor_2008winter
https://www.nxtbookmedia.com