In our last research note, Mirror, Mirror on the Wall, which is the fairest Benchmark of them All?, we highlighted that investors can use factor exposure analysis to identify and select the most appropriate benchmark for a mutual fund, or even a portfolio with diverse assets.
Investors generally rely on the choice of benchmark provided by the asset manager, but these are not necessarily the most suitable as fund managers want to portray their performance in the most favourable way, i.e. there is a conflict of interests. The mantra should be “trust, but verify”.
However, instead of using factors, investors could also use sectors for creating a systematic benchmark selection process, which may seem to be more intuitive, especially when evaluating sector-focused funds.
In this research article, we will contrast sector with factor-based benchmark selection.
ARKK’s breakdown by sectors
As in the previous analysis, we use the Ark Innovation ETF (ARKK) as a case study. The ETF’s primary benchmark is the S&P 500 as per the asset manager’s factsheet. ARKK’s portfolio is highly concentrated and holds mainly growth stocks like Tesla, while the S&P 500 represents a diversified portfolio across all sectors, i.e. is unlikely the optimal benchmark.
Given this, we include the S&P 500 Growth index when conducting a simple breakdown by sector analysis. We observe there was some overlap in sectors between ARKK and the two indices, but in some cases, the ETF’s exposure was closer to the S&P 500 Growth than that of the broader S&P 500 index, i.e. utilities, industrials, or consumer staples.
Source: FactorResearch
We can highlight the differences between ARKK and the two indices by subtracting their sector exposures from the ETFs. Furthermore, we calculate the sum of the absolute differences, which shows that the S&P 500 Growth index had a smaller absolute difference, which can be interpreted as being more similar to ARKK than the S&P 500.
Naturally, this result is intuitive given that ARKK’s portfolio is primarily comprised of growth stocks that have larger weights in the S&P 500 Growth than the S&P 500 index.
Source: FactorResearch
Sector-based benchmark selection
Next, we calculate the sum of absolute sector differences of ARKK and 40 well-known indices, which highlights that the S&P 500 Growth index has the most comparable portfolio from a sector perspective given the smallest absolute difference. The S&P 500, which is the asset manager’s designated benchmark, ranks fourth on this list.
Source: FactorResearch
Factor exposure analysis
Next, we run a factor exposure analysis on the three benchmark indices, which shows that the Russell 2000 Growth index has the most similar factor exposure to ARKK. The S&P 500 Growth index has negative exposure to the value and low volatility factors like ARKK, but it lacks positive exposure to the size factor. The S&P 500 consists of large caps, compared to small and mid-caps for the Russell 2000 and ARKK.
Source: FactorResearch
We contrast the performance of ARKK and the three benchmarks over the last three years, which highlights a significant outperformance followed by a severe underperformance of the ETF.
It does appear that the trends in performance were more similar between ARKK and the Russell 2000 Growth than to S&P 500 indices. The ETF’s correlations were 0.73 to the S&P 500, 0.80 to the S&P 500 Growth, and 0.81 to the Russell 2000 Growth in the period from 2009 and 2022.
Source: FactorResearch
Outperformance versus benchmarks
Finally, we randomly select 12 actively-managed US mutual funds and ETFs where we contrast the outperformance to a benchmark index chosen by the asset manager versus the sector- and factor-based selections.
In almost all of the 12 funds the direction of the outperformance was the same, i.e. broadly speaking the manager-selected benchmarks were not inappropriate. However, the magnitude of outperformance differed significantly, which highlights that benchmark selection matters.
Source: FactorResearch
Further thoughts
Considering both approaches, should investors select benchmarks based on sectors or factors?
In the case of sector-focused mutual funds, the most appropriate index is a sector benchmark index. However, it is important to understand the factor exposure. For example, a fund manager that focuses on consumer staples but prefers small caps will be impacted by the performance of the size factor, which at times may be a larger driver of performance than the idiosyncratic dynamics of the consumer staples sector.
However, for most other mutual funds or portfolios a factor-based benchmark selection generates a more accurate result, which is supported by the entire performance attribution industry focusing on factors rather than sectors. The former are less correlated and therefore better independent variables than the latter.
KYF – Know Your Factors.
Nicolas Rabeneris founder and CEO of FactorResearch
Related articles
