Nike’s Fastest Shoes May Give Runners an Even Bigger Advantage Than We Thought – The New York Times

Nike’s Fastest Shoes May Give Runners an Even Bigger Advantage Than We Thought  The New York Times

Anyone who saw Eliud Kipchoge of Kenya break the two-hour marathon barrier in October very likely saw something else, too: the thick-soled Nike running shoes on his feet, and, in a blaze of pink, on the feet of the pacers surrounding him.

Photograph by Joe Toth/The INEOS 1:59 Challenge via AP; illustration by The New York Times

These kinds of shoes from Nike — which feature carbon plates and springy midsole foam — have become an explosive issue among runners, as professional and amateur racers alike debate whether the shoes save so much energy that they amount to an unfair advantage.

A new analysis by The New York Times, an update of the one conducted last summer, suggests that the advantage these shoes bestow is real — and larger than previously estimated.

At the moment, they appear to be among only a handful of popular shoes that matter at all for race performance, and the gap between them and the next-fastest popular shoe has only widened.

We found that a runner wearing the most popular versions of these shoes available to the public — the Zoom Vaporfly 4% or ZoomX Vaporfly Next% — ran 4 to 5 percent faster than a runner wearing an average shoe, and 2 to 3 percent faster than runners in the next-fastest popular shoe. (There was no meaningful difference between the Vaporfly and Next% shoes when we measured their effects separately. We have combined them in our estimates.)

How Vaporflys and Next% shoes compare with other popular running shoes:

This difference is not explained by faster runners choosing to wear the shoes, by runners choosing to wear them in easier races or by runners switching to the shoes after running more training miles. In a race between two marathoners of the same ability, a runner wearing these shoes would have a significant advantage over a competitor not wearing them.

The shoes, which retail for $250, confer an advantage on all kinds of runners: men and women, fast runners and slower ones, hobbyists and frequent racers.

Many other brands, including Brooks, Saucony, New Balance, Hoka One One and Asics, have introduced similar shoes to the market or plan to. These shoes may provide the same advantage or an even larger one, but most do not yet appear in sufficient numbers in our data to measure their effectiveness.

The shoes’ effect when we restrict our analysis to …

Statistical
models
Shoe
switchers
Matched
pairs
Chance
of P.R.
Everyone 4% 5% 5% 73%
Men 4% 5% 5% 73%
Women 4% 4% 4% 74%
Marathons only 4% 5% 5% 73%
Half marathons only 5% 4% 5% 75%
Fastest runners 3% 4% 3% 74%
Fast runners 4% 5% 5% 73%
Slower runners 6% 6% 6% 71%
Enthusiastic runners 4% 4% 5% 66%
Logged training miles 3% 4% 2% 68%

The subset of fastest runners are those whose average time meets the 2018 time-qualifying standards for the New York marathon; fast runners are those whose average time is within 25 percent of those standards or faster; slower runners are those whose average time exceeds 25 percent above those standards. Enthusiastic runners are those with at least four completed marathons or four completed half marathons in the data. Logged training miles is the subset of runners who logged training miles in Strava in the four months before the race date.

These findings are based on more than twice the data that produced our previous estimates. Our data now includes results from more than a million marathons and half marathons combined since 2014.

Data coverage

More important, nearly all of these new results take place in a world in which runners had begun to wear these shoes in large numbers. In this period, an overwhelming share of runners — particularly faster ones — reported switching to these shoes, presumably looking for any edge they could get on race day.

Consider that in the final months of 2019, about 41 percent of marathons under three hours were reported to have been run in these shoes (for races in which we have data):

Share of sub-3-hour marathons with runners reporting wearing Vaporflys or Next%

Among races where shoe information was reported

What makes these shoes different is, among other things, a carbon-fiber plate in the midsole, which stores and releases energy with each stride and is meant to act as a kind of slingshot, or catapult, to propel runners. The shoes also feature midsole foam that researchers say contributes to increased running economy.

Whether the shoes violate rules from track’s governing body, World Athletics, depends on how one interprets this sentence from its rulebook: “Shoes must not be constructed so as to give athletes any unfair assistance or advantage.” It does not specify what such an advantage might be.

“We need evidence to say that something is wrong with a shoe,” a spokesman for the governing body, then called the I.A.A.F., told The Times last year. “We’ve never had anyone to bring some evidence to convince us.”

In an announcement earlier this year, the group said, “It is clear that some forms of technology would provide an athlete with assistance that runs contrary to the values of the sport.” It has since appointed a technical committee to study the shoe question, and to make a report with recommendations. (The report was originally intended to be released to the public by the end of the year; it will now reportedly be released in 2020.)

When we asked Nike last year about whether its shoes might violate I.A.A.F. rules, a spokesman said the shoe “meets all I.A.A.F. product requirements and does not require any special inspection or approval.”

On Thursday, the company said in a statement, “We respect the I.A.A.F. and the spirit of their rules, and we do not create any running shoes that return more energy than the runner expends.”

Where the data comes from

Race information

Finish time

Self-reported

shoe information

Race information

Finish time

Self-reported

shoe information

Finish time

Race information

Self-reported

shoe information

A sample Strava race report

There is no such thing as a large-scale randomized control trial for marathons and shoes, but there is Strava, a fitness app that calls itself the social network for athletes. Nearly each weekend, thousands of runners compete in races, record their performance data on satellite watches or smartphones, and upload their race data to the app. This data includes things like a race name, finish time, per-mile splits and overall elevation profile. And about one in four races includes self-reported information about a runner’s shoes.

In all, this data includes race results from about 577,000 marathons and 496,000 half marathons in dozens of countries from April 2014 to December 2019.

How we measured the shoes’ effect

[These approaches are essentially identical to the ones The Times used last summer. See that article for more examples and methodological details.]

We measured the shoes’ performance using four different methods — each with its own strengths and flaws:

None of these approaches are perfect, but they all point to the same conclusion: Something is happening in races with the Vaporfly and Nike Next% shoes that is not happening with most any other kind of popular shoe.

Method 1: Using statistical models

Estimated change in race time, compared with a previous result, when switching shoes

Best guess

95% confidence interval

Some shoe names have been shortened.

Besides race times and the names of shoes, we also have data on runners’ gender and approximate age. For some of the more serious runners, we have detailed information about their training volume in the months leading up to a race. We also know about the weather on race day.

When we put this information into a statistical model, times associated with Vaporfly and Next% shoes are a clear outlier — about 2 percent faster than with the next-fastest shoe. The model estimates the effect of wearing these shoes compared with the effect of wearing other shoes.

No statistical model is perfect, and it’s possible that runners who choose to wear Vaporfly or Next% shoes are somehow different from runners who do not. Regardless of the decisions that went into this model — even when trying to control for runners’ propensity to wear the shoes in the first place — the outputs were similar.

Method 2: Comparing groups of runners who completed the same two races

Average change among shoe-switchers compared with nonswitchers

Best guess

95% confidence interval

Some shoe names have been shortened.

Strava is very popular among runners. At last year’s Berlin Marathon, for example, more than 10,000 runners uploaded race information to Strava, and this year, more than 14,000 did. Crucially for our purposes, about a thousand of those runners ran both races, and a subset of them reported racing in different shoes.

We could then examine the change in performance of two similar runners — people with similar race performances and, ideally, training regimens — and compare the improvement of a runner who switched shoes with a runner who did not. In Berlin, runners who switched to Vaporfly or Next% shoes improved their times more than runners who did not, on average.

For two athletes and a single pair of races, this might not tell us much. But in our data, there are thousands of instances when pairs of runners ran in the same two races.

When we perform this calculation for every pair of races in our data and measure the effect of switching to any kind of popular shoe, we see that runners who switch to these Nike shoes improved significantly more than runners who switched to any other kind of shoe. No other shoe comes close to having the same effect.

Method 3: Following runners as they switch to a new kind of racing shoe

Median change in race time when runners switch shoes

Best guess

95% confidence interval

Includes only runners who switch from one shoe to another, rather than switching from not reporting shoes at all to reporting them. Some shoe names have been shortened.

More than 110,000 athletes uploaded data for more than one marathon, and about 47,000 uploaded data for three or more marathons. The Strava data allows us to follow these repeat racers over time and as they change shoes.

When we aggregate the change in race times for runners the first time they switch to a new pair of shoes, runners who switched to Vaporflys or Next% shoes improved their times more than runners who switched to any other kind of popular shoe.

Method 4: Measuring the likelihood of a personal best

Likelihood of a personal record when switching to …

Best guess

95% confidence interval

*Among runners who have run two or more marathons or half marathons. Some shoe names have been shortened.

Race times are, in many ways, a crude way to measure performance. One marathon may be hilly or full of sharp turns; others may be flat and straight. Weather, too, is important, with higher temperatures typically resulting in slower times. And yet race times are how runners qualify for prestigious races, like the Boston Marathon, and most runners know their personal best times by heart, regardless of whether the race they ran was flat or hilly, on a hot day or a cold one.

We can follow the runners in our data with this measure in mind, testing whether a runner’s fastest time is more likely when he or she switches to any kind of shoe.

Someone can run a personal best for all kinds of reasons unrelated to shoes. A runner may train more, execute a better strategy on race day or run an easier course. Regardless, we found that runners who switched to these shoes were more likely to run their fastest race than runners who switched to any other kind of popular shoe.