Author: Keith Allison from Hanover, MD, USA. Source: Wikipedia Commons
On Valentine’s Day 2018, late into the still frigid Hot Stove that is this year's offseason, the Orioles entered into a relationship with Andrew Cashner to the tune of two years for $16 million, much to the chagrin of some of his ex’s (Rangers) fans. Both SBNation’s site of the Texas Rangers, LoneStarBall, and beat writer Evan Grant, recommended a Cashner reunion at one point or another this offseason.
By looking at some of Cashner’s raw statistics from his 2017 campaign, it could be argued, albeit wrongly, that he was one of, if not the best, pitcher on the Ranger’s staff. For the sake of this entire analysis, I will be using data from FanGraphs. There are some data discrepancies, especially with batted ball data and WAR, between FanGraphs and BaseballReference, which is why I am only using FanGraphs data for consistency.
First, here is an awkward moment/transition into a tweet defending the first paragraph. The thread is pretty funny:
Now onto the analysis! Among qualified starters for the Rangers, pitchers with at least 70 innings pitched (IP), Cashner had a 3.40 ERA and 11 Wins, which were first and second best among the staff respectively. However, these metrics are skewed and do not tell the whole story about the competence of a pitcher. 
There are many problems with pitcher Wins as a metric of pitcher ability. You can read passionate tirades against it here and here for example. In essence, why should one pitcher be rewarded for the work of an entire team? Winning a baseball game is half the responsibility of the offense after all, and at least a quarter on the defense and relievers, so why should a pitcher be rewarded or penalized by an arbitrary stat? A pitcher can pitch a great game and still not get “the win”. For an extreme example, in 1959, Harvey Haddix of the Pittsburgh Pirates pitched 12 perfect innings against the Milwaukee Braves, only to lose the game on a two-run double by Braves’ first baseman Joe Adcock in the 13th inning. 36 batters up, 36 batter retired, yet Haddix still did not get a Win. However, I am not here to rail against wins. Instead, I want to point out how ERA can be skewed, and why luck, and the inherent randomness in baseball, can impact a player’s season. ERA stands for “Earned Run Average” and is the average of the number of “earned runs” a pitcher allows per nine innings. Not every run that crosses home plate during a pitcher’s stint on the mound counts as an “earned run” however. No, an “earned run” is any run that was fully enabled by the offensive team's production in the face of competent play from the defensive team. A pitcher has no control over the competence of his defense. There are many examples of good pitchers pitching for bad teams, and this can result in inflated ERA’s and skewed Win totals. This can be seen with Cashner, who in 2017, only had 84% of his runs allowed be “earned”, by far the lowest on the staff. What we need then, is a way to measure a pitcher’s skill, without worrying about any balls put into play that are the responsibility of the defense. Luckily, the smart people of the sabermetric community developed such a metric, lovingly known as FIP. FIP, which stands for Fielding Independent Pitching, exists to remove the effects of fielding from the equation and only look at the aspects of the game that the pitcher can control. FIP improves for each strikeout a pitcher obtains, and penalizes a pitcher for each homerun, walk, and hit batter, all weighted accordingly. This number is then divided by innings pitched, and then a FIP constant is added. The FIP constant is based on the league average FIP and the league average ERA, and is the same for all pitchers. The purpose of the constant is to scale the metric so it is similar to, and can be interpreted the same as, ERA. This means both FIP and ERA operate on the same scale, where around 5.00 is poor, 4.00 is about average, 3.00 is good, and below 3.00 is getting into Cy Young territory. If you were to compare the FIP of pitchers to their ERA, you would notice that many of them have ERAs that are close to their FIP. John Smoltz ended his career with an ERA of 3.33 and a FIP of 3.24. New Ranger Bartolo Colon has a career 4.02 ERA and a career 4.06 FIP. Pedro Martinez finished with an ERA of 2.93 and FIP of 2.91. Almost everyone finishes their MLB careers with a minimal difference between their FIP and their ERA. This can be seen even at a season wide level and will be examined in more detail later in this post. Since this is a more statistically oriented site, it is important to point out that since FIP only measures things in a pitcher’s control, its variance is smaller than that of a noisy stat like ERA. For 20 years, from 1997-2016, I calculated the FIP for each team at the end of the season and compared it to their ERA. I am able to make the assumption that the team ERA and FIP are approximately Normal because of the Central Limit Theorem. While no single team ERA or FIP across those years may necessarily be Normal, by summing them together, we can see that they are approximately Normal. For any image, right click and open in a new tab to enlarge.
The team ERA had a mean of 4.27, with a variance of 0.293. This means that ~95% of team ERAs fell between 3.19 - 5.36, or a range of 2.17. The team FIP, on the other hand, had a mean of 4.17, with a variance of only 0.177. This means that ~95% of team FIP’s fell between 3.38 - 5.00, or a range of 1.62. The distribution of team FIP is much narrower than that of team ERA. By building a linear regression between FIP and team runs allowed, we can also see that FIP is a decent predictor of runs allowed. The correlation is a high 0.872, with an R^2 value of 0.761.
Sure, but no team would field a pitching staff of only Andrew Cashners, I hear you muttering. Don’t fret my faithful reader, I narrowed my population down to just single pitchers with over 120 IP per season between 1997-2016 and compared their FIP to ERA. The results are below.
Again, we can see that the distribution of pitcher FIPs is much narrower than that of pitcher ERAs, due to a smaller variance. Pitcher ERA had a mean of 4.12 with a variance of 0.79. 95% of pitcher ERAs fell between 2.35 - 5.9, or a massive range of 3.55. FIP, on the other hand, had a mean of 4.15, with a variance of 0.51. 95% of pitcher FIPs fell between 2.72 - 5.57, or a range of 2.85. If you were wondering, the correlation with pitcher runs allowed was only .46, with an R^2 of 0.21. This is because there is much more inherent randomness within single pitcher runs allowed than an entire team, and one statistic can only explain so much variance. ERA only had a correlation of .60 with runs allowed, with an R^2 of 0.36, which is odd if you think about it, since ERA is supposed to encapsulate the damage of runs allowed.
By looking at the difference between FIP and ERA, we can see if the above observation that ERA and FIP tend to converge is true. For those of you who already compared the means for pitcher ERA and FIP, we can already make that assumption.
The mean of the difference FIP - ERA is .02, quite close to 0, with a variance of 0.32. 95% of the difference in pitcher FIP and ERA fell between -1.11 and 1.16. With this knowledge then, we can come to the conclusion that a large difference between a pitcher’s ERA and FIP is probably unlikely, and the probability of a pitcher’s ERA outperforming their FIP multiple times is nearly zero.
Since the mean of the difference is essentially zero, we can also assume that over a large enough sample size, ERA and FIP will converge. While monthly ERA and FIP might differ, or even whole seasons, over the course of a career or multiple years, we would expect to see such convergence in the two metrics. This is a phenomenon known as regression towards the mean. What does all of this have to do with Andrew Cashner? Well, here are his ERA, FIP, and FIP-ERA stats from 2013-2017:
One of those years is not like the others. His average FIP – ERA from 2013-2016 is -0.025, essentially 0. That obviously changes in 2017.
In fact, Cashner’s whopping 2017 FIP – ERA of 1.21 is so large, the probability of it occurring was only 2%! Only around 40 single season pitchers in the 20 years examined, out of a total population of approximately 2,000 qualifying pitchers, had a difference that high. The likelihood of Cashner outperforming his FIP by such a margin again in the future is thus minuscule.
For his career, Cashner has a 3.8 ERA and a 3.99 FIP. In 2018, we should expect a regression towards those statistics as well as a closer career ERA and FIP. In fact, his FIP might outperform his ERA to cancel out the extreme difference of 2017.
So what could explain such a discrepancy? Well, two metrics that strongly signify luck benefitted Cashner in 2017. These were BABIP and HR/FB%. BABIP is the batting average of balls in play, and usually hovers around .300. A pitcher that strongly outperforms their career BABIP is likely to regress the following season. Further, HR/FB% measures the percentage of flyballs that turn into homeruns. The league average is around 10%, and again, outperforming this metric strongly implies regression the next year. BABIP and HR/FB% are two metrics a pitcher should not be able to control. For example, Clayton Kershaw had a HR/FB% of 15.9%! This is well above his career average, and so we should expect this value to drop tremendously next season. But don't take this from me; here is what FanGraphs has to say on BABIP: BABIP is likely even more important when evaluating pitchers because they have almost no control over what happens to a ball once it is put in play. A pitcher can control their strikeouts, walks, and home runs, and through those, the number of balls they allow to be put into play, but once the ball leaves the bat, it’s out of their hands. As a result, pitcher BABIP is heavily influenced by defense and luck, which means the number of hits a pitcher gives up is influenced by things outside of their control.
For this reason, we are more inclined to expect a pitcher’s BABIP to look more like league average, or at least their career average, in the future than whatever number they might have for the current season because pitcher BABIP over the course of one season has little predictive power. Even if it does have a little predictive power, it is likely not a matter of skill. Here is what FanGraphs has to say on HR/FB%:
While pitchers can control (to a certain extent) the type of batted balls hit against them, there is less skill involved when considering whether a long fly ball is hit into the seats or to the warning track. For example, pitchers who throw in a home ballpark with short fences will tend to have a higher HR/FB ratio than pitchers who throw in large ballparks. Pitcher HR/FB ratios have also been shown to vary considerably from year to year, meaning they have limited predictive value.
Here are Cashner's advanced pitching stats for his career:
Cashner had a 0.26 BABIP in 2017, where his career is 0.290, and a HR/FB% of 8.6%, to a career rate of 10.6%. These numbers are further confounded when taken with the context that Globe Life Park is a hitter’s park, second only to Coors Field in run park factor. The Rangers staff had an average HR/FB% of 13.4%, and an average BABIP of 0.275, although that is skewed by Martin Perez. 
We can also see from the graph below that a 0.26 BABIP is quite rare from pitchers over the 20 year sample defined above, further indicating a high probability of regression in 2018 due to its lack of predictive value as a statistic. 
Finally, here are two charts, provided by FanGraphs, that show Cashner’s career ERA/FIP and BABIP/HR/FB%. BY looking at the years 2013-2017, it is evident he outperformed his true ability last season and regression is unfortunately inevitable.
In summary, Cashner had fewer balls in play fall for hits, and less fly balls turn into homeruns than expected, as seen by other pitchers on the Rangers' staff. Further, the probability of Cashner’s ERA outperforming his FIP, which measures only things the pitcher can control, by such a large margin again is slim to none. These differences indicate Cashner had a lucky 2017 campaign, and his metrics are unsustainable for future play. These lucky seasons are expected to happen, as that is part of the wonderful randomness of baseball, but a repeat is highly unlikely. If you want a different argument for why Cashner will regress in 2018, I highly recommend The Orioles Are Paying Money to Andrew Cashner, by Jeff Sullivan. Here, Jeff looks at Cashner’s plummeting strikeout percentage, and his xFIP, a more fancy and predictive version of FIP accounting for a player’s HR/FB%. What do you think? Will Cashner help the Orioles in the AL East and force Rangers’ fans to inwardly groan? Or will he regress closer to his career norms? Let me know in the comments! I know I at least won’t be drafting him for my fantasy team this year… As always, my code and analysis can be found on GitHub. The SaberSmart Team P.S. While you're here, why not subscribe to be notified by email of all future articles and news? Thanks!
Comments
|
Archives
July 2019
Categories
All
|
RSS Feed