Playoff Odds & The Value Of Volatility
Given the sheer quantity of high-risk/high-reward pitchers on the market this winter, there's been quite a bit of discussion regarding whether it's better to sign perceived consistency or volatility. I'm not feeling very creative at the moment, so something something something here's a link to Athletics Nation. The highlight of that thread is the following chart:
You'll want to pay attention to the red curve. This curve is showing a team's calculated odds of making the playoffs versus the same team's number of Pythagorean wins. It's a logistic curve, which, when you think about it, is to be expected - we would assume that the impact of a single additional win on playoff odds starts low, gets bigger, gets huge, and then gets smaller again as we move from 0 towards 162. This is why the marginal value of an extra win through player acquisition is bigger right now for the Mariners than it is for, say, Kansas City. That extra win means a ton for the M's, because they're (projected to be) hanging out right around where the slope is the steepest.
Where this gets fun is in plugging in hypothetical examples. For example, consider one question the M's may have faced recently: Jarrod Washburn or Ben Sheets?
Obviously we can't make perfect projections, but the idea behind the question is simple consistency vs. volatility, so let's work with that. Let's call the Mariners an 86-win team, right now. Let's say (HYPOTHETICALLY) that Jarrod Washburn is worth 2 additional wins 100% of the time. And let's say that Ben Sheets is worth 4 additional wins a third of the time, 2 additional wins a third of the time, and 0 additional wins a third of the time. The average for each pitcher is +2. But which would be of more help to the team?
Washburn: +12% improvement
Sheets: +13% improvement
Jarrod Washburn would, in this hypothetical example, always take the Mariners from 23% to 35%. But Sheets, while having the potential to get injured and not pitch, would sometimes take them to 35%, and sometimes take them to 50%. So the additional wins a healthy Ben Sheets could contribute would cancel out the effect of his potential worst-case scenario.
If Washburn represented a 1-win improvement 100% of the time, his impact would be +6%.
As any idiot can tell, this is far from definitive. The playoff odds shown in the chart are averages and in no way take into account different divisions, and we also have no way of predicting the likelihood of different-WAR seasons for different players. It's all theory and guesswork. But what's neat is that it doesn't require much of a leap to uncover the take-home message that, generally speaking, ~.500-ish teams should err towards volatility, while 90+ win teams should err towards consistency. Look at the A's. Let's say the A's were, I dunno, an 80-win team pre-Sheets. Now, Sheets might blow up and contribute zero value, but the longer he stays healthy and the more value he provides, the higher the team climbs on that curve, at an accelerated pace. Sheets gives them a chance, and even if he doesn't work out, it's not that big of a deal, because the team was unlikely to go anywhere anyway. In that regard, he's a good risk. A better risk than he might've been for a division favorite.
I dunno. It's a fun chart, and also an intuitive one, meaning it doesn't exactly tell us anything we didn't already know. But it's nice to have a visual. And yes, I suppose I should take this opportunity to state that, while Washburn isn't the sort of pitcher I want to add, he would definitely help, as we are right in that area where every win is important. I don't really want the M's to go that route, but I can see why they would.
1 recs |
25 comments
|
Comments
Washburn would also carry a risk factor
It might not be as high as Sheets but he failed to perform during his Tigers portion of last season and is not risk free. A Piniero or Garland type would be less of a risk if they were still available.
I think Piniero would be more of a risk
since he used to suck, and suddenly had one magic season of not sucking. Washburn has always been pretty meh, and his skill-set didn’t really change at all last year, just the defense behind him.
Numbers, you say? Washburn was worth 4.5 WAR in 2002, and since then has been 1.7, 2.0, 2.4, 1.9, 1.9, 1.3, and 2.1. Piniero, on the other hand, was Washburn-esque once upon a time (2.6, 3.8, 1.9, and 2.2 from 2002-2005), started sucking (0.6, 0.6, and 0.9 from 2006-2008), and then suddenly put up a 4.8 WAR season. I think the risk that Piniero met a genie or something is comparable to the risk that Washburn breaks.
Garland is just a slightly better Washburn.
by I Lick Squirrels on Feb 1, 2010 2:13 AM PST up reply actions
Well, if we're going to turn this post into a trade deal...
Garland, Piniero, and Sheets are out. As interesting as these stats are, it’d be more useful to discuss signing Washburn. So what do you guys think? Will the M’s sign Washburn? It certainly seems like Jarrod wants to come back to Seattle, seeing how he already turned down the Twins $5 million contract. Honestly at this point, I don’t see what Washburn thinks he’s going to get that’s any better than that, but let’s just say ‘hypothetically’ that the M’s sign Washburn to a one year deal. Where do you put him in the rotation, assuming the rotation thus far is Felix, Lee, RRS, Snell/French/Vargas/Fister.
by katherinekiyoko on Feb 1, 2010 8:56 AM PST up reply actions
One question...
Would we have a better chance of making the playoffs if we hired this guy?

Or would this guy be better?

(just kidding)
Dude. Everyone knows what Damon looks like, so you don't really need to post such large pictures of him stacked one atop the other.
But to answer your question if you have two players with the same skills and talent you always go for the younger player.
De Gutibus non disputandum est
by Bearskin Rugburn on Feb 1, 2010 8:44 AM PST up reply actions 1 recs
Cool stuff
I forget how much is getting to the playoffs worth? How much is 13% compared to 12% worth (I know these are very fuzzy numbers but they are still interesting)?
This might be kind of stupid or confusing
But it might be cool to plot “% improvement” as a function of wins for Washburn and Sheets at all win values to show when a team would prefer to have low risk signings like Washburn instead of Sheets. That might end up being an interesting plot.
I think something that should also be factored in the longterm season thinking is the second season
Yes, we have all heard that once you make the playoffs, anything can happen. So, the goal is to make the playoffs. But, everything else being equal, having Ben Sheets start game three of a playoff series would give a lot better chance at winning than Jarrod Washburn.
The thing is you're using this precise model for the marginal value of wins
and then plugging in a crude model for the projected win value of the two players. Can you even use the numbers coming out of this to make even a general statement as to whether teams should value volatility over consistency? Presumably the errors from the projected win values are on the order of the differences you’re seeing now.
You're looking for Pennants Added
http://www.hardballtimes.com/main/article/pennants-added/
http://www.hardballtimes.com/main/article/pennants-added-revisited/
One of my favorite concepts out there for measuring career worth.
by vivaelpujols on Feb 1, 2010 12:28 PM PST up reply actions
I am a little confused
What is the difference between the red and black curve?
The black curve is based on actual win total instead of Pythagorean
by Jeff Sullivan on Feb 1, 2010 8:39 PM PST up reply actions
I guess I'm missing how you relate Pythagorean to playoff %
I understand the black curve which kind of came from Athletics Nation.
by Edgar for Pres on Feb 1, 2010 9:35 PM PST up reply actions
Data/Graph dump (used black curve and not red so numbers aren't exact matches to Jeff's)
I plotted the contribution of adding different players as a function of the # of expected team wins. I first looked at Jeff’s example of Washburn (constant 2 WAR) and Sheets with his 3 possible outcomes.
Graph showing Sheets’ and Washburn’s added contribution to playoff%

Graph zoomed in. Shows Sheets peaking at a lower win value.

Graph showing the contribution of Washburn minus the contribution of Sheets. Its an easier way to see the difference between the two (units on right axis).

Like last graph but zoomed in a tad.

Now instead I graph the contributions of a 1 WAR and 2 WAR player. This is showing the upgrade from Vargas to somebody better is super extremely valuable.

And the same type of difference plot as before but instead for a 2 WAR vs 1 WAR player.

I just thought it was interesting seeing all this stuff in graph form.
by Edgar for Pres on Feb 2, 2010 12:53 AM PST reply actions 2 recs
Yeah its cool when things turn out interesting
Now hopefully the research I do in real life will take a 180 and start getting interesting too.
by Edgar for Pres on Feb 2, 2010 8:35 AM PST up reply actions
One last thing
I was looking at the equation that Athletics Nation put up and maybe this is just a weird coincidence but its kind of interesting.
Playoff % = 1 / (1 + exp( A * ( B – Wins))
where:
A = Replacement Win %
B = Average Wins needed to make the playoffs
Using the numbers that they used:
A = 0.40
B = 90
Probably just a coincidence right?
by Edgar for Pres on Feb 2, 2010 11:18 AM PST up reply actions

by 

















