Defensive Prowess and Sabermetrics
After a discussion with some other LLers I wanted to do a comment poll/discussion with the LL community about how they view defense and defensive metrics. There has been a lot of discussion recently about some of the potential problems with UZR, including posts by Matthew, and I have let my own feelings on the topic be known probably far too often, but after discussing this with JY, Kermit, and a few others, I realized that people all seem to view how they value defense differently - both using those stats and ignoring them. So I wanted to pose a few questions while they're fresh on my mind and see what people's thoughts are:
1) Based on what you know about defense and assuming the in zone and out of zone evaluations of current players are accurate, do you believe that a team of 9 healthy 2007 Jack Wilsons (2.7 WAR) would be able to beat a team of 9 2009 Manny Ramirez's (roughly 2.7ish WAR if healthy) 50% of the time assuming an equal pitcher.
2) Ignoring UZR and all defensive metrics completely (forget everything you know about current defensive calculations), do you cognitively believe it is possible for a player that has hit as poorly as Gutierrez all year to provide enough defense to make up for their complete lack of offense. If so, do you believe it is possible, cognitively, for a player to be a net positive with a .534 OPS.
3) UZR is a counting stat. When people say UZR takes 3 years to stabilize, they are not saying that a one year UZR is inaccurate for what a player did, only that it in accurate for a player's true talent. It's one of the reasons it is included in WAR, which is also based on how a player performed, not how they will perform or whether they are skilled enough to do that well. With that in mind, it is difficult/impossible to say that a 5.5 win player is better than a 5.2 win player, and few - if any - LLers ever do. So how much do two players need to diverge before you can clearly call one player better than another using WAR, knowing the flaws and variability of UZR? Are you comfortable calling a 5.5 win player better than a 5 win player? A 4.5 win player? A 4 win player?
If there is little participation or the mods would like this removed I'll clear it out in the morning. But these questions created a lot of discussion and I thought it would be worth seeing the community's thoughts.
92 comments
|
6 recs |
Do you like this story?
Comments
I'll give it a shot
1) No. I’ll take the team of Manny Ramirez’s of course (as would most anyone), but I think there’s some serious selection bias in your choices there. We all know Wilson’s true talent was below his performance in 2007 and Manny’s was above his performance 07. Jack’s team could win a few games, especially if the pitcher could get groundballs, but the true talent is not roughly equivalent here.
2) That pretty clearly depends on the context of the run environment. In 2003? No, not at all? In 2011? Possibly. In 1912? Certainly.
3) I don’t think it’s ever safe to base a true talent evaluation on one season of WAR or any other single statistic, no matter how large the gap in that season’s performance. Guys have fluke years, just as much so at the plate as in the field, and just as much negatively as positively. You have to look at a whole lot more than just one season of WAR to get close to determining true talent level.
I'm pretty sure he really meant for you to assume that those seasons represented the true talent level of those players.
Forget the names, if that helps, and just assume the question is about hypothetical players, one extremely skilled on defense but poor on offense, the other one extremely skilled on offense, but poor on defense. The key being that both of them are rated equal in runs above/below average using the WAR framework.
by nathaniel dawson on Sep 7, 2011 12:09 PM PDT up reply actions
Dawson is correct.
Assume WAR is true talent and ignore the names. The names are just designed to give you a reference. Also, for the Guti question, I mean this year.
...and now I'm here
by CapSea on Sep 7, 2011 12:43 PM PDT via mobile up reply actions
Also, for 3, my question was worded incorrectly.
At what point are you comfortable saying that one player had a better YEAR than another, using WAR.
...and now I'm here
by CapSea on Sep 7, 2011 12:46 PM PDT via mobile up reply actions
Important topic.
1) I have to agree with the previous poster that your choice skews the question since you take one of the worst years of Manny (the second worst year in ten years) and best of Jack Wilson.
With that said, if the defense numbers are accurate (BIG if, since I think that UZR is trash or something crooked), I would take 9 2007 Jack Wilsons over 9 2009 Manny Ramirezes (butchers in the field, and having one of their personal worst offensive year to that date).
2) If you’re talking about replacement level, then, yes. If the comparison is with an MLB averagely valuable player, then I think, no.
Guti was so bad with the bat this year.
3) I would only be comfortable with calling player A more valuable than B, when completely disregarding UZR, if A had an advantage in oWAR, AND if A and B were similarly good, average, or bad in defense (by the eye test).
For two players with obviously largely different defense abilities, I think it’s a tough call, since we can’t trust the UZR numbers, to make a judgement call on equivalent translation of offensive contribution numbers.
By the way, I suspect something is very fishy (or possibly actually crooked) with UZR’s blackbox or it’s source numbers (some people are compiling the raw data, right?).
I know Ichiro is having a poor year by his standards, but no way do I believe that Ichiro is the worst defensive rightfielder in the major leagues (together with another Japanese player, Fukudome, who actually can cover CF).
Their UZR numbers are actually around 30% worse than the worst fielding RF in the league (Bautista).
Something’s fishy with UZR numbers.
And another thing which stuck out was that in terms of UZR numbers, Choo (although I generally like him) was ranked by far the best defensive RF in the league, before he got injured. Really heads and shoulders above the pack in UZR numbers.
No way.
Something’s fishy (maybe even crooked) with UZR, in my opinion.
OK
1. If, for this exercise, you’re assuming that you know nothing else of Wilson’s career and that his 2007 is his true talent level (while also assuming the same thing for Ramirez), you’re pitting a team of average-hitting, average defensive players against a team of great-hitting, terrible defensive players. Personally, I’d rather have the more well-rounded team, especially since Team Ramirez only had about 4% of their plate appearances end in HRs, which would be about the only way the Ramirezes would be able to mitigate the defensive advantage of the Wilsons.
2. Setting aside any knowledge about defensive metrics (and, for that matter, the concept of replacement-level players), I’d have a hard time believing that a player could ever contribute enough defensively to make up for such an extremely deleterious bat.
3. dnc said it best, so I’d refer to his post.
I'll throw my hat into the ring.
1) Give me the ManRams every time. While I think that team would be horrific to watch in the field (oh the terror of Ramirez at SS), I think UZR is much more prone to incorrectly gauging performance than wOBA, and if I had to rely on one of those statistics it would be the latter.
2) I don’t think that Gutierrez can provide enough defensive value to be close to an average player. Replacement? Sure. Above replacement? Likely. I think the only positions that can provide that amount of fielding value (fielding + positional adjustment) to counteract their poor hitting is SS and C, though we’re still enamored with the issue of catcher defense.
3) I never base anything off of one year of WAR data; there’s just too much variance. If I had to differentiate between two players, I’d take a 3-year 5-4-3 weighted sWAR of each player before making any conclusions. If there is a difference equal to or greater than .5 WAR I’m willing to state that the players are of different true talent level.
On this note, I only use sWAR because it leaves out fielding metrics all together while including the positional adjustment. I’m not comfortable with using individual fielding metrics, especially one year of them, in WAR as I feel they are far too inaccurate. While we can say with a good amount of certainty that Gutierrez has been a plus fielder this year, do we know by how much? If UZR spurts out a number, does that make it correct? I’m comfortable with team fielding statistics and I hope Matthew will eventually make his batted ball one available even if the data isn’t perfect, but I think that on an individual level fielding statistics don’t give enough of a correct description to be used.
"Satisfaction is the enemy of success." SanFranPreps Twitter: @d_quazzo
Is your answer to #1 really answering his question?
Maybe CapSea could clarify it a bit, but I think he was asking that if the defensive evaluations used in this WAR calculation are accurate, does WAR do a good job of evaluating total contribution by players? Specifically, players that have wildly different contributions on offense and defense.
If you answer that the Manny Ramirez team would win more games, then you’re saying the WAR framework is flawed in some manner other than defensive runs. Would the flaw be in positional adjustment, or replacement level, or offensive runs?
At least that’s the way I read “assuming the in zone and out of zone evaluations of current players are accurate”. Could be that’s not what he was getting at, but that’s the way I read it.
by nathaniel dawson on Sep 7, 2011 12:54 PM PDT up reply actions
If that is the case, then I would believe the two teams would be as equal as they could be.
Even if they are absolutely equal in terms of overall talent, they will not play that way due to random chance. Given that WAR is a framework and not an actual statistic, I don’t think it’s flawed. It follows logically what we know and want to measure in baseball: offensive, defensive, positional, and playing time (+baserunning in some cases) contributions, at least for position players. The only problems lie with the stats attempting to measure the above.
"Satisfaction is the enemy of success." SanFranPreps Twitter: @d_quazzo
The reason I'm particularly suspicious about UZR is the money involved.
Asides from any possible racial aspects in play, WAR (including UZR) is a widely used number now to evaluate player worth.
It’s so simplified that it’s dangerous (if not upboard and accurate), since anyone can remember one number, and make judgments based on this number.
oWAR can in general be objectively checked and calculated by any fan with an interest.
UZR is some kind of blackbox, of which the numbers we can’t easily check.
Let’s say some player get’s a crooked boost of 2 WAR from skewed UZR numbers. That would be worth 10 million per year on the market, since you can be sure his agent will be cramming these WAR numbers in the face of any GMs in negotiations.
This is huge money we’re talking about.
It would be huge money to whoever is controlling UZR’s blackbox, and/or any lowly scorer or whoever is compiling the raw data.
Asides from whether anything fishy is really going on or not, nobody can deny the possibility/ existence of temptation (or rather the mechanism in place) for potential wrongdoing, or to put it more mildly, just some tweaking of the numbers (that doesn’t sound so bad, does it?).
It worries me that this number (UZR, and by connection WAR) that we can’t objectively check, is having an increasingly important role in baseball.
I’m also disturbed because UZR didn’t seem THIS BAD up to last year. Something’s suddenly screwy this year.
Maybe some of the agents suddenly realized the “new inefficiencies in the market” (=subjectivity of UZR).
I think you're looking for something that isn't there
The nature of defensive statistics makes them unstable. I don’t see any reason to think there’s any kind of hidden racism, or even bias, in the numbers. The numbers just have a great deal of variance.
by dnc on Sep 7, 2011 11:16 AM PDT up reply actions 2 recs
I feel the most prudent course of action is to use a variation one WAR like/similar to what statcorner uses
If I recall correctly, it uses a positional adjustment, but does not adjust for defensive ability. Given the wide variations in available metrics, I still think it is best to use scouting report and one’s eyes to gauge defensive ability.
WAR on Statcorner is hitting + position + playing time.
It’s everything bWAR or fWAR is except doesn’t include defense.
Would you go for a WAR calculation that uses the Fan's Scouting Report?
Provided you’re comfortable with the conversion of the gradings into runs above/below average?
by nathaniel dawson on Sep 7, 2011 12:19 PM PDT up reply actions
It might be possible for someone with a .534 OPS to be a net positive....
If they were both an excellent defender and a threat to steal a base every time they did get on base, but even then it’s probably hovering around the baseline for acceptable. Guti is a great defender but not as much of a base stealing threat so I don’t think he’ll cut the mustard unless he can recover his bat a bit.
Me:
1) I’d feel comfortable saying that both teams would win a similar number of games if they played a whole bunch of times.
2) I would definitely think that’s possible. I’m going with above replacement level with no consideration of salary as “net positive”, but even using “average” as the benchmark, I think it can be done. I’d have to say that the player would need to turn in one of the best defensive seasons in baseball history to be average or above.
3) Maybe something like 3 or 4 WAR difference would be enough for me to say that one player was certainly better than the other. I’d think of it more in probabilities, something like a .5 WAR difference means one player has a 10% chance of having been better, a 3 WAR difference might be 90% or whatever.
Good questions all.
by nathaniel dawson on Sep 7, 2011 1:17 PM PDT reply actions
Might as well have a go at this.
1)
Excusing the thought of this:
Jack Wilson singles on a bunt to third baseman Manny Rameriez. No outs.
Jack Wilson singles on a bunt to third baseman Manny Rameriez. Jack Wilson to second. No outs.
Jack Wilson singles on a bunt to third baseman Manny Rameriez. Jack Wilson to third. Jack Wilson to second. No outs.
Jack Wilson singles on a bunt to third baseman Manny Rameriez. Jack Wilson scores. Jack Wilson to third. Jack Wilson to second. No outs.
I want to think about this one more. I had a thing all written up, but then I decided I wanted more time to think about it.
2)
As I feel like we have a good handle on how position, batting, and playing time relate to runs, I feel like I can use those numbers fairly freely and confidently. Looking at Fangraphs for the numbers, we get 11.5 runs for playing time(replacement), 1.3 for position, and -17.7 for batting. Thus, assuming net positive means anything above replacement, he needs to have 5 runs of production with his glove to be a net positive. Since he is one of the greatest Center Fielders gloves I have ever seen, I think it would be very easy for him to save 5 runs with the glove.
Further, I would argue that if you think there was no way anyone could do that, you’d be arguing that defense is essentially meaningless, and that elite defense is worth less than 5 runs compared to an average defender, which seems to me to be absolutely ridiculous.
3) I’d say something like:
.5 WAR difference: 50% confidence
1.0 WAR: 90%
1.5: 99%
by joof on Sep 7, 2011 1:30 PM PDT reply actions 1 recs
1) Love it!
Because you know there’d be a lot of that going on.
by nathaniel dawson on Sep 7, 2011 2:08 PM PDT up reply actions
Truth.
"Ever tried? Ever failed? No matter. Try again. Fail again. Fail better." - Samuel Beckett Mariners Minors
by JY on Sep 8, 2011 1:22 AM PDT up reply actions
1)
Assuming that we take UZR at face value for this, as I believe that’s what you’re saying you want. Looking at Fangraphs, Jack Wilson 2007 was a league average bat, playing league average defense at shortstop, while Manny 2009 was a 3.5 win bat playing absolutely dreadful defense in Left Field.
I think the Jack Wilson team would win more than 50% of the time. Manny only hit 7 more homeruns than Jack Wilsondid that year, 12 to 19, and the Manny team would average one homerun a game versus the Jack Wilson team averaging 2 homeruns every three games. On top of that, I feel like moving down the spectrum, Jack Wilson would retain more value from defense, and play a more credible outfield than Manny could moving up the spectrum to middle infield or corner infield. Add in the Jack Wilson team’s better ability to play small ball against the Manny laden infield, and I could easily see the Jack Wilson team winning more games than they lost.
Bingo
Definitely agree on the overall point. You do have to give Manny another 9-10 HR’s because CapSea is extrapolating a full season for Manny to get him to 2.7 WAR. Of course, Jack missed 30 games that year himself. If you’re assuming true talent and complete health for both, that tips the scales even more in Jack’s favor.
Let us not discount the problem of the pitcher having to throw 300 pitches a game because nearly zero groundballs are being turned into outs.
by Poochie on Sep 8, 2011 11:40 AM PDT up reply actions 1 recs
The other team would suffer too.
Going through a lineup of Manny Ramirez’s (grammar police, help me out on that one), you’re working your way through a lot of pitchers to get through 9 innings.
by nathaniel dawson on Sep 8, 2011 8:49 PM PDT up reply actions
1) Assuming your WAR calculation was based on the true run value of defense then yes. The problem is with UZR and other defensive metrics, not with run prevention. Then again, for this thought experiment, if you’d chosen a hitter who generated value with walks and home runs, the defensive advantage would be mitigated.
Good point about the walks and home runs.
I’d expand that and say “three true outcomes” players. If you’re hitting the ball out of the park, walking, and striking out a lot, you’re giving the defense fewer opportunities to impact your run scoring.
The flip-side is true, as well. A player like a Jack Wilson rarely hits home runs, walks, or strikes out, putting a lot more pressure on the defense to make plays to prevent runs.
by nathaniel dawson on Sep 7, 2011 2:18 PM PDT up reply actions
Yeah, well your thoughts on #1 brings up a point I want to discuss later. I did mention that we assume the range calculations are correct at least though.
So that UZR is, at the very least, successfully categorizing what it is supposed to be measuring.
...and now I'm here
My thoughts:
1) I’d take the offensive team over the defensive team, just because I’m so sick of watching the Mariners lose low scoring games. Ask me again in 1997 and I’ll probably say the opposite.
2) Yes, but it would have to be legendary defense (like Ozzie Smith) and only at shortstop and catcher. Maybe CF if we’re talking Andruw Jones in his prime (I’m still leaning towards no), but I can’t think of any other position where a player with a 53 wRC+ to be a net positive.
3) If UZR is being included in WAR, it would have to be a difference of 1 win beyond the UZR difference before I consider one player better than the other. However, I don’t think UZR counts what it thinks it does, so I take out the UZR component when comparing players.
My thoughts are similar to some others here, but nevertheless
1) Yes, I would say it would be roughly 50%, +/- 5% given a large enough sample. I might favor the Mannys by a small margin due to the difficulty of pitching to consecutive elite hitters, but I wouldn’t favor them by much.
2) Yes, speaking purely from a hypothetical point of view, a player who literally catches everything could very well negate any possible negative offensive contribution that player could make. An interesting thought experiment might be this: would you trade an automatic out in the lineup (say, the 9th spot of the lineup) for the option to have any ball hit into the CF zone be ruled an automatic out?
The thought experiment doesn’t work perfectly, of course. You’d have to consider GIDPs, out of zone plays, outfield assists, and HR robbing, but you get the general idea. It’s sorta an interesting scenario to think about.
3) I will typically not use Fangraphs WAR with more than 1 WAR of uncertainty between players due to UZR. I prefer to use sWAR and then formulate a defensive range (e.g. +5 to +10 with the glove) based on the collective information from UZR, DRS, TZL, and Fan Scouting Reports. Even then, I always keep in mind that WAR is not an exact science. There are enough variables and enough variance in the game itself from year to year that it’s difficult to capture a players precise value in a year. And that’s not even considering the context of what they actually did in games in a given year (WPA).
Generally, while I think the run values of UZR are highly suspect, I feel that UZR, DRS, and TZL can at least give us is an idea of whether or not a player is above or below average. If a player has 3 consecutive seasons of positive UZR, I’ll typically conclude they’re at least above average, disregarding what their actual, precise positive run value was in each of those 3 seasons.
Crap, I remembered the other question I forgot. I'll put it down here since I don't want to force people to read the post again.
According to your belief – and just your belief – what percentage of a baseball game is your team’s defense? So for example, offense is ~50% of the game (since when you’re up to bat you’re neither pitching nor playing defense, accounting for 50% of your team’s output). So of the remaining 50% of the game, what percentage is pitching and what percentage is defense?
...and now I'm here
Pitching is somewhere between 70-80% of the remaining half
And pitching is somewhere between 20-30% of the remaining half.
So overall that leaves pitching at 35-40% of the game and defense at 10-15%.
by dnc on Sep 7, 2011 9:01 PM PDT up reply actions
Okay! Thanks everyone for answering. So here's the ideas that brought up the questions
I’m open to these being wrong.
1) Maybe it’s just me, but I don’t think it’s possible for a team of excellent defense, poor offense players to beat a team of excellent offense, poor defense players 50% of the time. There are things like chaining to consider (getting multiple hits/OBP in a row to keep an inning going), the role of pitching when compared to defense (even Manny Ramirez-like defense is going to make most of the outs in a game), and walks/home runs – which are not balls in play and thus not included in defense. It’s possible that I’m wrong, but I find it very hard to believe that the team of Manny Ramirez like players wouldn’t win most of the game despite their WARs being equal to the Jack Wilson team.
Side Note: One possible reason for this: You always need to score at least 1 run to win a game. No matter how good your pitching and defense is, you have to have at least some offense. And indeed, because an average pitcher would still give up a home run or two, even if you have amazing defense they would still need to come up with 2 or 3 runs a game to win. Because of that it’s possible that offense may be worth more than 50% of a game. But that’s just a passing thought.
2) Two parts to this. First, once again, I think it’s hard to imagine that any .500 OPS player could ever make up for his terrible offense with his defense, no matter how amazing a defender he may be. Gutierrez may be the greatest center fielder in the game, and – cognitively – I don’t think it’s possible for a player to make up for being that bad at hitting, let alone a net positive, which WAR believes he is. Even if his UZR is accurate, something seems amiss.
And to illustrate that, most people here agreed that defense is probably about 10% of a baseball game. Yet Gutierrez has had several seasons where he’s been worth – as has been argued not only by UZR but also by just watching him play – 20 runs, or 2 wins, sometimes even more. That is the equivalent of being worth 10 wins on offense (Offense being 50% of a game, defense only 10%). Since 1950, only Barry Bonds has been worth 10 wins on offense. Guti’s defense is exemplary, but it’s not once in a generation.
This is where Kermit and I disagreed. I think defense, while it’s undervalued in baseball, may be massively overvalued in sabermetrics. Kermit thinks that it’s not overvalued, but it needs to be adjusted more for park, where Gutierrez in Safeco is worth a ton, but Gutierrez playing in Boston is worth much less.
Either way – and I believe it was mentioned by Poochie in another thread and something I believed for a while – the way defense is added into WAR (even if UZR is “accurate” for what it’s supposed to be measuring) seems wrong, whether it’s because of park adjustments or defense simply being overvalued as an asset in sabermetrics, at least in terms of how much a player helped a team.
3) Most people agreed that it sounds fair to compare people at ~1 win. Even still, there may be a player that UZR has valued incorrectly low, and a player that UZR has valued incorrectly high, and it’s not too tough to see how a player worth, say, 3.5 wins may actually have had a better season than a player worth 5 wins.
3.5) In my eyes, UZR is singlehandedly destroying the validity of sabermetrics with much of the general public. It makes WAR nonsensical, it makes a team built on defense to seem like it should be better than it is (I still think defense is undervalued, but in baseball – not in stats), it makes a less-than replacement player look like an asset, and it makes a player like Jack Wilson in 2007 seem equal to Manny Ramirez in 2009 who – while he may be a butcher in the field – would still probably win more games if a team of him went up against a team of Wilsons.
Anyway, these are all my own opinions and I’m not trying to argue they’re fact. It’s just some thoughts I’ve been having on all of this and it didn’t make sense to write them all out without seeing what other people believe. Hopefully this type of stuff is interesting to others even if you disagree.
...and now I'm here
by CapSea on Sep 8, 2011 1:57 AM PDT reply actions 4 recs
Seriously though, fuck UZR.
- The run values assigned to defensive plays are probably wrong.
- The ranges are probably wrong.
- It’s a counting stat that doesn’t count correctly.
- It treats a play that an outfielder lets drop because they don’t want to risk overrunning it and turning a meaningless single into a meaningful triple as equivalent to a diving play with the bases loaded.
- It ignores line drives, which is weird.
- It doesn’t match up with BABIP and all that stuff Matthew mentioned.
What a piece of crap. That stupid rLF thing I made up as a semi-joke back in 2008 was more useful that this load of shit.
...and now I'm here
by CapSea on Sep 8, 2011 2:13 AM PDT up reply actions 5 recs
Yuo
Maybe it’s just me, but I don’t think it’s possible for a team of excellent defense, poor offense players to beat a team of excellent offense, poor defense players 50% of the time.
The last couple of years of watching the Mariners is pretty convincing of this point. You need at least some offense or you just can’t win even remotely consistently.
RIP Dave Niehaus.
I'm not disagreeing, but didn't the M's run out a not particularly good defense as well?
How come you can do all this other great shit, but you can't lie the fuck down and sleep?
One pretty serious disagreement here
(even Manny Ramirez-like defense is going to make most of the outs in a game) I just don’t think this is correct. Manny at shortstop would be an absolute disaster. Second base and CF wouldn’t be much better. The possibility that was raised of just laying down bunts that Manny is not going to be able to field is extremely legitimate.
I think you’re way underestimating how easy it would be for the team of Jack Wilsons to score against the team of Manny’s defense.
And this goes back to the original argument I brought up. You’re claiming that we should “Assume WAR is true talent and ignore the names. The names are just designed to give you a reference,” but you’re clearly not doing that in your analysis. You yourself point out you’re trying to compare a “team of excellent defense, poor offense players to … a team of excellent offense, poor defense players”.
The problem is, that doesn’t describe 2007 Jack Wilson and Manny Ramirez. 2007 Jack Wilson had a .335 wOBA. 2007 Manny Ramirez had a .385 wOBA. Throw out the names and assess that .050 difference in true talent, and now the question becomes is the difference between one of the best defensive players in the league and one of the worst defensive players in the league enough to make up .050 points of wOBA.
I think that’s a pretty likely yes. From this perspective I take Team Jack.
In summary, I think the names are biasing the responses significantly, even yours, whether that was your intention or not.
by dnc on Sep 8, 2011 9:00 AM PDT up reply actions
My bad, that should be a .396 wOBA for Manny
Double fail – looked at 2007 and still got the wOBA wrong.
So now it’s a .061 difference in wOBA, which makes me a bit more hesitant. I still think Team Jack’s ability to bunt/steal/take the extra base on Team Manny would be the difference. That and Team Manny would never turn two on Team Jack, but Team Jack could turn two pretty frequently on Team Manny.
I’m still going with Jack, assuming true talent seasons.
I don't think the Wilson v. Manny is a great way to frame this discussion
Those teams simply do not exist in reality. It’s fun to use it to poke fun at the whole positional adjustment system, but I believe that system was made to account for positional changes that would be realistic.
Well, maybe I'm not explaining it right.
Poochie’s right here. Manny Ramirez literally at shortstop would be terrible, but then he wouldn’t be 2.7 WAR. I’m thinking more someone that is the “Manny Ramirez of his position” – great hitting, poor fielding.
...and now I'm here
Basically, think two players with equal WAR, but one that's essentially there from fielding only and another from hitting only.
...and now I'm here
At that point, I would say it's probably 50/50, with fluctuation depending on how Three True Outcomes heavy either side gets.
However, Assuming a replacement levelbat, a first baseman would have to be a nearly 40+ run defender to get to league average.
I don’t think it’s possible for one player to save that many runs with defense over the course of one year. I don’t think the no bat, all defense team could exist as specified.
Yeah, I guess we disagree.
I don’t think it’s possible for a no-offense, all defense team to beat an all offense, no defense team more than.. maybe 20% of the time, if that. The need to score runs to win a game outweighs the need to stop runs from scoring to win a game. Or, looking at a extremes, the hypothetical no offense, all defense team would never win a game, while the hypothetical all offense, no defense team would never lose.
...and now I'm here
Yeah, but even the worst offense of the past 50 years scored over 500 runs.
It’s not like they’ll never score. And they’ll score more than deserved when their shitty bloop singles are falling in all over the place and their terribly hit grounders are booted or find holes in the infield.
But would this great defensive team be able to stop enough great offense runs team from scoring to equal a 500 runs/500 runs against split?
The idea of extremes is really just the only way I can think to illustrate my thought that defense in statistics may be overvalued. Or maybe I should say that offense is undervalued. It seems in a lot of ways like offense represents more than 50% of a game. The whole “Guti would be worth 10 wins” thing bothers me a lot.
...and now I'm here
Also, for the 50-50, I was assuming that all the players were -10 run defenders, with bat and position taking them the rest of the way, and vice versa for the other team.
So, assuming we round for ease up to 3 wins, we would have the following:
Shortstop on the Jack Wilson team would be a +20 replacement, +7.5 Position, +10 glove, -7.5 bat, while the Manny shortstop would be a +20 replacement, +7.5 position, -10 glove, +12.5 bat.
Likewise, the First basement would be +20 replacement, -12.5 Position, +10 glove, +12.5 bat, compared to +20 replacement, -12.5 position, -10 glove, +32.5 bat.
So the Manny Team would be playing Dustin Ackley with a shitty glove at First, while the Wilson team would be playing Mike Carp with a tiny bit worse bat at first, but with Casey Kotchman’s glove.
Sure. That sounds right, and pretty much exactly as I was thinking. I don't know how to run these numbers though.
Although really I was thinking a bit more extreme, like +/- 15 glove and +/- 15 offense, maybe even more. Manny Ramirez was a fucking awful defender and Wilson/generic amazing defensive shortstop would be really good. That’s probably why the names were bad examples, but still.
Also, there is still the question of whether one can actually be a -15 or +15 glove. Can someone really be adept enough at defense to be worth that much when defense only affects 10% of a game. I’m still really uncomfortable saying that’s possible,
...and now I'm here
As I said below, this isn't 2007 Jack Wilson at all
07 Jack got his value from his bat and his position, not from his glove.
Actually, 2011 Guti would probably be the example you’re looking for here. He’s at 1.3 WAR in 92 games (entirely thanks to his defense), which would put him right at 2.5 on a full year, which would actually be closer to 09 Manny than 07 Jack was.
I should add
I’m really not trying to be a dick, I just love pulling back the layers on thought exercises like this.
Interestingly I originally posited the question without player names.
But then I was worried people wouldn’t understand what I was asking and decided to enter the names later.
...and now I'm here
Another interesting path to follow
(Following in the thought exercise realm) What about Jekyll and Hyde teams, choosing the best offensive players at each position versus the best defensive players, with matching WAR at each position.
Which team would people then choose to win the most games?
by nathaniel dawson on Sep 8, 2011 10:27 PM PDT up reply actions
So, do you trust the run values we assign to batting and positional adjustments, or do you disagree with those to?
I don't know, really.
I agree with them in terms of a player’s value to their team, but every team has a shortstop, which means that every team gets the same positional adjustment, so when two teams play against each other the value of the positional adjustment is cancelled out.
...and now I'm here
I was speaking in respect to a player's value to their team.
Would you agree that Gutierrez has been worth 17.7 runs below average, his time in Center Field is worth 1.2 runs compared to the field of all positions, and due to replacement being 20 runs below average, he gets 11.5 runs to adjust the scale to runs above replacement, or would you disagree with those values? (I’ve just been checking Fangraphs due to ease and familiarity. If you would prefer some other way of calculating run value, feel free to substitute that.)
Maybe. But then maybe it's the positional adjustment that is overvaluing defense.
Yeah, Guti is worth a lot to his team because of the positional adjustment, but because literally any player that is put in center field gets the same adjustment, it seems like in many ways that number – or the number of his adjustment + defensive value – is too high. I don’t know how to describe it, but
- He’s been consistently worth about 15 to 20 runs in defense (one year he was worth 30!), and if defense is only 10% of a game, that number is just way too high.
- I can’t mentally imagine any player in modern history being good enough on defense to make up for the fact that they’re a black hole in offense.
To me, and I don’t know if I’m describing this correctly, his WAR is way too high. Whether it’s because the positional adjustment is wrong or the ability for defense to be valued in excess of 10 runs is wrong or the combination of both is wrong I don’t really know, but there’s no player that should be worth more than Barry Bonds in defense, and shouldn’t be a player hitting that poorly that is considered a net bonus to his team. According to the numbers, Gutierrez should easily be starting 2012 even if he continues to hit that bad, and I can’t see how that is possible.
...and now I'm here
Too high! Too high! Too high!
I work as a writer =/
...and now I'm here
by CapSea on Sep 8, 2011 4:20 PM PDT up reply actions 1 recs
Guti's positional adjustment has only been 1.2 runs this year, so it's not all that much. The 11.5 is the "replacement" playing time adjustment.
I would argue, that the issue lies with Guti not being punished enough for his incredibly low production with the bat. At a certain threshold, it would make sense to me that the run values would switch from a more linear scale to more of an exponentially falling scale, where each point of lost OPS would be worth a larger negative run value.
Me too! That's why I don't know if I should be arguing that defense is overvalued or offense is undervalued.
You have to chain non-home run hits together to score runs. The worse a player is (making it more likely they cause an out) the harder it becomes to chain those hits. I emailed a few of the stats people like Tom Tango if there is an effect of chaining that may be missed in offense numbers but I didn’t get a response and didn’t really know where to continue.
...and now I'm here
I really want to continue this conversation, but I have to leave for a bit.
I’m going to mull some things over while I’m gone though.
I'm not going to answer 1 and 3.
Because I don’t feel knowledgeable enough.
With 2, I think it’s a combination of things:
How good is the glove? How sucky is the bat? How does that compare to the league at that position? How much are we paying? Park factors?
As long as all those things balance out, I think a below average bat can be worth it for an excellent glove. Where exactly the line is for that is up to people with more baseball knowledge smarts than me. That said, I don’t think we can judge Guti’s value overall based on this years OPS (not that I think you are, I’m assuming that’s just an example also).
Even though my opinion is worthless
1.) Theoretically, yes, I could find it plausible since Jack Wilson wasn’t garbage offensively that year. More hits would drop for Jack since Manny wasn’t good defensively, so Jacks would probably be able to score around 4 runs a game, which would be able to match Manny, because he wouldn’t hit a dinger in every game and I wouldn’t doubt that a team full of Jacks could rob a few line drives to keep Manny around 2-3 runs per game that doesn’t have homeruns. This is just what I think (which is also probably wrong!) So I could see team Jack winning 50% of games, but I think team Manny would win more, but not alot more.
2.) No. I think he can be replacement level with a .534 OPS, but not a net positive. I think if he were around a .600 OPS he could be, just because I think he’s the best defensive CF in the Majors right now, but I wouldn’t really feel confident that he would be average overall unless he was around .650.
3.) For 1 season 1 win would probably be a big enough gap for me to comfortably think one player was better then the other.
I think a problem with really trying to figure out how good someone is defensively is the fact that all ball parks are different in basically every way. Since all the parks are different you have to grade all the players differently, which leads to alot of mistakes. It’s nearly impossible to judge the fielders then even when adjusting for park factors (especially when they change from year to year, so a player like Jason Bay who was thought to be awful in 2009 defensively by UZR had his numbers changed to reflect non awful defense). So I guess eye test + a combination of whatever defensive metric you like the most is for now the best way to evaluate a defender.
by SuperDopaLiciousFunkStar on Sep 8, 2011 5:16 AM PDT via mobile reply actions
Two other considerations I haven't seen mentioned for point 1
1) You mention 9 Mannys, 9 Jacks, and an equal pitcher, which I assume means we are talking about an AL team. The one position where you get offensive Manny and offensive Jack without the defensive counterparts is pretty significant, and is something I wasn’t figuring in. On an NL team I definitely like Team Jack better. On an AL team I might have to take Team Manny.
2) I understand that in your premise you stated that we are assuming both teams stay healthy, which makes Manny around 2.7 WAR but also makes Jack around 3.1ish (which you didn’t factor in). However, I don’t think it’s safe to assume equal health here. Wouldn’t you naturally expect the bodies of the more athletic defensive minded team to handle this much better than the less athletic offensive minded team? Isn’t a season at short, catcher and centerfield going to destroy those Manny’s physically, whereas the seasons at first, left and right should be a relative breeze for those Jack’s?
As I mentioned above, ignore the names. They're just to give an idea of what a great hitting, poor fielding player is and a great fielding, poor hitting player.
...and now I'm here
I understand ignoring the names
I’m talking about player types/positions. If you take a poor defensive LF and put him at SS he’s much more likely to have a body type that will break down there than a poor hitting SS you ask to play 1B.
What you’re saying now is that you’re not talking about 9 of anyone on a team, but 9 players who are at the extremes of the offense/defense metrics for their actual position. Which is a completely different discussion entirely. And in that case I think you picked really bad examples because 2007 Jack didn’t get much value at all from his UZR, it was almost entirely positional combined with a solid if unspectacular bat.
I agree UZR is pretty worthless
Even the guys at Fangraphs question UZRs validity, but yet they still use it and WAR as some sort of fact in their writings. I just don’t get the point of using it when it takes 3 years of recording to get a true measure of a players defensive abilities when you could probably get a better sense after watching that player actually play for a month or so.
Perhaps because one year UZR still represents what a player did, even if not indicative of his true ability
Casey Kotchman is hitting like .330 right now – this is something he accomplished and should be reflected in his WAR for 2011, even if we have no illusions that he will continue to hit like this going forward.
by seattlebruin on Sep 8, 2011 12:57 PM PDT up reply actions
It's unclear that one year of UZR measures what actually happened
by Graham MacAree on Sep 8, 2011 7:41 PM PDT up reply actions 4 recs
Ideally, yes it would.
I don’t think that’s the case with UZR.
"Satisfaction is the enemy of success." SanFranPreps Twitter: @d_quazzo
Interesting topic.
1) I visualize #1 as a match up between the Twins teams from a while back, when they had a web gem almost every night, against the current Blue Jays line up (ignoring the pitching staffs of course). I think that Blue Jays line up would win most of those games pretty easily.
2) In this case I think it depends on the pitching staff. A defensive player like Guti would have to have a lot of batted balls come his way each game to outweigh the four or five times he comes to the plate and fails. If the staff pitches to a lot of contact I think they would be able to make up for it. A hit saved is probably as good as a hit earned.
3) The answer to this question would look like an exponential graph in my opinion. The difference between a two win player and a three win player, in my mind, is greater than the difference between a four win player and a six win player.

by 

















