tRA explained; no numbers
I know there are a few people who think tRA is too complicated to understand, what with all those scary numbers in it. Hopefully the following is an easier read than the 'official' primer. For many (most?) of you, well, you know this already.
The traditional way of evaluating pitcher effectiveness is ERA. There are a number of glaring flaws with this statistic, the primary one being that you can describe it as follows. 'How many earned runs (unearned vs. earned determined by the subjective home scorekeeper) a team concedes per nine innings when a certain pitcher is on the mound.' If you can't spot a couple of major issues here, stop reading now.
The primary problem, of course, that ERA is much closer to a team run prevention metric than a pitching one. Even at the major league level, defensive ability varies considerably. An adjustment is made for errors, but that's in the hands of a scorekeeper, and you can't make an error if you don't get anywhere near the baseball*. This seems a rather unfair thing to penalize a pitcher for. You see the defense issue popping up all the time - the early 00s Mariners, for example, had one of the best outfields in the history of the game, and their pitchers got all the credit for it. When Mike Cameron was removed from the equation, their ERAs rather predictably collapsed.
A couple of tertiary problems follow:
- Different stadiums have different effects on pitchers and hitters. A pitcher in Arlington suffers immensely compared to a pitcher in Petco Park, even if they are roughly equivalent in talent.
- We shouldn't really care about the unearned vs. earned run distinction, because giving up an unearned run is no different to an earned one in terms of wins and losses.
- ERA tends to fluctuate wildly year to year, which implies that it is divorced from a pitcher's true abilities.
Essentially, we need to look at what a pitcher can actually control to evaluate how good he is at pitching. Seems obvious, right? How?
What we can measure about a pitcher which the defense has no control over:
- Strikeouts swinging
- Strikeouts looking
- Walks
- Hit by pitch
- Ground balls
- Line drives
- Popups
- Fly balls
- Home runs
By only looking at these numbers, defence is more or less entirely eliminated. There are a few robbed home runs every year, but that's neither here nor there. What do we do next? We have to figure out how many runs and outs each of these are worth. This is a long, complicated process, and I'm not going to go into the details here. Suffice to say that every line drive, strikeout, etc over an entire year is examined to see how many runs/outs result, with the average taken after the all of these events have been calculated. And then you can figure out how many runs and outs a pitcher should have given up, without considering his defence, over the course of a year. Much like ERA, tRA is calculated by Runs/Outs*27. Parks are also adjusted for (when measuring the bulleted list above). It's actually a pretty simple concept, and unlike ERA is defence independent, park independent, and much more stable year-to-year (meaning that it's a closer measure of talent - regressing tRA gets you even closer).
There are problems with it, of course - some pitchers' ground balls are hit harder than others', etc, but these issues pale in comparison to the challenges with using ERA to evaluating pitching. Just because ERA is more traditional and fits into the old-school definition of baseball stats better doesn't mean it's right. tRA, as well as other advanced statistics, can be found on StatCorner.
*The Raul Ibanez school of defence.
13 recs |
79 comments
Comments
It may go without saying
but you can read more analysis on tRA from Graham and Matthew at StatCorner.
by katal on
Nov 8, 2008 10:22 AM PST
reply
actions
0 recs
Is it reasonable to say...
ERA measures overall pitching results.
FIP measures pitching performance.
tRA measures pitching abilities.
by Edgar for Pres on
Nov 8, 2008 11:14 AM PST
reply
actions
0 recs
Not really.
ERA measures team run prevention, FIP measures pitcher performance, and tRA also measures pitching performance but more accurately.
xFIP and tRA* are pitching ability indicators based on a year’s worth of performance.
by Graham on
Nov 8, 2008 11:17 AM PST
up
reply
actions
0 recs
tRA for minors
Trust it or don’t?
Also, a link between a club’s minor league affiliates and the major league team would be great.
by Edgar for Pres on
Nov 8, 2008 11:26 AM PST
reply
actions
0 recs
Trust it but watch out for park factors.
We recalculate all the run/out values for each league – it’s accurate apart from not being park corrected.
by Graham on
Nov 8, 2008 11:31 AM PST
up
reply
actions
0 recs
This is all great
but what do the letters stand for?
by JI on
Nov 8, 2008 11:30 AM PST
reply
actions
0 recs
It was meant to be Tra
But I had caps lock on
by Graham on
Nov 8, 2008 11:36 AM PST
up
reply
actions
0 recs
tRA*
What’s this? Some kind of Barry Bonds measurement?
by Two Rs and Two Ls on
Nov 8, 2008 11:36 AM PST
reply
actions
1 recs
Until you measure quantatively a groundskeepers effect on groundball rates, I say "Pshaw!"
My favorite perennial baseball journalism piece. I had in mind a Jim Edmonds climbing the wall clip, just to be a jerk, but you had to include the line “a few robbed home runs every year”. Covered all the bases on this one, booo.
by dpseadv on
Nov 8, 2008 1:45 PM PST
reply
actions
0 recs
I feel this post was a pointed message
what with all those scary numbers in it.
Just because some of us have nightmares in which we are chased by giant 2s and tormented by 4s does not mean you should poke fun.
by NOLAmarinergirl on
Nov 8, 2008 2:02 PM PST
reply
actions
0 recs
.
Nice Guys Finish Third - Hopelessly lost, but makin' good time.
by pdb on
Nov 8, 2008 3:43 PM PST
up
reply
actions
0 recs
Did this keep you awake for weeks?
by NOLAmarinergirl on
Nov 8, 2008 3:38 PM PST
up
reply
actions
0 recs
I wish I were dyslexic
because the idea of a movie called Dairy Of The Dead really intrigues me.
Nice Guys Finish Third - Hopelessly lost, but makin' good time.
by pdb on
Nov 8, 2008 4:13 PM PST
up
reply
actions
0 recs
...this is the most vile thing ever and calls for a revised Clown-themed flowchart.
by BrianL on
Nov 8, 2008 3:46 PM PST
up
reply
actions
0 recs
Has the name been changed to Fanpost Of The Dead yet?
I fucking hate you Mariners
by kentroyals5 on
Nov 8, 2008 11:12 PM PST
up
reply
actions
0 recs
This was a fantastic idea on your part
Good job
by Fogel on
Nov 8, 2008 3:17 PM PST
reply
actions
0 recs
But minor question: at the beginning of the season, do you still use the run/out values for the previous year? And if so, when is the transition to the current year made? And if not, how accurate could the numbers be at the start of the season?
by Fogel on
Nov 9, 2008 2:25 PM PST
up
reply
actions
0 recs
We don't know yet.
We haven’t had to deal with the problem before since SC only started up mid ’08. Matthew and I shall have a ponder before opening day.
by Graham on
Nov 9, 2008 2:26 PM PST
up
reply
actions
0 recs
This is a much clearer explanation than the one with all the numbers and formulae in
and I’m not saying that facetiously. This was really easy to grasp, and made a lot of sense. Thanks.
Nice Guys Finish Third - Hopelessly lost, but makin' good time.
by pdb on
Nov 8, 2008 3:23 PM PST
reply
actions
0 recs
This is a great explanation.
Thank you, Graham.
by BrianL on
Nov 8, 2008 3:37 PM PST
reply
actions
0 recs
Great Explanation
I hate to advocate drugs, alcohol, violence, or insanity to anyone, but they've always worked for me.
by wadswerth on
Nov 8, 2008 9:49 PM PST
reply
actions
0 recs
I think I understand tRA much better now.
I am glad you explained it, sans the numbers, it made it much easier for a novice like me to understand.
JI/Robert '08!
by Fin on
Nov 9, 2008 1:28 AM PST
reply
actions
0 recs
The real key was reading this drunk.
Still made sense. Well done.
J.K.L.
by acblue on
Nov 9, 2008 1:53 AM PST
reply
actions
0 recs
Thanks.
I run screaming from equations (strikingly similiar to NOLA’s nightmare), so this was useful for me.
by Omerta on
Nov 9, 2008 7:50 AM PST
reply
actions
0 recs
I'm glad I'm not the only one.
by NOLAmarinergirl on
Nov 9, 2008 12:34 PM PST
up
reply
actions
0 recs
You are definitely not.
Nice Guys Finish Third - Hopelessly lost, but makin' good time.
by pdb on
Nov 9, 2008 1:36 PM PST
up
reply
actions
0 recs
Seconded. Or would it be thirded?
Indie.
by Taylor H on
Nov 9, 2008 1:59 PM PST
up
reply
actions
0 recs
I still have nightmares about high school calculus tests.
by BrianL on
Nov 9, 2008 2:04 PM PST
up
reply
actions
0 recs
It took me two years to get through Algebra I in high school
The only class I ever failed, and I failed it rather spectacularly. Passed the second time with a D-minus, which was about the happiest day of my academic life.
Nice Guys Finish Third - Hopelessly lost, but makin' good time.
by pdb on
Nov 9, 2008 2:10 PM PST
up
reply
actions
0 recs
The only class I ever came close to failing was chemistry
but that was because the teacher knocked off a half letter grade every time I went on a band performance.
by BrianL on
Nov 9, 2008 2:21 PM PST
up
reply
actions
0 recs
I'm taking Calc right now.
It’s pretty awful. My teacher is impossible to communicate with, and the material keeps coming at light-speed.
Indie.
by Taylor H on
Nov 9, 2008 2:14 PM PST
up
reply
actions
0 recs
I got a C in high school AP Calc
and then went to take first semester Calculus at UPS and my advisor said “No, we won’t let you because you have already seen that material” so I got a C in second semester Calc at UPS when I was just looking for an easy grade
Determined, Jonesing Commentor | Proud proprietor of Washingtonhighways.org
by I'm NOT Corco on
Nov 9, 2008 5:30 PM PST
up
reply
actions
0 recs
Question
What is a line drive? Where do you draw the line between a caught line drive and a fly-out? Do you just take the gameday description of the AB?
by Paytheline on
Nov 10, 2008 9:17 AM PST
reply
actions
0 recs
Are MLB's definitions publically available somewhere?
Nice Guys Finish Third - Hopelessly lost, but makin' good time.
by pdb on
Nov 10, 2008 10:09 AM PST
up
reply
actions
0 recs
Scorekeeper's discretion.
It's hard to convince people to let you eat them if you're an asshole. - Thingray
by Faux on
Nov 10, 2008 11:40 AM PST
up
reply
actions
0 recs
so, wait
what constitutes a line drive is different in each park, depending on the scorekeeper? Matthew’s “we use MLB’s definition” seemed to imply there was a single standard.
Nice Guys Finish Third - Hopelessly lost, but makin' good time.
by pdb on
Nov 10, 2008 12:59 PM PST
up
reply
actions
0 recs
If it was actually different we'd notice in the park effects.
by Graham on
Nov 10, 2008 1:06 PM PST
up
reply
actions
0 recs
I get that but I'm still wondering where MLB's definitions live
if they’re available to the public that is.
Nice Guys Finish Third - Hopelessly lost, but makin' good time.
by pdb on
Nov 10, 2008 1:11 PM PST
up
reply
actions
0 recs
Given that the MLB rulebook isn't technically available to the public, I'm going with no.
by Matthew on
Nov 10, 2008 2:36 PM PST
up
reply
actions
0 recs
All I needed to know, thanks.
Nice Guys Finish Third - Hopelessly lost, but makin' good time.
by pdb on
Nov 10, 2008 3:00 PM PST
up
reply
actions
0 recs
tRA is a big step over ERA
but like the line drive definition, doesn’t take us out of subjectivity. Other friction points — fly out at the wall vs. WFB style fly-out; where an infield FB becomes an outfield FB; smoked one-hopper through the infield (Graham flags this one).
I’m also suprised that HBP has a greater run probability than a walk, especially since an HBP results in a dead ball, and a walk could include a wild pitch, runners moving, etc.
by Paytheline on
Nov 10, 2008 3:54 PM PST
up
reply
actions
0 recs
Those average out
and HBP’s are greater indications of wildness than walks by themselves.
by Matthew on
Nov 10, 2008 4:03 PM PST
up
reply
actions
0 recs
I'm trying to work the HBP explanation
Seems that if we are measuring independent events for their run producing effect, it is odd to give greater run producing value to an HBP based on the assumption that shittier pitchers throw them.
Assume that the HBP is by a pitcher who pitched to only one batter. Does that change the run probability of HBP?
by Paytheline on
Nov 10, 2008 6:50 PM PST
up
reply
actions
0 recs
That's not the reason HBPs have a higher run value.
HBP have a higher run value because they produce a higher change in run expectancy than walks do, on average.
by Matthew on
Nov 10, 2008 6:59 PM PST
up
reply
actions
0 recs
OK, but why the higher run expectancy?
Or should I just forget about this and move on with my life? If it’s just running the numbers on events (which I assume it is), I’m just curious why it works out that way. Seems counterintuitive because runners can’t advance.
by Paytheline on
Nov 10, 2008 7:05 PM PST
up
reply
actions
0 recs
Because runners almost never advance on a walk either
and HBPs are distributed somewhat randomly, but happen more often for pitchers with bad control. Pitchers with bad control often have more base runners on.
Also, some walks, while not classfied as intentional fall under the non-intention but intentional/pitching around variety which is often deployed in situations where adding a runner to first base doesn’t impact the RE much. That doesn’t happen with HBP.
by Matthew on
Nov 10, 2008 7:08 PM PST
up
reply
actions
0 recs
I love it when the coach visits the mound when a big hitter takes the plate.
You can practically read their lips “pitch to him, but don’t give him anything to hit”. Whatever the hell that’s supposed to mean.
Nice explanation, very concise. I was enjoying this question, and that is a pretty tidy answer.
by dpseadv on
Nov 10, 2008 7:13 PM PST
up
reply
actions
0 recs
thanks, Matthew
I hadn’t considered the “empty first base” issue.
by Paytheline on
Nov 11, 2008 9:56 AM PST
up
reply
actions
0 recs
MLB rulebook
Isn’t this the MLB rulebook?
Beyond that, I do think it’s strange that certain teams seem to show higher LDs – it seemed to me that SF’s staff had a collective increase in their LD rate that didn’t translate into runs allowed. It’ll be interesting to see if any of these (possibly park-related) anomalies continue year after year, or if, gasp, SF’s staff just gave up a lot of LDs last year.
by marc w on
Nov 10, 2008 4:26 PM PST
up
reply
actions
0 recs
So I was discussing statcorner and defensive metrics with a friend.
And we got into our usual argument about catchers. Specifically Dan Wilson and comments he’s made about focusing on the batter despite a runner on first that is a threat to steal second. I’m thinking the quickest way to settle this is looking at the pitching sequences for a catcher like Pudge, who posted some pretty good numbers throwing out runners, and Dan.
I’m going blind trying to find a site that lists the pitch type thrown when a base stealer runs, does such a site even exist? Also, this might not be the best way to go about this, anybody have any better suggestions?
by dpseadv on
Nov 10, 2008 6:59 PM PST
reply
actions
0 recs
I'm sorry if this is a dumb question, but, who or what determines an "expected out?"
What happens if a ball takes a funny hop?
GREINKE HO!!!!!
by oc on
Nov 10, 2008 9:52 PM PST
reply
actions
0 recs
Expected outs are just how many outs that have resulted per event for each season.
xRuns and xOuts are entirely dependent on recorded data.
by Graham on
Nov 10, 2008 9:59 PM PST
up
reply
actions
0 recs
From the primer on the site.
Using play by play data we can, in any given year, determine the average number of outs that was made on a given type of play by simply going through each play and counting the number of outs made on each type of play and dividing by the total number of plays for that type. Fairly straightforward, although a small correction factor has to be introduced to deal with outs made on the bases.
Expected outs are calculated by simply taking the occurrences for each event, for each pitcher, and multiplying by that out factor as outlined above.
by Matthew on
Nov 10, 2008 10:01 PM PST
up
reply
actions
0 recs








