Lookout Landing: An SB Nation Community

Navigation: Jump to content areas:



Sports blogs for fans, by fans.
New Blog: Backing the Pack for NC State Fans!


tRA explained; no numbers

I know there are a few people who think tRA is too complicated to understand, what with all those scary numbers in it. Hopefully the following is an easier read than the 'official' primer. For many (most?) of you, well, you know this already.

The traditional way of evaluating pitcher effectiveness is ERA. There are a number of glaring flaws with this statistic, the primary one being that you can describe it as follows. 'How many earned runs (unearned vs. earned determined by the subjective home scorekeeper) a team concedes per nine innings when a certain pitcher is on the mound.' If you can't spot a couple of major issues here, stop reading now.

The primary problem, of course, that ERA is much closer to a team run prevention metric than a pitching one. Even at the major league level, defensive ability varies considerably. An adjustment is made for errors, but that's in the hands of a scorekeeper, and you can't make an error if you don't get anywhere near the baseball*. This seems a rather unfair thing to penalize a pitcher for. You see the defense issue popping up all the time - the early 00s Mariners, for example, had one of the best outfields in the history of the game, and their pitchers got all the credit for it. When Mike Cameron was removed from the equation, their ERAs rather predictably collapsed.

A couple of tertiary problems follow:

  1. Different stadiums have different effects on pitchers and hitters. A pitcher in Arlington suffers immensely compared to a pitcher in Petco Park, even if they are roughly equivalent in talent.
  2. We shouldn't really care about the unearned vs. earned run distinction, because giving up an unearned run is no different to an earned one in terms of wins and losses.
  3. ERA tends to fluctuate wildly year to year, which implies that it is divorced from a pitcher's true abilities.

Essentially, we need to look at what a pitcher can actually control to evaluate how good he is at pitching. Seems obvious, right? How?

What we can measure about a pitcher which the defense has no control over:

  • Strikeouts swinging
  • Strikeouts looking
  • Walks
  • Hit by pitch
  • Ground balls
  • Line drives
  • Popups
  • Fly balls
  • Home runs

By only looking at these numbers, defence is more or less entirely eliminated. There are a few robbed home runs every year, but that's neither here nor there. What do we do next? We have to figure out how many runs and outs each of these are worth. This is a long, complicated process, and I'm not going to go into the details here. Suffice to say that every line drive, strikeout, etc over an entire year is examined to see how many runs/outs result, with the average taken after the all of these events have been calculated. And then you can figure out how many runs and outs a pitcher should have given up, without considering his defence, over the course of a year. Much like ERA, tRA is calculated by Runs/Outs*27. Parks are also adjusted for (when measuring the bulleted list above). It's actually a pretty simple concept, and unlike ERA is defence independent, park independent, and much more stable year-to-year (meaning that it's a closer measure of talent - regressing tRA gets you even closer).

There are problems with it, of course - some pitchers' ground balls are hit harder than others', etc, but these issues pale in comparison to the challenges with using ERA to evaluating pitching. Just because ERA is more traditional and fits into the old-school definition of baseball stats better doesn't mean it's right. tRA, as well as other advanced statistics, can be found on StatCorner.

*The Raul Ibanez school of defence.

13 recs | Comment 79 comments

Story-email Email Printer Print

Comments

Display:

It may go without saying

but you can read more analysis on tRA from Graham and Matthew at StatCorner.

by katal on Nov 8, 2008 10:22 AM PST reply reply actions actions   0 recs

Is it reasonable to say...

ERA measures overall pitching results.
FIP measures pitching performance.
tRA measures pitching abilities.

by Edgar for Pres on Nov 8, 2008 11:14 AM PST reply reply actions actions   0 recs

Not really.

ERA measures team run prevention, FIP measures pitcher performance, and tRA also measures pitching performance but more accurately.

xFIP and tRA* are pitching ability indicators based on a year’s worth of performance.

by Graham on Nov 8, 2008 11:17 AM PST to parent up reply reply actions actions   0 recs

tRA for minors

Trust it or don’t?

Also, a link between a club’s minor league affiliates and the major league team would be great.

by Edgar for Pres on Nov 8, 2008 11:26 AM PST reply reply actions actions   0 recs

Trust it but watch out for park factors.

We recalculate all the run/out values for each league – it’s accurate apart from not being park corrected.

by Graham on Nov 8, 2008 11:31 AM PST to parent up reply reply actions actions   0 recs

tRA*

What’s this? Some kind of Barry Bonds measurement?

by Two Rs and Two Ls on Nov 8, 2008 11:36 AM PST reply reply actions actions   1 recs

Until you measure quantatively a groundskeepers effect on groundball rates, I say "Pshaw!"

My favorite perennial baseball journalism piece. I had in mind a Jim Edmonds climbing the wall clip, just to be a jerk, but you had to include the line “a few robbed home runs every year”. Covered all the bases on this one, booo.

by dpseadv on Nov 8, 2008 1:45 PM PST reply reply actions actions   0 recs

I feel this post was a pointed message
what with all those scary numbers in it.

Just because some of us have nightmares in which we are chased by giant 2s and tormented by 4s does not mean you should poke fun.

by NOLAmarinergirl on Nov 8, 2008 2:02 PM PST reply reply actions actions   0 recs

This is a much clearer explanation than the one with all the numbers and formulae in

and I’m not saying that facetiously. This was really easy to grasp, and made a lot of sense. Thanks.

Nice Guys Finish Third - Hopelessly lost, but makin' good time.

by pdb on Nov 8, 2008 3:23 PM PST reply reply actions actions   0 recs

Great Explanation

I hate to advocate drugs, alcohol, violence, or insanity to anyone, but they've always worked for me.

by wadswerth on Nov 8, 2008 9:49 PM PST reply reply actions actions   0 recs

I think I understand tRA much better now.

I am glad you explained it, sans the numbers, it made it much easier for a novice like me to understand.

JI/Robert '08!

by Fin on Nov 9, 2008 1:28 AM PST reply reply actions actions   0 recs

The real key was reading this drunk.

Still made sense. Well done.

J.K.L.

by acblue on Nov 9, 2008 1:53 AM PST reply reply actions actions   0 recs

Thanks.

I run screaming from equations (strikingly similiar to NOLA’s nightmare), so this was useful for me.

by Omerta on Nov 9, 2008 7:50 AM PST reply reply actions actions   0 recs

It took me two years to get through Algebra I in high school

The only class I ever failed, and I failed it rather spectacularly. Passed the second time with a D-minus, which was about the happiest day of my academic life.

Nice Guys Finish Third - Hopelessly lost, but makin' good time.

by pdb on Nov 9, 2008 2:10 PM PST to parent up reply reply actions actions   0 recs

The only class I ever came close to failing was chemistry

but that was because the teacher knocked off a half letter grade every time I went on a band performance.

by BrianL on Nov 9, 2008 2:21 PM PST to parent up reply reply actions actions   0 recs

I'm taking Calc right now.

It’s pretty awful. My teacher is impossible to communicate with, and the material keeps coming at light-speed.

Indie.

by Taylor H on Nov 9, 2008 2:14 PM PST to parent up reply reply actions actions   0 recs

I got a C in high school AP Calc

and then went to take first semester Calculus at UPS and my advisor said “No, we won’t let you because you have already seen that material” so I got a C in second semester Calc at UPS when I was just looking for an easy grade

Determined, Jonesing Commentor | Proud proprietor of Washingtonhighways.org

by I'm NOT Corco on Nov 9, 2008 5:30 PM PST to parent up reply reply actions actions   0 recs

Question

What is a line drive? Where do you draw the line between a caught line drive and a fly-out? Do you just take the gameday description of the AB?

by Paytheline on Nov 10, 2008 9:17 AM PST reply reply actions actions   0 recs

Scorekeeper's discretion.

It's hard to convince people to let you eat them if you're an asshole. - Thingray

by Faux on Nov 10, 2008 11:40 AM PST to parent up reply reply actions actions   0 recs

so, wait

what constitutes a line drive is different in each park, depending on the scorekeeper? Matthew’s “we use MLB’s definition” seemed to imply there was a single standard.

Nice Guys Finish Third - Hopelessly lost, but makin' good time.

by pdb on Nov 10, 2008 12:59 PM PST to parent up reply reply actions actions   0 recs

I get that but I'm still wondering where MLB's definitions live

if they’re available to the public that is.

Nice Guys Finish Third - Hopelessly lost, but makin' good time.

by pdb on Nov 10, 2008 1:11 PM PST to parent up reply reply actions actions   0 recs

tRA is a big step over ERA

but like the line drive definition, doesn’t take us out of subjectivity. Other friction points — fly out at the wall vs. WFB style fly-out; where an infield FB becomes an outfield FB; smoked one-hopper through the infield (Graham flags this one).

I’m also suprised that HBP has a greater run probability than a walk, especially since an HBP results in a dead ball, and a walk could include a wild pitch, runners moving, etc.

by Paytheline on Nov 10, 2008 3:54 PM PST to parent up reply reply actions actions   0 recs

Those average out

and HBP’s are greater indications of wildness than walks by themselves.

by Matthew on Nov 10, 2008 4:03 PM PST to parent up reply reply actions actions   0 recs

I'm trying to work the HBP explanation

Seems that if we are measuring independent events for their run producing effect, it is odd to give greater run producing value to an HBP based on the assumption that shittier pitchers throw them.

Assume that the HBP is by a pitcher who pitched to only one batter. Does that change the run probability of HBP?

by Paytheline on Nov 10, 2008 6:50 PM PST to parent up reply reply actions actions   0 recs

That's not the reason HBPs have a higher run value.

HBP have a higher run value because they produce a higher change in run expectancy than walks do, on average.

by Matthew on Nov 10, 2008 6:59 PM PST to parent up reply reply actions actions   0 recs

OK, but why the higher run expectancy?

Or should I just forget about this and move on with my life? If it’s just running the numbers on events (which I assume it is), I’m just curious why it works out that way. Seems counterintuitive because runners can’t advance.

by Paytheline on Nov 10, 2008 7:05 PM PST to parent up reply reply actions actions   0 recs

Because runners almost never advance on a walk either

and HBPs are distributed somewhat randomly, but happen more often for pitchers with bad control. Pitchers with bad control often have more base runners on.

Also, some walks, while not classfied as intentional fall under the non-intention but intentional/pitching around variety which is often deployed in situations where adding a runner to first base doesn’t impact the RE much. That doesn’t happen with HBP.

by Matthew on Nov 10, 2008 7:08 PM PST to parent up reply reply actions actions   0 recs

I love it when the coach visits the mound when a big hitter takes the plate.

You can practically read their lips “pitch to him, but don’t give him anything to hit”. Whatever the hell that’s supposed to mean.

Nice explanation, very concise. I was enjoying this question, and that is a pretty tidy answer.

by dpseadv on Nov 10, 2008 7:13 PM PST to parent up reply reply actions actions   0 recs

thanks, Matthew

I hadn’t considered the “empty first base” issue.

by Paytheline on Nov 11, 2008 9:56 AM PST to parent up reply reply actions actions   0 recs

MLB rulebook

Isn’t this the MLB rulebook?

Beyond that, I do think it’s strange that certain teams seem to show higher LDs – it seemed to me that SF’s staff had a collective increase in their LD rate that didn’t translate into runs allowed. It’ll be interesting to see if any of these (possibly park-related) anomalies continue year after year, or if, gasp, SF’s staff just gave up a lot of LDs last year.

by marc w on Nov 10, 2008 4:26 PM PST to parent up reply reply actions actions   0 recs

So I was discussing statcorner and defensive metrics with a friend.

And we got into our usual argument about catchers. Specifically Dan Wilson and comments he’s made about focusing on the batter despite a runner on first that is a threat to steal second. I’m thinking the quickest way to settle this is looking at the pitching sequences for a catcher like Pudge, who posted some pretty good numbers throwing out runners, and Dan.
I’m going blind trying to find a site that lists the pitch type thrown when a base stealer runs, does such a site even exist? Also, this might not be the best way to go about this, anybody have any better suggestions?

by dpseadv on Nov 10, 2008 6:59 PM PST reply reply actions actions   0 recs

From the primer on the site.
Using play by play data we can, in any given year, determine the average number of outs that was made on a given type of play by simply going through each play and counting the number of outs made on each type of play and dividing by the total number of plays for that type. Fairly straightforward, although a small correction factor has to be introduced to deal with outs made on the bases.

Expected outs are calculated by simply taking the occurrences for each event, for each pitcher, and multiplying by that out factor as outlined above.

by Matthew on Nov 10, 2008 10:01 PM PST to parent up reply reply actions actions   0 recs

Comments For This Post Are Closed


User Tools

By reading a game thread of your own volition you agree to accept all liability for any and all damage done to your delicate sensibilities.
Start posting about the Mariners »

Join SB Nation and dive into communities focused on all your favorite teams.

FanPosts

Community blog posts and discussion.

Recommended FanPosts

Small
Strip Club Cleared to Open Near Safeco Field

Recent FanPosts

Amy_s_pictures1_042_small
Ichiro's comments on his fake flip at Yankee Stadium
Small
Want to go to tonights game in Boston?  Please?
Small
Top 5 IFA Guillermo Pimentel signs with the Mariners?
Clemente_small
OT 7/2/05-- Flag Waving, Long Weekend, 4th of July Holiday edition
Small
Open Sounders vs. Timbers gamethread
Small
Happy Canada Day
Durer2_small
Who will be heir to the King?
Eyebrows_small
OFFTOP 6/29/09 - Avoiding Work Edition
Dscn1856_small
USA vs. Brazil Game Thread
Small
Anyone meeting up in NYC?

Post_icon New FanPost All FanPosts Carrot-mini


Sexy People

Hms_surprise_small Graham

Small Matthew

Small Jeff

Official Partner of Yahoo! Sports