Baseball for the Thinking Fan

Login | Register | Feedback

btf_logo
You are here > Home > Baseball Newsstand > Baseball Primer Newsblog > Discussion
Baseball Primer Newsblog
— The Best News Links from the Baseball Newsstand

Wednesday, February 26, 2014

James: On the Relative Importance of Pitching Categories (Registration Required)

Part I:

Which pitching stats are most closely connected to value?... I took all pitchers in history who pitched 199.0 to 201.0 innings… The more often a category agrees with the bottom line, the more closely it is connected to Value.

What is Value?  I decided to use Fangraphs WAR as “true value”.

Part II:

1)  Home Runs Allowed (55.4%).  Among the twelve pitching categories that I studied, Home Runs Allowed are the poorest predictor of overall value…

2)  ERA (57.4%)...

3)  Runs Allowed Per 9 Innings (58.9%)...

4)  WHIP (60.01%)... 

5)  Strikeout Rate (60.5%)...

6) Won-Lost Records (60.9%)... First of all, we should make sure everyone understands that the “ERA” that performs poorly here is ERA not adjusted for the league ERA…

I started to think about this article in January, when I was on Brian Kenny’s show, and Brian asked me whether I would join in the effort to get rid of the “Win” stat.   I said “No”, and the reason I said “No” is that I’m not generally in favor of getting rid of information…

I might argue that fans in general have a stronger grasp of the biases inherent in won-lost records from the teams on which people pitched than they do of the ERA bias from leagues…

The won-lost record has a tremendous advantage over almost any other stat, in that the winning percentage is always .500 in every decade, in every year, in every month—and in every park…

6)  Walks Per Nine Innings (61.2%)... 

5)  Winning Percentage (61.5%)....

4)  Season Score (62.6%) [this is a new stat that assigns weights to the basic pitching stats - TDA]... 

3)  Relative ERA [63.6%]... This Relative ERA was NOT park-adjusted…

1 and 2)  Strikeouts Minus Walks (65.2%) and Strikeout to Walk Ratio (65.4%) essentially tied as the best predictors of True Value, among the twelve categories studied.

Of course, it is possible that Strikeouts and Walks perform best as a predictor of Wins Above Replacement because Fangraphs is relying too heavily on strikeouts and walks in their calculation of the pitcher’s value… I will have to tell you, honestly, that I was surprised by how many cases there are in which F-WAR gives seemingly irrational answers in comparing two pitchers… I am not saying that Fangraphs is wrong in any of these comparisons; it is quite possible that, if I knew more about the calculations, I would agree with them.  I know very well that many times what seems like an obvious conclusion from the statistics will not stand up to closer scrutiny, and the researcher will wind up arguing that what appears to be true is not actually true.  I’ve seen that myself a thousand times.

But I also know very well, from years of doing it, that the process of weighing and measuring every stat so as to determine overall value is a treacherous and difficult task, and that there are thousands of ways you can get the wrong answer.    I’ve done that myself a great many times, as well.  I am less convinced than I would like to be that these evaluations are accurate.

The District Attorney Posted: February 26, 2014 at 11:50 AM | 11 comment(s) Login to Bookmark
  Tags: bill james, sabermetrics

Reader Comments and Retorts

Go to end of page

Statements posted here are those of our readers and do not represent the BaseballThinkFactory. Names are provided by the poster and are not verified. We ask that posters follow our submission policy. Please report any inappropriate comments.

   1. Sean Forman Posted: February 26, 2014 at 01:27 PM (#4662918)
Is Bill aware that fWAR for pitchers is basically just a combination of Walks, SO and HR?
   2. PreservedFish Posted: February 26, 2014 at 01:35 PM (#4662929)
It looks like he figured that out halfway through the study...

Of course, it is possible that Strikeouts and Walks perform best as a predictor of Wins Above Replacement because Fangraphs is relying too heavily on strikeouts and walks in their calculation of the pitcher’s value… I will have to tell you, honestly, that I was surprised by how many cases there are in which F-WAR gives seemingly irrational answers in comparing two pitchers…

I am less convinced than I would like to be that these evaluations are accurate.


Nice work Bill!

Do you think the Red Sox get his A-game, or is he just a Statistician Emeritus at this point?
   3. Baldrick Posted: February 26, 2014 at 01:44 PM (#4662941)
So...a statistic that inputs strikeouts, walks, and HR is really sensitive to good numbers of strikeouts and walks?

I'm shocked.
   4. dave h Posted: February 26, 2014 at 02:04 PM (#4662974)
I want fWAR for pitchers to die in a fire.
   5. cardsfanboy Posted: February 26, 2014 at 02:15 PM (#4662996)
I want fWAR for pitchers to die in a fire.


I hate fWar as much as anyone, but it has it's uses. I mean realistically all you really need is fip and could probably ignore fWar, but it's another way at looking at fip. There are other stats that need to die first (any stat that is /9 based of course, needs to be replaced by a percentage)
   6. Zach Posted: February 26, 2014 at 02:32 PM (#4663018)
I was going to say, you could just look up the formula if you care that much.
   7. PreservedFish Posted: February 26, 2014 at 02:58 PM (#4663042)
This is seriously embarrassing.
   8. The District Attorney Posted: February 26, 2014 at 04:07 PM (#4663084)
Even if BB, K, and HR weren't inputs into fWAR, I still don't think I understand what this was attempting to prove. If the pitcher's "value" is minimizing run scoring, by whatever measurement... and we already know how much BB/K/HR/etc. contribute to run scoring, via stats as old as Runs Created... then, well, what are we doing?

It seems like it'd be a lot more useful to examine what stat best predicts how good the guy will be next year. (I'm sure that's been done a million times, but I haven't seen it in quite a while, and I'd be curious to see an update.)
   9. Robert in Manhattan Beach Posted: February 26, 2014 at 04:44 PM (#4663119)
I will have to tell you, honestly, that I was surprised by how many cases there are in which F-WAR gives seemingly irrational answers in comparing two pitchers… I am not saying that Fangraphs is wrong in any of these comparisons

They're wrong. It's bad enough to do a study like this but why on earth would you share it with people?
   10. Rob_Wood Posted: February 26, 2014 at 11:37 PM (#4663308)
I don't blame Bill for this is an example of the law of unintended consequences. The internet allows (encourages) all sorts of "analyses" that would not have seen the light of day in an era of peer review -- and by peer review I mean showing it to someone else before publishing it.
   11. PASTE Thinks This Trout Kid Might Be OK (Zeth) Posted: February 27, 2014 at 10:16 PM (#4663912)
Do you think the Red Sox get his A-game, or is he just a Statistician Emeritus at this point?


Likely a little of both. Even among hobbies the stuff he posts on BJO is only a time-killer and small income-booster for him; his serious hobby is reading and writing about murder stories.

You must be Registered and Logged In to post comments.

 

 

<< Back to main

BBTF Partner

Support BBTF

donate

Thanks to
The Piehole of David Wells
for his generous support.

Bookmarks

You must be logged in to view your Bookmarks.

Hot Topics

NewsblogJays hitting coach Brook Jacoby suspended 14 games
(31 - 7:12am, May 06)
Last: PASTE Thinks This Trout Kid Might Be OK (Zeth)

NewsblogBattering the Batter
(1 - 6:04am, May 06)
Last: Mirabelli Dictu (Chris McClinch)

NewsblogOTP - May 2015: Jeb Bush would like to watch baseball with Teddy Roosevelt and Pitbull
(826 - 5:52am, May 06)
Last: BrianBrianson

Newsblog5-5-2015 OMNICHATTER
(120 - 5:07am, May 06)
Last: Get A Brian Harper, Morans!

NewsblogKyle Farnsworth is a defensive lineman now, and he leads his team in sacks
(26 - 5:06am, May 06)
Last: Tuque

NewsblogTyler Tumminia Has Baseball In Her Blood
(7 - 4:35am, May 06)
Last: Jacob

NewsblogMitch Williams, Lenny Dykstra clash during Philly Sports Roast (Video) | Big League Stew - Yahoo Sports
(17 - 3:37am, May 06)
Last: Jeltzandini

NewsblogOT: Monthly NBA Thread - May 2015
(388 - 2:41am, May 06)
Last: Maxwn

NewsblogIn firing manager Ron Roenicke now, Milwaukee Brewers bring decisions they made in past into question, and now must act fast to avoid prolonging the current downward spiral, Ken Rosenthal writes | FOX Sports
(13 - 1:21am, May 06)
Last: DFA

NewsblogJered Weaver: “I’m not hurt … I’ve got no answers”
(9 - 12:50am, May 06)
Last: The TVerik of Lordly Might

NewsblogOT: 2015 NHL Playoff thread
(157 - 12:39am, May 06)
Last: Langer Monk

NewsblogTwo Dudes Smooch On Dodgers' Kiss Cam, To Hearty Applause
(102 - 12:02am, May 06)
Last: Spahn Insane, D0ngwr@ngler

Hall of MeritMost Meritorious Player: 1904 Ballot
(19 - 11:27pm, May 05)
Last: neilsen

Newsblog10 Degrees: Jered Weaver's fastball can't even break a Texas speed limit, and what it means for his future - Yahoo Sports
(25 - 11:06pm, May 05)
Last: shoewizard

NewsblogBrewers fire manager Ron Roenicke, reportedly set to hire Craig Counsell
(92 - 10:57pm, May 05)
Last: PASTE Thinks This Trout Kid Might Be OK (Zeth)

Page rendered in 0.2143 seconds
48 querie(s) executed