Baseball for the Thinking Fan

Login | Register | Feedback

btf_logo
You are here > Home > Baseball Newsstand > Baseball Primer Newsblog > Discussion
Baseball Primer Newsblog
— The Best News Links from the Baseball Newsstand

Thursday, October 25, 2012

Should we ever use a complex ERA estimator?

KISS.

There’s a chance that the more complex estimators work better for special circumstances, like pitchers who change teams, throw a ton of groundballs, or are remarkably adept at keeping the ball in the yard. Also, they could add descriptive value over simply using the combination of FIP and batting average on balls in play, but I have yet to hear a really great argument explaining that fact.

What I can tell you though is that when a predictor is made more complex, it must add more predictive value, by a significant amount. If it does not, then my only response can be just two words:

Occam’s Razor.

Jim Furtado Posted: October 25, 2012 at 09:51 AM | 10 comment(s) Login to Bookmark
  Tags: sabermetrics

Reader Comments and Retorts

Go to end of page

Statements posted here are those of our readers and do not represent the BaseballThinkFactory. Names are provided by the poster and are not verified. We ask that posters follow our submission policy. Please report any inappropriate comments.

   1. Drew (Primakov, Gungho Iguanas) Posted: October 25, 2012 at 09:58 AM (#4282854)
Why isn't the response, "Scrap it"?
   2. Mike Emeigh Posted: October 25, 2012 at 10:41 AM (#4282896)
What I can tell you though is that when a predictor is made more complex, it must add more predictive value, by a significant amount. If it does not, then my only response can be just two words:

Occam’s Razor.


Or maybe it's an indication that the underlying behavior is more complex that your simple model of the relationship.

-- MWE

   3. snapper (history's 42nd greatest monster) Posted: October 25, 2012 at 10:44 AM (#4282902)
What I can tell you though is that when a predictor is made more complex, it must add more predictive value, by a significant amount. If it does not, then my only response can be just two words:

Occam’s Razor.


I don't necessarily agree with this. All these FIP/xFIP etc are already way past the point that the avg. fans (even stat inclined) can calculate them himself. With modern computing power, who cares how complex it is?

If a full projection system like ZiPs/Oliver/Cairo is necessary to get the best estimate, why do I care if it's complex?
   4. DJS and the Infinite Sadness Posted: October 25, 2012 at 11:03 AM (#4282917)

If a full projection system like ZiPs/Oliver/Cairo is necessary to get the best estimate, why do I care if it's complex?


Yeah, it's not like I make you guys run ZiPS! Whether you like or don't like the projections, for the end-user, the only complexity is looking at a website.
   5. snapper (history's 42nd greatest monster) Posted: October 25, 2012 at 11:36 AM (#4282942)

Yeah, it's not like I make you guys run ZiPS! Whether you like or don't like the projections, for the end-user, the only complexity is looking at a website.


Question, Dan. Is ZiPs a full blown regression/forecasting model?
   6. cardsfanboy Posted: October 25, 2012 at 12:49 PM (#4283007)
What I can tell you though is that when a predictor is made more complex, it must add more predictive value, by a significant amount. If it does not, then my only response can be just two words:


Is Fip better than component era by a significant amount? I thought it was barely noticeable difference.
   7. TomH Posted: October 25, 2012 at 01:54 PM (#4283102)
Tom's postulate:
differences in pitching projections are not primarily driven by differences in ERA estimator systems
differences in pitching projections are primarily driven by differences in change-over-time, park-and-defense effect adjustments, and possibly minor-league weighting of estimator systems

(edited)
   8. Tricky Dick Posted: October 25, 2012 at 02:19 PM (#4283117)
I like having all of the estimators available. I think the mistake is to fall in love with one particular estimator as the be all, end all method. My philosophy: look at all of the results and use your judgement in how to weight them. If one method produces an outlier result for a pitcher, think about why that may be the case, and either reject the outlier or use the outlier to temper your view of the other methods (depending on the circumstances).

Generally, FIP and x-FIP are pretty good (and produce similar results to SIERA or tERA), but I think there are occasions when factors like groundball tendency are important, and the more complex estimator may provide additional useful information.
   9. birdlives is one crazy ninja Posted: October 25, 2012 at 07:02 PM (#4283432)
Question, Dan. Is ZiPs a full blown regression/forecasting model?

I've heard Dan say that ZiPs relies on Monto Carlo simulations, which I believe doesn't rely upon any linear or non-linear regression models.
   10. snapper (history's 42nd greatest monster) Posted: October 25, 2012 at 09:35 PM (#4283667)
I've heard Dan say that ZiPs relies on Monto Carlo simulations, which I believe doesn't rely upon any linear or non-linear regression models.

How does he get the means and distributions for the simulations? i.e. how do you translate past stats into future probabilities w/o regression?

You must be Registered and Logged In to post comments.

 

 

<< Back to main

BBTF Partner

Support BBTF

donate

Thanks to
danielj
for his generous support.

Bookmarks

You must be logged in to view your Bookmarks.

Hot Topics

NewsblogPrimer Dugout (and link of the day) 7-28-2014
(11 - 10:22am, Jul 28)
Last: BDC

NewsblogOTP - July 2014: Republicans Lose To Democrats For Sixth Straight Year In Congressional Baseball Game
(3302 - 10:19am, Jul 28)
Last: Lassus

NewsblogOT: The Soccer Thread July, 2014
(434 - 10:18am, Jul 28)
Last: Shooty Survived the Shutdown of '14!

NewsblogTigers Display Focus on 2014; acquire Joakim Soria
(8 - 10:13am, Jul 28)
Last: The Good Face

NewsblogOT: Monthly NBA Thread- July 2014
(968 - 10:13am, Jul 28)
Last: Der-K thinks the Essex Green were a good band.

NewsblogNoble: Tom Seaver expects Derek Jeter to become first unanimous Hall of Fame inductee
(96 - 10:10am, Jul 28)
Last: BDC

NewsblogDodgers and Diamondbacks Triple-A teams involved in wild brawl
(17 - 10:08am, Jul 28)
Last: PreservedFish

NewsblogFull Count » Mike Carp explains why he requested a trade from Red Sox
(19 - 10:07am, Jul 28)
Last: billyshears

NewsblogDJ Short: Maximum stay on Hall of Fame ballot changed from 15 to 10 years
(58 - 10:07am, Jul 28)
Last: Ron J2

NewsblogSchoenfield: Why didn't the Braves win more titles?
(65 - 9:46am, Jul 28)
Last: Jeltzandini

NewsblogFull Count » Mike Carp, Felix Doubront and the challenges of player discontent on a struggling team
(11 - 9:15am, Jul 28)
Last: Jose Can Still Seabiscuit

SABR - BBTF ChapterWho's going to SABR??
(101 - 8:34am, Jul 28)
Last: Foghorn Leghorn

NewsblogGossage on Bonds, McGwire Hall hopes: ‘Are you f–king kidding?’
(107 - 7:55am, Jul 28)
Last: Jeltzandini

NewsblogHall of Fame Announces Changes to Voting Process for Recently Retired Players, Effective Immediately
(84 - 6:38am, Jul 28)
Last: Sunday silence

NewsblogRoger Angell goes into the Hall of Fame
(28 - 12:49am, Jul 28)
Last: bobm

Page rendered in 0.2442 seconds
52 querie(s) executed