Baseball for the Thinking Fan

Login | Register | Feedback

btf_logo
You are here > Home > Baseball Newsstand > Baseball Primer Newsblog > Discussion
Baseball Primer Newsblog
— The Best News Links from the Baseball Newsstand

Thursday, October 25, 2012

Should we ever use a complex ERA estimator?

KISS.

There’s a chance that the more complex estimators work better for special circumstances, like pitchers who change teams, throw a ton of groundballs, or are remarkably adept at keeping the ball in the yard. Also, they could add descriptive value over simply using the combination of FIP and batting average on balls in play, but I have yet to hear a really great argument explaining that fact.

What I can tell you though is that when a predictor is made more complex, it must add more predictive value, by a significant amount. If it does not, then my only response can be just two words:

Occam’s Razor.

Jim Furtado Posted: October 25, 2012 at 09:51 AM | 10 comment(s) Login to Bookmark
  Tags: sabermetrics

Reader Comments and Retorts

Go to end of page

Statements posted here are those of our readers and do not represent the BaseballThinkFactory. Names are provided by the poster and are not verified. We ask that posters follow our submission policy. Please report any inappropriate comments.

   1. Drew (Primakov, Gungho Iguanas) Posted: October 25, 2012 at 09:58 AM (#4282854)
Why isn't the response, "Scrap it"?
   2. Mike Emeigh Posted: October 25, 2012 at 10:41 AM (#4282896)
What I can tell you though is that when a predictor is made more complex, it must add more predictive value, by a significant amount. If it does not, then my only response can be just two words:

Occam’s Razor.


Or maybe it's an indication that the underlying behavior is more complex that your simple model of the relationship.

-- MWE

   3. snapper (history's 42nd greatest monster) Posted: October 25, 2012 at 10:44 AM (#4282902)
What I can tell you though is that when a predictor is made more complex, it must add more predictive value, by a significant amount. If it does not, then my only response can be just two words:

Occam’s Razor.


I don't necessarily agree with this. All these FIP/xFIP etc are already way past the point that the avg. fans (even stat inclined) can calculate them himself. With modern computing power, who cares how complex it is?

If a full projection system like ZiPs/Oliver/Cairo is necessary to get the best estimate, why do I care if it's complex?
   4. DJS and the Infinite Sadness Posted: October 25, 2012 at 11:03 AM (#4282917)

If a full projection system like ZiPs/Oliver/Cairo is necessary to get the best estimate, why do I care if it's complex?


Yeah, it's not like I make you guys run ZiPS! Whether you like or don't like the projections, for the end-user, the only complexity is looking at a website.
   5. snapper (history's 42nd greatest monster) Posted: October 25, 2012 at 11:36 AM (#4282942)

Yeah, it's not like I make you guys run ZiPS! Whether you like or don't like the projections, for the end-user, the only complexity is looking at a website.


Question, Dan. Is ZiPs a full blown regression/forecasting model?
   6. cardsfanboy Posted: October 25, 2012 at 12:49 PM (#4283007)
What I can tell you though is that when a predictor is made more complex, it must add more predictive value, by a significant amount. If it does not, then my only response can be just two words:


Is Fip better than component era by a significant amount? I thought it was barely noticeable difference.
   7. TomH Posted: October 25, 2012 at 01:54 PM (#4283102)
Tom's postulate:
differences in pitching projections are not primarily driven by differences in ERA estimator systems
differences in pitching projections are primarily driven by differences in change-over-time, park-and-defense effect adjustments, and possibly minor-league weighting of estimator systems

(edited)
   8. Tricky Dick Posted: October 25, 2012 at 02:19 PM (#4283117)
I like having all of the estimators available. I think the mistake is to fall in love with one particular estimator as the be all, end all method. My philosophy: look at all of the results and use your judgement in how to weight them. If one method produces an outlier result for a pitcher, think about why that may be the case, and either reject the outlier or use the outlier to temper your view of the other methods (depending on the circumstances).

Generally, FIP and x-FIP are pretty good (and produce similar results to SIERA or tERA), but I think there are occasions when factors like groundball tendency are important, and the more complex estimator may provide additional useful information.
   9. birdlives is one crazy ninja Posted: October 25, 2012 at 07:02 PM (#4283432)
Question, Dan. Is ZiPs a full blown regression/forecasting model?

I've heard Dan say that ZiPs relies on Monto Carlo simulations, which I believe doesn't rely upon any linear or non-linear regression models.
   10. snapper (history's 42nd greatest monster) Posted: October 25, 2012 at 09:35 PM (#4283667)
I've heard Dan say that ZiPs relies on Monto Carlo simulations, which I believe doesn't rely upon any linear or non-linear regression models.

How does he get the means and distributions for the simulations? i.e. how do you translate past stats into future probabilities w/o regression?

You must be Registered and Logged In to post comments.

 

 

<< Back to main

BBTF Partner

Support BBTF

donate

Thanks to
Forsch 10 From Navarone (Dayn)
for his generous support.

Bookmarks

You must be logged in to view your Bookmarks.

Hot Topics

NewsblogWhat's Buster Posey's best trait as a catcher? Here's what his pitchers had to say - Giants Extra
(5 - 5:47am, Oct 24)
Last: Morty Causa

NewsblogAJC: Hart says ‘yes’ to Braves, will head baseball operations
(15 - 5:31am, Oct 24)
Last: Morty Causa

NewsblogGleeman: Royals may bench Norichika Aoki for Game 3
(21 - 3:00am, Oct 24)
Last: PreservedFish

Newsblog9 reasons Hunter Pence is the most interesting man in the World (Series) | For The Win
(8 - 2:52am, Oct 24)
Last: mex4173

NewsblogOT: Monthly NBA Thread - October 2014
(368 - 2:12am, Oct 24)
Last: RollingWave

NewsblogOT: Politics, October 2014: Sunshine, Baseball, and Etch A Sketch: How Politicians Use Analogies
(3402 - 1:51am, Oct 24)
Last: Swoboda is freedom

NewsblogKey question GMs have to weigh with top World Series free agents | New York Post
(28 - 12:50am, Oct 24)
Last: Dale Sams

NewsblogOT: NBC.news: Valve isn’t making one gaming console, but multiple ‘Steam machines’
(867 - 12:47am, Oct 24)
Last: Poster Nutbag

NewsblogPrimer Dugout (and link of the day) 10-23-2014
(13 - 11:36pm, Oct 23)
Last: EddieA

NewsblogDealing or dueling – what’s a manager to do? | MGL on Baseball
(44 - 11:31pm, Oct 23)
Last: villageidiom

NewsblogRoyals are not the future of baseball | FOX Sports
(39 - 11:25pm, Oct 23)
Last: villageidiom

NewsblogOT: NFL/NHL thread
(8370 - 11:22pm, Oct 23)
Last: Russlan is fond of Dillon Gee

NewsblogI hope this doesn't get me fired. | FOX Sports
(23 - 11:17pm, Oct 23)
Last: Walt Davis

NewsblogGold Glove Awards finalists revealed | MLB.com
(53 - 11:07pm, Oct 23)
Last: cardsfanboy

NewsblogOT: The Soccer Thread, September 2014
(904 - 10:56pm, Oct 23)
Last: frannyzoo

Page rendered in 0.2517 seconds
52 querie(s) executed