Baseball for the Thinking Fan

Login | Register | Feedback

btf_logo
You are here > Home > Baseball Newsstand > Baseball Primer Newsblog > Discussion
Baseball Primer Newsblog
— The Best News Links from the Baseball Newsstand

Tuesday, February 09, 2010

Tango:  Evaluating the 2009 forecasts - Chone/ZiPS + Fantistics win

[Chone and ZiPS lead the way.  Marcel is where it should be, whil PECOTA once again brings up the rear (just not so obvious this time).

(...)

 

It looks to me like we found our secret recipe: Chone/ZiPS forecasts for rate, with Fantistics for playing time.

So, my question is, what did Nate do with PECOTA that hasn’t been done by the rest of the BP guys since Nate became a politometric dork?  This is the second year that PECOTA got trounced and it also was bottom of the barrel in Tango’s Simulated Draft experiment.

He's Bought a Bat Like Prince Fielder Posted: February 09, 2010 at 05:46 AM | 14 comment(s) | Login to Bookmark
  Related News: ZIPS

Reader Comments and Retorts

Go to end of page

Statements posted here are those of our readers and do not represent the BaseballThinkFactory. Names are provided by the poster and are not verified. We ask that posters follow our submission policy. Please report any inappropriate comments.

Page 1 of 1 pages
   1. Eugene Freedman Posted: February 09, 2010 at 01:21 PM (#3456702)
My only problem with ZIPS and CHONE has been playing time forecasts. The non-rate stats are somewhat irrelevant if you don't consider who is actually going to be playing/pitching. Projecting 500 ABs for a guy who is the 5th OF because that's what his age would indicate makes no sense. Projecting 300 ABs for a guy who is now the starter b/c that's what his history has been makes just as little.
   2. Voros McCracken, Human Shield Posted: February 09, 2010 at 01:33 PM (#3456707)
The problem with projecting playing time is that the vast majority of it is deterministic; IE, guys get as much playing time as their teams give them. Transitioning from predicting ability to predicting behavior is very difficult, and raw statistics can only do so much here.
   3. Eugene Freedman Posted: February 09, 2010 at 01:36 PM (#3456708)
I'm not saying that the computer modeling should predict the playing time. That has to be done manually based upon the best available information before the season.
   4. Home Run Teal & Black Black Black Gone! Posted: February 09, 2010 at 01:36 PM (#3456710)
They're not designed to project playing time, though, and I'm not terribly interested in seeing Brian Bocock's line for the Jays when it reflects the 1% chance he's called up for a week in September or the 98% chance he's not called up at all. I want to see the 1% window where Brian Bocock is used as a major league regular/utility man.

Brian Bocock ss 25 .188 .255 .245 107 400 51 75 15 1 2 39 35 123 9 8 35

This is a glorious projection and your wants would deny me it, so bully to you.

Anyhow, I doubt either Sean or Dan would strenuously object to someone making detailed depth charts and reprojecting their numbers based on that. It's just not what they're personally trying to do.
   5. Jose Can You Seabiscuit Posted: February 09, 2010 at 01:45 PM (#3456714)
I have never even bothered looking at anything other than the rate stats on these projections. I think Teal has it right, just tell me what a guy is going to do when he plays.
   6. Tango Posted: February 09, 2010 at 03:02 PM (#3456758)
My only problem with ZIPS and CHONE has been playing time forecasts.


This is also the problem that Dan and Sean have with them as well, so you are echoing what the creators of those systems are saying.

Fantisitcs apparently is a person or persons that creates playing time forecasts. They did a better job, apparently than the Crowdsource from my Community Forecast project last year.

In my Forecasters Challenge last year, ZiPS, MGL, Steamer and Marcel all used the playing time forecasts from the Community, and they all ended up in the top third of the 22 systems (essentially competing with themselves frankly).

What we also see is that the playing time forecasts are more important than the rate forecasts (for fantasy baseball anyway).

So, I would highly recommend going with Chone or ZiPS on rate, and then going to the Fangraphs playing time forecasts, or Fantistics.

This should pretty much be the best you can hope for.
   7. AROM Posted: February 09, 2010 at 07:27 PM (#3457040)
I'm projecting playing time, but not necessarily major league playing time. Last year I projected 536 PA for Brandon Wood. He actually got 474, but only 46 in the majors. To project 500-750 guys who are mostly going to play in the minors, and forecast 10-50 PA for each doesn't give you much room to qualitatively show their abilities. So I prefer showing more of a full season for presentation purposes.

You want to use your own depth charts with these projections, be my guest.

I have created a spreadsheet for people who want to do their own team record projections. Check it out. I strongly encourage you to form your own team W-L projections. Spreadsheet link in the text at the bottom of that page.
   8. Ron Johnson Posted: February 09, 2010 at 07:50 PM (#3457061)
Chone, thanks for the link.
   9. Eugene Freedman Posted: February 09, 2010 at 09:05 PM (#3457196)
Sean,

That's helpful to know about the PA projections. Looking at them in a vacuum, they almost seemed like hopes or based upon age based/career line projections. They may be the latter, but if they're regardless of level, then they make sense. The only problem becomes projecting distribution. But, that's not computer based.
   10. rudygamble Posted: February 09, 2010 at 09:33 PM (#3457236)
Cool analysis. Last year, we at Razzball used a Marcel/CHONE/ZiPS average for rates and Baseball Prospectus for playing time. Glad to see this general strategy is best (will use just CHONE and ZiPS this year) - surprising that BP gets beat both on projecting stats and playing time. Oh how the mighty have fallen.
   11. NJ is feeling better Posted: February 09, 2010 at 09:56 PM (#3457264)
What about CAIRO?
   12. Der Komminsk-sar Posted: February 09, 2010 at 10:00 PM (#3457268)
I want to very much echo point #4 - both as to the general point and, specifically, on the glorious awfulness of Brian Bocock.
   13. snapper (history's 42nd greatest monster) Posted: February 09, 2010 at 10:07 PM (#3457280)
What about CAIRO?

Only 2 years of history, so probably too soon to include it with the systems that have been around longer.

That said, I'd trust it over Pecota any day.
   14. Ron Johnson Posted: February 09, 2010 at 10:12 PM (#3457283)
#10, It'll be interesting to see how things go with Clay running the forecasts. The last time he had to step in he went very conservative. I can't swear to this, but my recollection is that he cut the standard error quite a bit but left them with fewer projections to really brag upon.

Kind of confirms what Darrell Huff wrote in one of his books. Since nobody really expected projections to be accurate, Gary Huckabay got more credit for a few surprisingly accurate projections than Clay did for a generally more accurate set.
Page 1 of 1 pages

You must be Registered and Logged In to post comments.

 

 

<< Back to main

Support BBTF

donate

Thanks to
tl; dr (Voxter)
for his generous support.

Bookmarks

You must be logged in to view your Bookmarks.

Hot Topics

Newsblog'Duk: Tim Lincecum slims down with swim routine, loses appetite for McDonald’s
(144 - 12:12am, Feb 08)
Last: Ron J

NewsblogWHALEN: Erstad talks big game, but let’s see if Huskers deliver
(1 - 11:57pm, Feb 07)
Last: Jim (jimmuscomp)

NewsblogSources: Cubs’ Starlin Castro Accused Of Sexual Assault
(5526 - 11:56pm, Feb 07)
Last: McCoy

Hall of MeritMost Meritorious Player : 1969 Discussion
(61 - 11:55pm, Feb 07)
Last: lieiam

NewsblogL.A. Times: Dodgers sign Clayton Kershaw to two-year, $19-million deal
(2 - 11:48pm, Feb 07)
Last: Tuque

NewsblogDJF: Decipher the Mind of Brett Lawrie with Translawrieate
(8 - 11:39pm, Feb 07)
Last: Yankee Redneck is a Pinhead.

NewsblogOT: NBA Monthly Thread, February 2012
(226 - 11:29pm, Feb 07)
Last: Athletic Supporter leads the nation in drifters

NewsblogOT: The Soccer Thread: January 2012
(719 - 11:26pm, Feb 07)
Last: Swedish Chef

NewsblogMONEYBALL~ Oscar Nominations 2012: Academy Award Nominees List ~ MONEYBALL
(556 - 11:07pm, Feb 07)
Last: Dock Ellis on Acid

NewsblogBASN: The MLB FRAUD - Oakland, Los Angeles, and New York
(45 - 11:02pm, Feb 07)
Last: Yankee Redneck is a Pinhead.

NewsblogEdwin Jackson turned down three-year offer from Pirates
(57 - 10:53pm, Feb 07)
Last: The District Attorney

NewsblogTrump's Son-In-Law Seeks To Buy Dodgers
(13 - 9:35pm, Feb 07)
Last: AndrewJ

NewsblogBeane To Sign Extension Through 2019
(8 - 9:07pm, Feb 07)
Last: Bitter Calculus Instructor

NewsblogNYBD: Silva: Yankees Fragrance and 1996?
(2 - 8:21pm, Feb 07)
Last: Mayor Blomberg

Transaction Oracle2012 ZiPS Projections - Miami Marlins
(31 - 8:16pm, Feb 07)
Last: Misirlou's got a busy day, he's wearing a vest

Buy MLB playoff tickets, plus 2011 World Series, 2011 ALCS tickets and NLCS game tickets. We also have Texas Rangers playoff schedule, tickets to Red Sox games and Yankees game tickets. Plus, buy Phillies baseball tickets, Tigers playoff tickets and the biggies like ALDS baseball tickets and 2011 NLDS tickets.

Demarini, Easton and TPX Baseball Bats

 

 

 

AllianceTickets.com has cheap MLB Tickets. Get all your Colorado Rockies Tickets, Seattle Mariners Tickets, San Francisco Giants Tickets and all your favorite baseball tickets here. We also carry cheap Denver Broncos Tickets, Seattle Seahawks Tickets and Denver Nuggets Tickets.

Page rendered in 0.3506 seconds
40 querie(s) executed