Baseball for the Thinking Fan

Login | Register | Feedback

btf_logo
You are here > Home > Baseball Newsstand > Baseball Primer Newsblog > Discussion
Baseball Primer Newsblog
— The Best News Links from the Baseball Newsstand

Tuesday, February 09, 2010

Tango:  Evaluating the 2009 forecasts - Chone/ZiPS + Fantistics win

[Chone and ZiPS lead the way.  Marcel is where it should be, whil PECOTA once again brings up the rear (just not so obvious this time). 

(...)

 

It looks to me like we found our secret recipe: Chone/ZiPS forecasts for rate, with Fantistics for playing time.

So, my question is, what did Nate do with PECOTA that hasn’t been done by the rest of the BP guys since Nate became a politometric dork?  This is the second year that PECOTA got trounced and it also was bottom of the barrel in Tango’s Simulated Draft experiment.

He's Bought a Bat Like Prince Fielder Posted: February 09, 2010 at 01:46 AM | 14 comment(s)
  Related News: ZIPS

Reader Comments and Retorts

Go to end of page

Statements posted here are those of our readers and do not represent the BaseballThinkFactory. Names are provided by the poster and are not verified. We ask that posters follow our submission policy. Please report any inappropriate comments.

Page 1 of 1 pages
   1. Eugene Freedman  Posted: February 09, 2010 at 09:21 AM (#3456702)
My only problem with ZIPS and CHONE has been playing time forecasts. The non-rate stats are somewhat irrelevant if you don't consider who is actually going to be playing/pitching. Projecting 500 ABs for a guy who is the 5th OF because that's what his age would indicate makes no sense. Projecting 300 ABs for a guy who is now the starter b/c that's what his history has been makes just as little.
   2. Voros  Posted: February 09, 2010 at 09:33 AM (#3456707)
The problem with projecting playing time is that the vast majority of it is deterministic; IE, guys get as much playing time as their teams give them. Transitioning from predicting ability to predicting behavior is very difficult, and raw statistics can only do so much here.
   3. Eugene Freedman  Posted: February 09, 2010 at 09:36 AM (#3456708)
I'm not saying that the computer modeling should predict the playing time. That has to be done manually based upon the best available information before the season.
   4. Teal & Black Tie's Giant Masturbatory Ninja Brain  Posted: February 09, 2010 at 09:36 AM (#3456710)
They're not designed to project playing time, though, and I'm not terribly interested in seeing Brian Bocock's line for the Jays when it reflects the 1% chance he's called up for a week in September or the 98% chance he's not called up at all. I want to see the 1% window where Brian Bocock is used as a major league regular/utility man.

Brian Bocock ss 25 .188 .255 .245 107 400 51 75 15 1 2 39 35 123 9 8 35

This is a glorious projection and your wants would deny me it, so bully to you.

Anyhow, I doubt either Sean or Dan would strenuously object to someone making detailed depth charts and reprojecting their numbers based on that. It's just not what they're personally trying to do.
   5. Jose Can You Seabiscuit  Posted: February 09, 2010 at 09:45 AM (#3456714)
I have never even bothered looking at anything other than the rate stats on these projections. I think Teal has it right, just tell me what a guy is going to do when he plays.
   6. Tango  Posted: February 09, 2010 at 11:02 AM (#3456758)
My only problem with ZIPS and CHONE has been playing time forecasts.


This is also the problem that Dan and Sean have with them as well, so you are echoing what the creators of those systems are saying.

Fantisitcs apparently is a person or persons that creates playing time forecasts. They did a better job, apparently than the Crowdsource from my Community Forecast project last year.

In my Forecasters Challenge last year, ZiPS, MGL, Steamer and Marcel all used the playing time forecasts from the Community, and they all ended up in the top third of the 22 systems (essentially competing with themselves frankly).

What we also see is that the playing time forecasts are more important than the rate forecasts (for fantasy baseball anyway).

So, I would highly recommend going with Chone or ZiPS on rate, and then going to the Fangraphs playing time forecasts, or Fantistics.

This should pretty much be the best you can hope for.
   7. AROM  Posted: February 09, 2010 at 03:27 PM (#3457040)
I'm projecting playing time, but not necessarily major league playing time. Last year I projected 536 PA for Brandon Wood. He actually got 474, but only 46 in the majors. To project 500-750 guys who are mostly going to play in the minors, and forecast 10-50 PA for each doesn't give you much room to qualitatively show their abilities. So I prefer showing more of a full season for presentation purposes.

You want to use your own depth charts with these projections, be my guest.

I have created a spreadsheet for people who want to do their own team record projections. Check it out. I strongly encourage you to form your own team W-L projections. Spreadsheet link in the text at the bottom of that page.
   8. Ron Johnson  Posted: February 09, 2010 at 03:50 PM (#3457061)
Chone, thanks for the link.
   9. Eugene Freedman  Posted: February 09, 2010 at 05:05 PM (#3457196)
Sean,

That's helpful to know about the PA projections. Looking at them in a vacuum, they almost seemed like hopes or based upon age based/career line projections. They may be the latter, but if they're regardless of level, then they make sense. The only problem becomes projecting distribution. But, that's not computer based.
   10. rudygamble  Posted: February 09, 2010 at 05:33 PM (#3457236)
Cool analysis. Last year, we at Razzball used a Marcel/CHONE/ZiPS average for rates and Baseball Prospectus for playing time. Glad to see this general strategy is best (will use just CHONE and ZiPS this year) - surprising that BP gets beat both on projecting stats and playing time. Oh how the mighty have fallen.
   11. NJ in DC (Now searching for employment!)  Posted: February 09, 2010 at 05:56 PM (#3457264)
What about CAIRO?
   12. Der Komminsk-sar  Posted: February 09, 2010 at 06:00 PM (#3457268)
I want to very much echo point #4 - both as to the general point and, specifically, on the glorious awfulness of Brian Bocock.
   13. snapper  Posted: February 09, 2010 at 06:07 PM (#3457280)
What about CAIRO?

Only 2 years of history, so probably too soon to include it with the systems that have been around longer.

That said, I'd trust it over Pecota any day.
   14. Ron Johnson  Posted: February 09, 2010 at 06:12 PM (#3457283)
#10, It'll be interesting to see how things go with Clay running the forecasts. The last time he had to step in he went very conservative. I can't swear to this, but my recollection is that he cut the standard error quite a bit but left them with fewer projections to really brag upon.

Kind of confirms what Darrell Huff wrote in one of his books. Since nobody really expected projections to be accurate, Gary Huckabay got more credit for a few surprisingly accurate projections than Clay did for a generally more accurate set.
Page 1 of 1 pages

You must be Registered and Logged In to post comments.

 

<< Back to main

Support BBTF

donate

Thanks to
Adam M
for his generous support.

My Bookmarks

You must be logged in to view your Bookmarks.

Vivid Seats is a sports ticket broker, concert ticket broker and theater ticket broker offering the best baseball tickets like Yankees tickets, Cubs tickets, and Red Sox tickets, as well as Police reunion tour tickets and Jersey Boys tickets.

We have baseball tickets, the NFL schedule, college football tickets and Cowboys tickets. We have NBA tickets like Celtics tickets and Lakers tickets. Plus, buy concert tickets, Patriots tickets and Colts tickets. Also check out our MLB baseball schedule

Baseball Bats

 

 

 

Find Yankee collectibles and more

Major League Baseball: All Star Game, New York Yankees, Boston Red Sox, LA Angels, Washington Nationals, Chicago White Sox, and the Chicago Cubs.

Find amazing, cheap New York Yankees tickets for the 2010 season at Yankees Stadium, terrific Chicago Cubs tickets for Wrigley Field bleacher seats, Boston Red Sox tickets for Fenway and the Green Monster, and cheap tickets to any MLB baseball game.

Alliance Tickets has cheap tickets available to all MLB games. We also have tickets to major concerts and theater events. Get tickets to the Colorado Rockies, the Seattle Mariners and all your favorite baseball teams. We also carry tickets to all the major Sporting Events.

Page rendered in 1.0041 seconds
61 querie(s) executed