Go straight to the Projection Update!
With the month of June Starting, I thought it would be kind of fun to see how my projections have done so far, compared to some of the more high profile names out there. I will issue the words of caution here that it is just June, and lots can happen to the stats of various players.
I also decided to post some more projections of players who have, during the season, managed to obtain a position where they are currently getting some playing time. This happens usually when someone gets injured, but sometimes they just win the job. On the same page, I've also finally added the projections for the hitters lucky enough to play their home games in Coors. Yes, I now have the projections up for all of the Colorado regulars. These projections do not use any of the current season performance (minors or majors) as a basis. They appear the same as if they were posted before the season started. They can all be found here.
I'll also add that I won't use any of these projections when evaluating how well the projections have done (neither now, nor at the end of the season). Obviously if they're not up by the time the season is underway, it's hard to fairly include them in the analysis.
As of games of June 1st, I decided I would take a quick look at how my projections are doing compared to others. I'm going to do a quick comparison of mine, with those of Stats, Inc. (as published in their yearly handbook), CBS Sportsline and Diamond Mind Baseball (A computer simulation game). I simply am going to compare OPS at this point (though when the season's over, I'll get much more in depth and maybe use other sources as well).
What I did was keep track of the projected OPS for each player from each source, and use the least squares method to obtain a correlation coefficient between the projected OPS for each source and the actual current OPS. (For all of you who don't speak math: I looked at what was projected and used a valid statistical technique to compare it with what has happened). I only did comparisons for those players with 148 or more At Bats plus Walks thus far (and, of course, had projections posted by me before the season started), of which there were 176 players. The results:
| Source | Corr. Coeff. | Average Error |
|---|---|---|
| Voros | 0.626 | 0.097 |
| Stats Inc. | 0.584 | 0.102 |
| CBS Sportsline | 0.514 | 0.103 |
| Diamond Mind Baseball | 0.562 | 0.102 |
The first thing I'd like to state is that I think all of these are pretty good, and better than I'd thought we'd get this early in the season. Now, I'll state very clearly here that it's early, and that those aren't very big differences (they shouldn't be as the projections were all reasonably close to each other). I'll also state that CBS Sportsline's projections pretty clearly look to be just simple estimations based on fairly recent performance without taking into account minor league numbers. That fact makes it pretty difficult for their's to compete (and frankly I don't think they much care about their projections anyway).
But I will say that even at this early stage, I'm very pleased. I know both Stats, Inc. and DMB put a whole bunch of effort into their projections, and I was pretty sure that for this first year they'd spank mine pretty hard. That still could very well happen, but for the time being I'm extremely happy to simply be holding my own with them.
To get a little more in depth, Troy Glaus' big start has been a major plus for me as I, by far, gave him the best projection of the four. I've also done relatively well with Ken Caminiti, Trot Nixon and Andruw Jones, compared to the others. B.J. Surhoff, Paul O'Neill and Brian Daubach, however, have so far been better projected by the others than by me.
It's worth noting that the average projected OPS of the group for each source was .812 (me), .803 (Stats), .819 (CBS) and .816 (DMB). Whereas the actual average OPS of the group is .846. I'm not sure whether this is due to increased offense this year, or shaping, or whatever.
As the year goes on, I'll check back here and make more comments. Thanks for reading along.
Vörös McCracken