Page rendered in 0.9845 seconds
61 querie(s) executed
Friday, November 11, 2005
Dr. StrangeGlove or: How I Learned to Stop Worrying and Love Zone Rating
There is a ton of mistrust of defensive methodologies, and how well they describe defensive play. MGL’s UZR is recognized at many baseball sites as being good enough to cite with considerable confidence in its accuracy. MGL does a good deal of work on it to perfect it, and he’s no dummy, so it’s a fair position of others to want to quote his data.
I’m here to tell you, friends and neighbors, that you, yes, you, can be a defensive runs saved calculator without the need to pray MGL is able to let you in on how your favorite player performed. MGL always obliges, but he doesn’t have to have the burden.
You will have to do some of the work, so stop watching that baseball game and get your head into a spreadsheet.
As described previously, it would be better to also look at Helton’s actual ZR Chances multiplied by the league average ZR, and then subtracting from Helton’s RS.
I don’t have Helton’s actual ZR chances. I think trying to re-estimate them is folly, as my “281” number is generated from some 56,000 innings and 11,000 chances.
Now you can set up your own spreadsheets and load the data. You can post weekly updates, or just be ready to look at defensive value before you post your MVP selections.
It is very important to understand that ZR chances are like plate appearances. If a fielder has only played enough innings to make 100 fielding plays, then it is too early to judge how good of fielder he is. It’s like 100 PAs. So don’t put too much weight, good or bad, on guy who haven’t played much. It’s very important for catchers too, because they always play partial seasons.
Oh, more info?
Okay, for outfielders’ arms, I calculate the average assists per inning from every outfielder and then multiply by the league average innings. Then I subtract that from the player’s assists with the proper playing time conversion. Those are straight runs added to a player’s RSpt (or RScal+).
I do not park adjust, pitching staff adjust, groundball/flyball adjust. I am really skeptical of that still – because I haven’t worked it out for myself. I’m stubborn that way, but I also have never seen the data broken out in that manner.
Catchers are done as an amalgam of caught stealing per inning above average, stolen bases per inning above average, errors per inning above average and passed balls per inning above average, at an average base advancement of 0.31 runs per. I have vacillated between a couple of catcher run value calculations. Someone needs to make an argument on which way I should go.
Is this method any good?
I like my method. I think defensive evaluations from a zone perspective is the best way. I think this method is robust due to the sheer volume of data input. How do I compare it to anything? I know UZR is pretty good, so I took MGL’s posted numbers in the Gold Glove articles, and David Gassko’s (DSG) from his article at The Hardball Times. Mr. Smith (Rally) provided all of us with all his numbers for players with 250 innings.
I have 56 data points from MGL. I have 100 from DSG. I used 122 from Rally. The reason I used 122 from Rally is because I used the guys that you have read with posted numbers. Besides, you’ll see there isn’t much point to more between Rally and me. We agree very tightly.
I made comparisons to each other, all based on 150 defensive games (1350 innings played) excluding outfield arms and double plays.
vsMGL vs DSG vs Rally Dial 0.82 0.60 0.97 Rally 0.80 0.61 DSG 0.61
Feel free to square those if you can’t do that in your head. The complete list of data used can be found here.
What about absolute differences? You may have seen various discussions (see the AL Gold Glove article) regarding the Nick Swisher number. MGL has Swisher at +37, while Rally and I had him at average and DSG had him very negative (-23). Somebody, somewhere has something off.
Average Absolute Difference:
vsMGL vs DSG vs Rally Dial 9.9 12.5 3.0 Rally 10.0 12.2 DSG 12.2
I’m certain there is a better statistical way to compare these results, but I don’t know what it is.
Correlations with MGL Dial Rally DSG 2 1.00 0.98 0.98 3 0.88 0.88 -0.28 4 0.86 0.85 0.91 5 0.84 0.83 0.66 6 0.69 0.59 0.83 7 0.99 0.99 0.95 8 0.88 0.84 0.83 9 0.74 0.78 0.14
Rally’s method correlates well everywhere with some question at shortstop. I don’t know if his double play addition would increase that, but MGL’s doesn’t include double plays.
My rating does very well. The worst correlation is 0.69, with a 0.9 rating or greater at five of the eight of the positions.
I am using UZR as a baseline because it is well respected.
If I remove the four worst matches – the players each method disagreed with UZR the most - the correlations increase (duh). Removing those four moved my correlation to 0.87, Rally’s to 0.84, but most amazingly, DSG’s to 0.83. That’s a huge jump in DSG’s numbers. That’s basically saying 7% of these players are problematic when comparing a non-pbp method to a pbp method. I think that’s really good. I don’t know if that 7% can be eliminated.
I haven’t worked up all of the 2000-2003 data for which there is a bunch of UZR data available. One of you more industrious fellows can take my methodology, make your own spreadsheet and compare to UZR. Or you can wait until I get around to it. Which will happen. No, really.
Each of you is now armed with the ability to accurately estimate how many runs a defender saves at any moment. No more “but how good is his glove”? No more “will MGL post UZR”? Well, we still want that, but you can feel pretty confident using this methodology that you are right on it.
Plus, when you vote for MVP, or ROY, you can do it with
52% more knowledge.
In the spirit of open research, the data used to calculate these defensive ratings can be found here.
You must be logged in to view your Bookmarks.
Reconciliation - Getting Defensive Stats and Statheads Back Together
(30 - 1:42pm, Apr 28)
Handicapping the NL East
(77 - 2:02pm, Oct 15)
Last: Rickey! scores own goals all the time
Landing Buerhle a Great Move
(79 - 8:43am, Feb 04)
Last: Foghorn Leghorn
Weekly DRS Update (Defensive Stats Thru July 19, 2010)
(3 - 2:47pm, Sep 27)
Last: Home Run Teal & Black Black Black Gone!
You Have Got To Be Kidding Me
(8 - 3:52am, May 01)
Weekly DRS Update (Defensive Stats Thru July 4, 2010)
(2 - 4:05pm, Jul 11)
Weekly DRS Update (Defensive Stats Thru Jun 29, 2010)
(5 - 12:47pm, Jul 04)
Last: Harveys Wallbangers
Weekly DRS Update (Defensive Stats Thru Jun 13, 2010)
(15 - 1:51am, Jun 16)
Last: Chris Dial
Weekly DRS Update (Defensive Stats through games of June 6, 2010)
(17 - 7:08pm, Jun 14)
Last: Foghorn Leghorn
Daily Dose of Defense
(41 - 8:31pm, Jun 04)
Defensive Replacement Level Defined
(40 - 10:11pm, Jun 03)
Last: Best Dressed Chicken in Town
2009 NL OPD (Offense Plus Defense)
(37 - 11:22pm, Feb 17)
Last: Foghorn Leghorn
NOT authorized by Major League Baseball or its Member Teams
(40 - 7:32pm, Feb 16)
2009 AL OPD (Offense Plus Defense)
(35 - 9:05pm, Jan 05)
Last: Foghorn Leghorn
Live from SABR 39!
(58 - 5:20am, Aug 04)
Last: Neal Traven