Baseball for the Thinking Fan

Login | Register | Feedback

btf_logo
You are here > Home > Baseball Newsstand > Baseball Primer Newsblog > Discussion
Baseball Primer Newsblog
— The Best News Links from the Baseball Newsstand

Tuesday, October 18, 2011

Bad outfield defense or a bad fielding metric?

Something is happening here and you don’t know what it is, do you, Adam Jones?

Playing in Camden Yards in any position in the outfield decreases your defensive metrics.  This means that as useful as UZR might be, it appears to do a poor job characterizing what normal means for Camden Yards.

escabeche Posted: October 18, 2011 at 02:10 PM | 14 comment(s) Login to Bookmark
  Tags: orioles

Reader Comments and Retorts

Go to end of page

Statements posted here are those of our readers and do not represent the BaseballThinkFactory. Names are provided by the poster and are not verified. We ask that posters follow our submission policy. Please report any inappropriate comments.

   1. Sean Forman Posted: October 18, 2011 at 04:50 PM (#3967319)
I'm guessing UZR is adjusted to ballpark. I know that TZR is.
   2. McCoy Wilfong for Money Posted: October 18, 2011 at 04:55 PM (#3967324)
I always though the metrics never really captured what was going on at Wrigley properly either. Granted it may have changed since I haven't looked at in years but back in the day CFers always seemed to look great for the Cubs.
   3. Bob Evans Posted: October 18, 2011 at 05:07 PM (#3967334)
It's intriguing enough that I'd like to see it done for all OFs Camden vs. non-Camden (pace #1).
   4. Mike Emeigh Posted: October 18, 2011 at 05:21 PM (#3967354)
I've pointed this out on a number of occasions: Static-zone metrics have problems in the OF in oddly-shaped ballparks, because the OFs can't position themselves where they would typically play in a ballpark with normal dimensions.

It's really hard to factor in a ballpark adjustment. If the RF has to play 20 feet closer to home plate in Camden Yards because of the scoreboard, how would that affect the expectation for each zone? You can't figure it based on plays actually made, because then you're letting the thing that you are actually trying to measure affect the measurement.

It's also not clear to me that uncatchable wall balls are factored out of UZR - STATS didn't used to flag those, but I think they started doing so right before Dewan left.

-- MWE
   5. McCoy Wilfong for Money Posted: October 18, 2011 at 05:26 PM (#3967365)
Wasn't this an issue with LF in Fenway as well?
   6. Tricky Dick Posted: October 18, 2011 at 07:00 PM (#3967481)
UZR is ballpark adjusted. I remember reading MGL's description of the ballpark adjustment methodology about two years ago, and I had some skepticism, but there is an adjustment that has a material effect on the OF results. As I recall, Dewan does not believe that a ballpark adjustment is necessary for the DRS method.
   7. bjhanke Posted: October 18, 2011 at 07:34 PM (#3967509)
Mike (#4) is absolutely correct, and the reason is the one he gives in paragraph 1. And it's not just ballparks. Consider a team with a good RF, a good CF, and Greg Luzinski in LF. Their CF is going to play "out of position" towards LF, and the RF will be out a bit towards CF. That changes the positions of the zones for any zone-based method. Unless some system starts tracking where the OFs play at all times, they're going to suffer from this problem. Doesn't make them useless, but it does make them sometimes dicey. - Brock Hanke
   8. Mike Emeigh Posted: October 18, 2011 at 08:00 PM (#3967534)
As I recall, Dewan does not believe that a ballpark adjustment is necessary for the DRS method.


Dewan has started removing uncatchable wall balls from the calculations, however - which they didn't do for most of the time he was at STATS - and there are obviously a fair number of those balls at Fenway, for example.

-- MWE
   9. Walt Davis Posted: October 18, 2011 at 08:39 PM (#3967584)
Their CF is going to play "out of position" towards LF, and the RF will be out a bit towards CF. That changes the positions of the zones for any zone-based method.

But how much does this hurt? The CF should make fewer plays in his zone towards RCF but more plays out of his zone towards LF.

You can't figure it based on plays actually made, because then you're letting the thing that you are actually trying to measure affect the measurement.

Which is why you use previous years' data to do this. We have no problem treating new parks as neutral until we build up enough data to calculate a park effect. There's no reason this should be treated any differently. Surely we have enough data on Camden Yards to adjust for this.
   10. Mike Emeigh Posted: October 18, 2011 at 09:56 PM (#3967652)
But how much does this hurt? The CF should make fewer plays in his zone towards RCF but more plays out of his zone towards LF.


It depends on what the penalties are for not making plays in zone, vs the rewards for making plays out of zone. In most zone-based systems, the penalty for failing to make an in-zone play in the OF is generally larger than the reward for making an OOZ play, in large part because most of the OOZ plays that you make in an oddly-shaped park save singles, whereas most of the in-zone plays that you can't make in an oddly-shaped park go for extra bases. I had estimated this back around 2000 for Fenway LF as having an effect of around 7-10 runs per season - Fenway LF being the most extreme example of the type. At the time, STATS included wall balls as in-zone plays - outfielders were getting penalized for balls that they couldn't have caught without a net on a 10-foot pole, as well as some that they *might* have been able to catch where the outfielder didn't believe he should take the risk of going all the way back to the wall. Excluding wall balls (which I think started in 2006) has mitigated this effect somewhat, but you still have areas in left-center and right-center in Fenway where in-zone plays simply aren't going to be made because the contours of the ballpark don't let the fielder play the position that way.

You can't figure it based on plays actually made, because then you're letting the thing that you are actually trying to measure affect the measurement.

Which is why you use previous years' data to do this.


.. which still skews it, because the same fielder is often there for a number of years. Are fewer plays made in RF at Camden because Nick Markakis plays the majority of the innings there, or because the ballpark makes it hard to play RF there. or some combination of both?

Conceptually, zone-based ratings are sound. But until we can overlay positioning on top of the static zone matrix, especially in the outfield (hello Field f/X), we can't entirely sort out the wheat from the chaff.

-- MWE
   11. OCF Posted: October 18, 2011 at 10:35 PM (#3967669)
Consider a team with a good RF, a good CF, and Greg Luzinski in LF. Their CF is going to play "out of position" towards LF, and the RF will be out a bit towards CF.

I remember watching a game in which I saw that very defense. Only it was in the Astrodome and the LF was named Bob Watson - with Cesar Cedeno in left center.
   12. Enrico Pallazzo Posted: October 19, 2011 at 01:01 AM (#3967734)
Mike hits the point bang on. These conversations won't exist once we crack Field f/x and get 5-10 years worth of positioning, speed, range, hang-time, first-step, end positioning for cut-off throws, etc... data from it.

Imagine a function of an OF's range based on hangtime, trajectory, and distance from the ball and adjusting for weather, righty/lefty, night/day, dome/grass, etc...Neat. One could make some cool-looking graphs out of that. Such a function might take a probabilistic form where the dependent variable is the probability that a given or average player will make a certain play. I imagine this could be an approach already taken by clubs for their proprietary use. It would give teams a better read on a player's potential performance in their own park. I know Boston has proprietary defensive numbers. I'm curious as to their methodology.
   13. Ron J Posted: October 19, 2011 at 06:56 AM (#3967890)
#4 Even if uncatchables are factored out there's still a problem with static zones. Boston LF always grade out poorly in static zone metrics like DA and ZR because you've turned a routine 1 chance, 1 putout to either 1 chance, double allowed (DA -- which didn't factor out uncatchables) or a 0 for 0 (ZR)

Yeah, park adjustments should catch most of this, but defensive park factors are bound to be pretty noisy.
   14. Ron J Posted: October 19, 2011 at 07:34 AM (#3967897)
#9 Scott Fischthal did a number of studies on the matter using DA. The most interesting of which (quoted from an rsba post) This bears following up, but we were just coming to the end of the DA period and interest in the matter pretty much died. I don't recall Scott doing any more work on the matter. (He had previously looked at such things as staff quality impact on DA and for evidence of the SS/3B interactions and SS/2B interactions.

(quoting now)
I was fooling around with DAs this morning and came across some interesting
preliminary results.

I was curious as to whether there was any correlation between CF defense
and corner OF defense. Could Ken Griffey's CF DA problems be related to
poor play by his mates in the Seattle outfield not "poaching" CF enough?

What I did was take the team OF DAs for every AL team from 1988-94 (98
teams). I then compared the CF DA to the combined DA in LF and RF for each
team. I rank ordered each.

Some of the interesting results:

1. The correlation (Pearson) between team CF DAs and team LF/RF DAs is a
somewhat disturbing .531 (Spearman's rho is .547). Furthermore, for team CF
DAs in the top and bottom quartiles, the correlation is .641 (Spearman:
651). Normalized to league average, the Pearson correlations are .573 and
617. The null hypothesis (actual correlation = 0) is easily rejected, with
effectively 100% certainty (via a t test; probit plots show normal
distributions).

2. There are NO cases in which a team's (e.g. "Toronto '92" or "Seattle
'94") CF DA is in the top quartile of performance over the period and the
corner OF DA is in the bottom quartile.

3. There are 3 cases of an upper quartile CF DA coinciding with a below
median LF/RF DA: Cleveland 1990, 7/62 (Mitch Webster!?); Toronto 1994, 18/53
(Devon White); Baltimore 1988, 21/74 (Ken Gerhart, et al.).

4. Conversely, there are only 5 cases of a lower quartile CF DA coinciding
with an above average LF/RF DA, including 3 cases of a lower quartile CF DA
coinciding with an upper quartile LF/RF DA. One of those cases is the Detroit
CF circus last year, with such comical selections as Kirk Gibson and Juan
Samuel playing there.

5. Seattle's CF DAs (primarily Ken Griffey, of course) in recent years have
been dreadful, including the worst performance of the period (1994).
However, their LF/RF DAs have *also* been uniformly dreadful. One of the
two times Griffey had a decent DA ('89), Seattle's LF/RF DA was also middle
of the pack -- much better than usual. The other time, Seattle's LF/RF DA
was as horrible as usual (remember, 98 teams):
year    CF      COF
.       Rank    Rank    LF                      RF
1994    98      96      Anthony
/Turang/misc     Buhner
1993    58      89      Felder
/Sasser/Cotto     Buhner
1992    42      87      Mitchell
/Briley/misc    Buhner
1991    92      78      Briley
/Cotto/GriffSr/   Buhner
                        Tracy Jones
/misc
1990    94      85      Calderon                Briley
/Buhner
1989    65      58      Cotto
/Briley            Calderon/Buhner 


I think it's fair to ask if the wildly spinning turnstile in LF combined with
the lumbering Buhner in RF makes Griffey's task in CF impossible. In the last
five years, the corner outfielders in Seattle haven't just been bad, they've
been brutal, never getting out of the bottom quartile.

6. Kenny Lofton's precipitous decline in DA last year coincided with a
large decline in the Indians' LF/RF DA, which dropped from good to mediocre
(25->51).

7. The year (1992) Willie Wilson had his fabulous DA (.641), the Oakland
corner outfielders had the second highest DA ever (.596).

Could Griffey's problems be caused by his mates in the Seattle outfield?
Could Seattle's other outfielders be suffering from *Griffey's* inability
to poach (STATS's Scoreboard showed that Griffey poaches less often than
many other outfielders)? Or maybe it really *is* the pitching staff's
fault?

However, my preliminary results appear to seriously call into question the
independence of OF DAs, and therefore their reliability as an estimate of a
player's defensive performance.

You must be Registered and Logged In to post comments.

 

 

<< Back to main

BBTF Sponsor

Support BBTF

donate

Thanks to
Eugene Freedman
for his generous support.

Bookmarks

You must be logged in to view your Bookmarks.

Hot Topics

NewsblogPaul Daugherty: Old-v-New schools of thought
(26 - 8:30pm, May 24)
Last: Ok, Griffey's Dunn (Nothing Iffey About Griffey)

Newsblog[OTP-May] Politico: Congressional baseball game, May 1, 1926
(4411 - 8:29pm, May 24)
Last: SteveF

NewsblogOMNICHATTER for May 24, 2013
(22 - 8:25pm, May 24)
Last: Mike Emeigh

NewsblogHHS: Autin: Miguel Cabrera to the max
(32 - 8:17pm, May 24)
Last: DavidFoss

NewsblogOT: The Soccer Thread, May 2013
(1159 - 8:17pm, May 24)
Last: Arnett Mead (Arjun)

NewsblogTangotiger Blog: Ensberg and Tango speak on being locked-in
(69 - 8:15pm, May 24)
Last: GuyM

NewsblogOT: NBA Monthly Thread - May 2013
(1232 - 7:50pm, May 24)
Last: Booey

NewsblogFox Sports: McLouth catch earns thrown beverage
(9 - 7:28pm, May 24)
Last: Joe Bivens, Minor Genius

NewsblogPrimer Dugout (and link of the day) 5-24-2013
(19 - 7:28pm, May 24)
Last: bobm

NewsblogMLB: Don Sutton never shy about voicing his opinion
(11 - 7:24pm, May 24)
Last: Howie Menckel

NewsblogLATimes: Microsoft unveils new Xbox One console
(38 - 5:57pm, May 24)
Last: CrosbyBird

NewsblogOT: NHL is finally back thread
(376 - 5:47pm, May 24)
Last: Random Transaction Generator

NewsblogESPN: Forging bond with Pete Rose has helped fuel Joey Votto's desire to be great
(174 - 5:11pm, May 24)
Last: The Id of SugarBear Blanks

NewsblogFay Vincent: THE UMPIRE FIX
(9 - 5:00pm, May 24)
Last: Johnny Sycophant-Laden Fora

NewsblogFanGraphs: Cameron: The 2013 Cubs: Better Than We Think
(41 - 4:47pm, May 24)
Last: The District Attorney

Demarini, Easton and TPX Baseball Bats

 

 

 

AllianceTickets.com has cheap MLB Tickets. Get all your Colorado Rockies Tickets, Seattle Mariners Tickets, San Francisco Giants Tickets and all your favorite baseball tickets here. We also carry cheap Denver Broncos Tickets, Seattle Seahawks Tickets and Denver Nuggets Tickets.

For wholesale prices on baseball gifts and equipment, check these stores out!

Baseball Autograph Signings
Baseball Card Supplies
Baseball Memorabilia
Baseball Collectibles
Baseball Equipment
Baseball Protective Gear

Page rendered in 0.1996 seconds
51 querie(s) executed