Baseball Primer Newsblog— The Best News Links from the Baseball Newsstand
Saturday, March 17, 2007
and Mitchel Lichtman being MGL.
All of today’s best P.B.P. systems agree that Ramírez is the worst defensive left fielder in baseball, and by a comfortable margin.
“Manny is at the far end of the as-bad-as-you-can-get-in-the-field spectrum,” said Mitchel Lichtman, who designed one highly regarded P.B.P. defensive statistic called ultimate zone rating, and who consulted for the St. Louis Cardinals from 2004 to 2006.
...By contrast, Lichtman’s system says Ramírez was 32 runs below average last year, which would make him one of the game’s most overrated and overpaid players. If he was actually that awful, he was no more valuable than the Mariners’ Raúl Ibáñez, the Blue Jays’ Reed Johnson or the Angels’ Juan Rivera.
|
Reader Comments and Retorts
Go to end of page
Statements posted here are those of our readers and do not represent the BaseballThinkFactory. Names are provided by the poster and are not verified. We ask that posters follow our submission policy. Please report any inappropriate comments.
I think it's safe to say that whatever defensive system the Red Sox are using, it doesn't show Manny to be a -30 outfielder (and therefore on par with Reed Johnsons of the world). If it did, they would have traded him already, just to be rid of his contract.
Interesting to hear that MGL's St. Louis work is spoken of in the past tense now. Does that mean we get to see UZR published here again? Please please please!
Huh? Giving Manny more room to cover helps his defense?
aren't wall balls are considered "catchable" in uzr? so putting the wall back would make those catchable balls actually catchable.
if this is true, why hasn't someone done a defensive study that subtracts out all the wall balls and considers them home runs (just for the sake of seeing what his defense would look like for actually catchable balls)?
Dial has done just that in in this ST thread. He finds that Manny is -12 runs /150 games, but suspects he'd be even better.
Two problems with this:
1. Dial completely eliminates all of those balls that hit the wall while leaving in all of the other Fenway data. But if it was a normal wall at a normal distance, many of those balls would be in play, and a good outfielder would get them. Therefore, in Dial's study, the Monster is allowed to hide any deficiency that Manny might have going back on the ball.
2. The presence of the shallow, tall wall allows LFs in Fenway to play shallower and get to more balls in front of them, a point brought up in the thread I mentioned above by TH. Dial's study doesn't account for this either.
Overall, I'm guessing that adjustments based on the Monster bring Manny back from -30 to -40 to something in the -10 to -25 range.
(Also, note that MGL's defensive numbers are park adjusted as well and show Manny to be -32.)
1. Yes, MGL told me he stopped working for the Cards in '06.
2. UZR's park adjustment is just a percentage applied to balls hit to a zone (eg, if a neutral-park LF is expected to catch 150 balls, a Fenway LF will only be expected to catch 125). His park adjustment definitely does not pick up year-to-year variation in number of balls hit off the wall, although it does account for the average # of balls hit off the wall per year.
3. MGL says most of Ramirez's poor fielding has been done on the road. John Dewan agrees.
4. David Pinto does account for park on every individual ball, and he had Manny at -20 plays last year. According to Dewan, most of the balls Manny missed went for doubles, suggesting a run value of around 0.95 runs per missed ball.
Also, is he being measured against an AL LF 2006 average, or some other benchmark?
Included among them diving stops of relay throws from the centerfielder.
dave h, thanks for crediting me but the observation that a LF in plays shallow and gets to more balls was made by TH--I was only relaying that from the other thread. Your double post was for naught! :)
Yes, that's an important distinction. If Dial were crediting Manny with getting all those balls, he'd be inflating his value greatly. By simply throwing the data out entirely, I think it's giving Manny a small boost. This is because in a normal park an average fielder would get to some small percentage of those and (IMHO) Manny would get to less of them. I base this on my observation of Manny and how a lot of balls seem to fall behind him, even in the small Fenway LF. But even that's debatable.
BTW, Dan R, I didn't realize you were a primate and I sent you an email complimenting the article. Really nice piece of work.
Because positioning and range would make this a very dubious classification. If one OF plays 10 ft to the left of where another plays, different flyballs are "routine" for them. If defensive metrics did this, then suddenly, Buster Olney's critiques of defensive stats would have merit.
biggest LFs (Metrodome, Yankee, Comerica).
This has always seemed like nonsense to me, too, but it simply entails an assertion that for several years now the Red Sox pitchers have been a lot better than they've looked. Maybe that's true. Maybe Josh Beckett's ERA should have been 4.50 last year, and it was 5.01 entirely because of Manny.
The conceptual issue comes back to the baseline. What do you compare Manny to? Replacement level? but there are hundreds of better outfielders in the minors. Having no left fielder? that seems insane, but Manny caught 175 fly balls last year, so clearly he contributed something to the cause. Hitters in his class? because Jim Thome or Frank Thomas or David Ortiz sure wouldn't catch 175 fly balls in left.
Or league average, of course, but even then there is always some doubt as to whether theoretical runs allowed by a single defender add directly into a team's runs-allowed column. Short of Jose Canseco letting a ball bounce off his head for a home run, no defender allows a run single-handedly. That's why managers are always tempted to "hide" great hitters somewhere. Yes, he's terrible, but please God nobody will hit the ball to left today ... whereas you cannot "hide" a pitcher or a hitter.
I'm quite skeptical that the effect here is particularly large. Is Fenway's LF really easier to play by a factor of 5-10 runs per year? I don't see it. I'd be interested to see statistics on this effect, but it's a bit hard to see for me.
Dial, Arthur, and Chone have been pretty clear that by the numbers, Manny has been about a -10 to -15 fielder for the Red Sox. This should be the starting point for future stat-oriented discussion of his defense.
I guess in the way they are the same point. But two separate things are happening. Thing 1: Manny (and other Fenway LF) can play shallow, knowing that balls hit over their heads are not going to turn into triples and inside the park HR. This allows Manny (and co) to catch more shallow balls than he normally would.
Thing 2: Dial is wiping out the 30 balls that hit the wall as unplayable. I trust his judgment that these are unplayable balls for Manny or anyone else. But in another park, those balls are all in play. Manny gets to less in-play balls than other LFs, so he would likely get to less of those as well. If you're trying to determine how many real runs Manny is costing the Red Sox, this is irrelevant. If you're trying to determine Manny's skill as a LF, it's part of the equation.
I'm quite skeptical that the effect here is particularly large.
I agree it's not large. I'd be surprised if it made up for 1/2 of the 30 plays which have been recredited to Manny by Dial's observation.
Is Fenway's LF really easier to play by a factor of 5-10 runs per year? I don't see it. I'd be interested to see statistics on this effect, but it's a bit hard to see for me.
I don't have the stats or observation to prove this, but I would not be at all surprised if it is in that range. Consider, though, that if we take Dial's latest work at face value, Dante Bichette and Troy O'Leary become great, great, LFers.
Dial, Arthur, and Chone have been pretty clear that by the numbers, Manny has been about a -10 to -15 fielder for the Red Sox. This should be the starting point for future stat-oriented discussion of his defense.
I don't think Dial's work here is complete. He uses observation to adjust for one quirk of the park, but has not accounted for the two issues I mention above. He also compares Manny playing in Fenway with special observational adjustments to other players playing outside Fenway with no such adjustments.
Chone's numbers are in this ST thread, and after adjusting for park, he got -20/400 chances in 05, -35/400 chances in 06. (Incidentally, using the same park adjustment on Dial's numbers, I got -23 /150g in 05, -32/150 in 06.)
Arthur's work is based on one injury-shortened year of data. It's far from complete.
One conclusion that you left out was MGL's, which put Manny as -32 in 06 and worse in 05 IIRC.
I'd hardly say that consensus is -10 to -15.
Arthur: -12 (using an average of his and AROM's park adjustment)
Dial: -12
Chone: -35
MGL: -32
Even if we take Arthur's and Dial's numbers at face value (which I don't), the average is -23.
When are you going to learn to view wild-ass guesses with some skepticism? When are you going to learn anything for that matter?
Per Dial, a play in LF is worth about .831 runs, so if Manny were 30 runs below average per 150 games, he'd have to not make about 36 plays that other LF make over a 150 game period. That means that about once every 5 games, Manny would miss a play that an average fielder would make. I find that quite believable. Of course you don't because you're seeing him make all those acrobatic plays.
It also seems to me that play by play analysis of this would need to be situational, although it would be hell to do. A ball Ramirez fails to get to with the bases loaded in the 7th in a 4-4 game is different than one he fails to get to in a 12-2 game with the bases empty in the 9th. Such a distinction might not be related to skill in isolation but is related to runs.
But the skill in isolation is far more important, IMHO. It tells what Manny alone contributed to the play, as opposed to what the hitters and baserunners on the opposing team, the pitcher, and other fielders, contributed to make the play meaningful. This tells us more about Manny's contribution looking backward and more about what he's likely to contribute going forward.
All that said, a fielder's positioning and tactics (you dive for a ball in a 4-4 game, you don't in 12-2 game) are probably affected considerably by game situations.
Agreed, and I think that is a "skill" as well.
You may be right; if so, this is why I prefer the Dewan plays metric as opposed to a runs metric.
1. You didn't ask me to give Dial's numbers a chance. You asked me to view statistics skeptically. In order to view stats skeptically, you have to insert your own observation. That's where the wild ass guessing comes in.
2. The reason you have been skeptical of MGL's work in the past is that it didn't fit with your WAG about certain players' defense.
I grant that Dial's and Arthur's numbers may need adjustments, but we should be adjusting those numbers rather than averaging them with statistics built ultimately off a data set so flawed as to be nearly unusable.
Okay, but don't lump Chone in with them. And learn how to spell "the." At least use the standard "teh."
I grant that Dial's and Arthur's numbers may need adjustments, but we should be adjusting those numbers rather than averaging them with statistics built ultimately off a data set so flawed as to be nearly unusable.
Chone's and MGL's park adjusted numbers based on years of data are nearly unusable, but Arthur's 1 season of data of 1 player is a gold standard that can only be tweaked at the margins?
have you ever disagreed with someone without calling them a complete idiot?
have you ever disagreed with someone without calling them a complete idiot?
I can answer that one, its rhetorical quality aside. He has disagreed with me and has done so in a respectful way. Plus, has he actually called you a name in this thread?
Anyway, I suspect that Manny is a pretty terrible fielder in the abstract, possibly as bad as the -30ish numbers would suggest, but Fenway hides a good chunk of his terribleness, in at least three ways:
1. Of the balls that are unplayable by anyone at Fenway because of the Monster, some of those would be caught by a good outfielder in a more typical park, but not by Manny in that park.
2. Of the balls that are unplayable by anyone at Fenway because of the seats along the left field foul line, some of those would be caught by a good outfielder in a more typical park, but not by Manny in that park.
3. Manny's arm is quick and accurate but not strong. At Fenway he can play shallower than in a more typical park, and does not need to make as many long throws as he would have to make in that park.
I think it could very well be that Manny is a -30 fielder in the abstract but only -15 or so when he gets to play half his games at Fenway.
Well, that is probably something most Red Sox fans here can agree on. After all, I root for the ####### Cincinnati Reds and also dislike Larry Lucchino, although I think he is a smart man.
Still funny after all these years.
JFCOAPS, kevin, even when I agree with just about everything you're saying in a given thread*, you make me wish I didn't because you're so often obnoxious.
* Maybe not *15* acrobatic catches, but he does make some fine plays.
Certainly, if someone applies Arthur's method to pre-2004, and finds that Manny was total crap then, that'll be useful information. But previous to such study, all we've got that's particularly useful are the numbers that only include balls that a human being can catch.
Just because they are based on first person observation doesn't mean that they account for balls off the monster better. For example, I could watch one game and see 3 balls off the monster and draw conclusions from that, but it would be completely useless.
Also, I don't think Many *is* average; but that our data (prior to me looking at the bip) indicated he *could be*.
Joe Arthur's road data indicates Manny may not struggle so much with a bigger park. His play in Cleveland wasn't bad.
There are other *smaller* issues with the work I have done. there's appears to be a shift in scoring BIP of the wall as LDs or FBs.
There is more work to be done than I have done. The 2004 eason (and others) need to be reviewed.
Manny is not a great outfielder, but his play in Fenway is only slighly worse than average and surprisingly his play on the road is not much worse. Although the fans (and some of his pitchers) will be angry that he doesn't hustle on every play, he does miss very little time during the season. The Red sox would be crazy to even think of trading him.
Manny's biggest problem is when he makes a bad play, it's often a spectacularly bad play on a ball a decent Pony League player would routinely make. Of course, a play like that makes the lowlights about 300 times on ESPN and is remembered. He doesn't do it often, but he does this more often than any other player in the majors. He seems to have these "Manny Moments" (aka "Brain Farts") just often enough to get a rep as a horrible fielder.
I'd wager, if the perfect fielding metric could be formulated (and I haven't seen it yet), #66 would have it about right: A little less than average at home, and less than that on the road. Is he the worst LF in baseball? Probably, but he's not THAT much worse than whoever is directly ahead of him.
Please set sarcasm meters.
Those are some odd numbers and conclusions.
A. Home fielders are expected to catch more balls than visiting ones, especially LF in Fenway. So you can't compare Manny's numbers to visiting teams' numbers unless you make an adjustment for HFA.
B. You give the same percentage for LD's and then say that Manny caught 4 LD more than he should have. ??
C. You say that Manny has a "great arm," give no data to support that assertion and then credit him 2.7 runs per year in "arm" (I think). While 2.7 is not inconsistent with a "great arm," Manny has in fact contributed 1.5 runs a year in "arm" over the last 4 years, using my methodology for computing "arm runs" which is essentially baserunner advances/outs per opportunity as compared to a league average LF'er and park adjusted as well (which is necessary for Fenway LF'ers of course). Since the 1.5 is based on less than perfect data and methodologies, I suppose it could be 2.7, although I have never heard before that Manny has a "great" arm (a very good one maybe).
If someone is not comfortable with a park adjustment for a player, especially one with many years of data, simply use his non-Fenway (or whatever park you are not comfortable with) numbers (road, and while playing for CLE). That should still give you a pretty good idea of a player's fielding value/talent. However, if nothing else, you can certainly infer SOMETHING more (using a larger sample) about a player's fielding by comparing his stats in a quirky park (like Fenway) to other fielders at that same park, again, adjusting for HFA.
When all is said and done, I think you will find that Manny appears to be (fron the data and from a consensus on scouting/observation) a poor LF'er. Whether his true talent is -10 or -20, who knows. After crunching my data in my imperfect way, it appears to be closer to -20 (-21 is my best estimate going into this year), but as always, that could be wrong. All estimates drawn from sample data have an uncertainty level and have an X percent chance of being "wrong," where X varies with the magnitude of "wrongness." Also keep in mind that on average we see a rather steep decline in fielding in the OF with age. When looking at Manny's historical data (his UZR's were good while in CLE) and making future projections, keep that in mind. For a typical OF'er, from age 25 to 35, you are probably looking at a 15-20 run decline. In order for Manny to be around average now, he would have had to be a superstar defender early in his career. Given his speed and body type, that is close to impossible. Again, this is all given a typical aging pattern.
Using scouting reports and observation (video, etc.) can reduce the uncertainty level of a "conclusion" (best estimate) drawn from sample data, and give us a more accurate number, if done and used properly (the observation and scouting reports) of course. I use a "lazy approach" (to quote some other poster) for my final defensive numbers for several reasons. One, it is not particularly important (to me) how accurate I am. Two, I don't generate defensive numbers for a living. Never did. This relates to one. Three, and most importantly, I have 10,000 other things that I do in my baseball research. I would have to put some or all of them aside if I took the time to use a "non-lazy approach." I have to balance streamlining all of my methodologies with an effort to use what I consider a quality one (methodology).
Finally, this thread is about half interesting and useful and about half assinine. The assinine part is why I rarely post here anymore.
How about posting new UZR numbers?
If Stats and BIS scorers haven't been marking when a ball hits 20 feet off the wall, so as not to count it against the Fenway left fielder, then their data for Fenway's left field is basically unsalvageable. (I'm following your use of terms here - if one year of good fielding data is "completely useless", then the Stats/BIS numbers are at least equally useless.)
I'm fine with saying that Manny may well be worse than -13 becuase only one year of data has been compiled. That's totally fair. But I think that mixing good data with bad data is not going to add value to the discussion.
(Should be noted, since mgl's here, that I also would love to the see the UZR numbers, and I'm excited to see them published. Thanks for your work! My stance here is wholly separable from my evaluation of UZR - the Stats data was compiled wrong for Fenway's LF, that's got nothing to do with MGL or his analysis of said data.)
I should proofread my posts better. The conversion rate (of LDs to outs) for visiting fielders is 10.4%. The +4 plays for Manny is still correct.
Great arm is too strong for Manny. I stand corrected. It is a better than average arm.
Home fielders are expected to catch more balls than visiting ones, especially LF in Fenway.
I am not sure why logically a home fielder should catch more balls than a visiting fielder and I have not seen any data that says that they do. Are they sopposed to be faster at home? Have better reaction times? See the ball better? I do agree that an outfielder should play the ball off the wall better, and Manny does.
You don't give any details about how you park adjust outfielders plays so it is hard to compare but adjusting for only the BIP hit to that particular field would seem to me to be more accurate than any generic adjustment.
For a typical OF'er, from age 25 to 35, you are probably looking at a 15-20 run decline. In order for Manny to be around average now, he would have had to be a superstar defender early in his career. Given his speed and body type, that is close to impossible. Again, this is all given a typical aging pattern.
A fast outfielder will decline a lot as he ages because his speed will decline a lot as his body changes. An outfielder like Manny, who didn't start out as a fast outfielder, will not decline as much since the other skills that make a good outfielder do not decline as much with age until the eyesight and reaction times begin to fail, which happens later. Good eyesight and reaction time are also necessary for good hitting so when Manny starts to get really bad as a fielder he will have lost most of his value as a hitter as well.
Logically, I can think of several reasons:
Better knowledge of the effect of wind conditions, park angles, nearness of wall and other impediments.
Better knowledge of how the playing surface affects ball movement, bounce, etc.
More experience seeing the ball come off the background, and thus being better able to judge flight.
Better positioning and spacing among outfielders as a result of better knowledge of conditions.
This is all in addition to the overall better physical condition many players feel from not being on the road, sleeping in their own bed, having the at-home routine, etc.
Um, I have also done 2005, so it is at least two years of data for Manny.
We were talking about outfielders and catching the ball in the air for an out. I still was. I guess I should have made that clear.
There is not much difference in background for outfielders that you can get used to. It's people and sky; pretty much the same everywhere but differing from day to day. Lighting is a possibility but is probably pretty good everywhere at the major league level. Dome background might be something that a player could adjust to and gain an advantage but obviously wouldn't apply to Fenway.
Wind is a problem for all outfielders when it is blowing. Everybody looks at the flags. There might be some advantage for the home outfielder where the park is unusually windy with strange currents like Candlestick was but I would like to see numbers that prove it.
So you are pretty much left with a better nights sleep as an advantage.
I believe in a home field advantage for pitchers and batters. But I think the majority of the advantage will be in home runs, walks, strike outs, and the distribution of hit ball types rather than the conversion rate for any specific hit ball type. But I haven't studied it, so I can be convinced by some numbers if someone has studied it.
Cutting off balls that are hit on the ground can be just as important. Knowing the bounce off the turf can be a pretty big advantage for guys playing in the metrodome.
Wind is a problem for all outfielders when it is blowing. Everybody looks at the flags. There might be some advantage for the home outfielder where the park is unusually windy with strange currents like Candlestick was but I would like to see numbers that prove it.
I don't agree. Winds swirl. The hit corners, they change directions. They swirl at Shea. They do different things in different parts of stadiums, depending on how much they are enclosed, etc. Just looking at a flag is not going to give you the kind of information that playing in park regularly does.
There is not much difference in background for outfielders that you can get used to. It's people and sky
It is not just people where the ball meets the bat. There are different backgrounds everywhere, some signage, some stands close up, some far back. Picking up the ball coming off the bat is a big deal for outfielders. I have heard outfielders say it is easier in some parks than in others.
In addition, there is the configuration of the park, and how used to it you are. Some guys can get very cautious about approaching walls, juts and angles that they are not used to.
Aging curves in LF and RF:
From age 24 to age 30, players (min 50 games per year) lose an average of 11 runs per 150 games in UZR. That is around 1.8 runs a year.
From 30 to 40, it is another 19.1 runs, or 1.9 runs a year.
This is using the "delta method" of course.
Interestingly the average UZR for all players at any age is around zero (slighly better at younger ages, 23-27), which suggests that only good defensive players (at the corners at least) stay at their position for very long.
Now let's break that down into fast and slow players. I used park adjusted triples rate for that.
For fast players only:
Overall, they lost 2.3 in UZR per 150 games per year. From 25 to 30, they lost 11.5 runs in 5 years, or 2.3 per year. From 30 to 39, it was 3 runs per year. So from 24 to 39, it was 2.75 runs per year.
The slow ones:
Overall loss per year: 1.57 runs per 150 games. There are no slow players less than 27 in my group. From 27 to 32, they lost 1.9 runs a year. From 32 to 40, they lost 2.3 a year.
So indeed it appears that fast player lose defensive skills more rapidly than slow players, but the difference is not all that great.
Looking at the very slowest players, to which Manny belongs, the average yearly decline is 2.3 runs. For the very fastest players, it is only 1.3 per year.
If I use BMI (body mass index) rather than speed, I get an average yearly decline of 1.58 for those with a BMI less than 27. For more than 26, it is 1.43. For the real low BMI (25-) players, we get almost no yearly decline, .195. For the high BMI guys (29+), we get 1.52 per year decline.
I am not sure that we have much evidence of a clear relationship between speed and defensive decline in LF and RF.
In addition to the reasons listed by Srul, the average home team is going to have to record around 120+more outs (that's strictly a guess, based on a slightly above-average home record minus walkoff wins) than the visiting team. It may not affect UZR rates, but it will impact total putouts.
Well he certainly was not a star defender in his younger days, but from your above post:
I'm not sure what years you're refferring to, but let's say Manny was a good UZR RF in his last two years in Cleveland (1999 and 2000) at ages 27 and 28.
You have slow players losing 1.57 runs per year (I think). Let's just say it's -2 per year. So during the course of Manny's time in Boston we might expect him to lose about 12 runs. and yet he has acctually gone from a good UZR RF (what's good +5? +7?) to an historically bad LF to the tune of a -32 in terms of performance and a -20 in terms of true talent.
Do you have a UZR difference in the move from RF to LF? I don't know. At least traditionally he has moved down the defensive spectrum from a harder position to an easier one as he's aged which might offset some of his age related decline. But at least in terms of UZR you have his performance absolutely cratering. Where we might expect an average slow player to lose 12 runs or so you have Manny actually losing close to 40 runs (that's the -32 plus whatever positive UZR he had in Cle).
It seems to me that most of what you've posted in this thread is more suggestive of the -10-15 range than what the UZR methodology is actually spitting out.
I'd also point out that as far as the Sox are concerned, what's important is how many runs Manny costs playing 1/2 his games in Fenway, not how many he would cost given average chances in an average park. If he's a below average fielder then it's to their advantage to be able to play him in Fenway's left field where he has fewer plays to make.
As far as the STATS data, they give the "slice" and the distance. In whatever slices are the "wall," (C-G or whatever) beyond a certain distance, no balls will be caught. It would be nice if they told you when any ball was "off the outfield wall," but it is not really necessary and can easily be inferred from the data at Fenway. I am not really sure what the argument is at Fenway. I can easily remove all balls in a certain slice and beyond a certain distance at Fenway and get a more accurate number for Fenway. I am reasonably certain that it won't change things a whole lot, and to tell you the truth, it is not worth the trouble. I really don't care whether Manny is a -17 or a -22.
i read the article and see it asserted, but i was hoping to see some actual numbers. is "at least half" 17 or 25?
thanks for the good work, and don't let a few jackasses deter you from posting here. your work is too important to the conversation.
Better knowledge of the effect of wind conditions, park angles, nearness of wall and other impediments.
Lastings Milledge looked lost at Fenway last year. He had no idea where the Wall was, and misplayed 2 balls in one inning, IIRC. Is he an awful LF?
Ehh...it's a house of cards argument though, since there's some evidence he was a plus defensive RF when young. I guess I am very leery of an argument that assumes because he's there he must be bad....aging patterns and such are true in large samples but not true universally, basically. Not that I doubt he's a bad defense LF, but I've long been in the -10 camp not the -20 to -30 camp.
mgl, what's your comment on the Arthur road data? That is, to me, one of the more interesting Manny defense points I've seen the last couple years.
Also, wasn't the HFA included in the calculation of the last UZRs you posted?
1. He was an average fielder before, and he's older, so he must be horrible. But this should be true for all sorts of players, and Manny has been reported as historically bad. I think this sort of generalization is a severe misuse of the statistics - by definition we cannot apply them definitively to one player.
2. He's just as bad on the road. It seems that this is not entirely accepted, but even if it were, road performance is not the same as overall skill. It's half the sample size and not a random half either.
mgl, how can you account for Dial's observation - i.e. that there are a huge number of balls off the wall that are counted as in Manny's zone, enough to be a big deal, and not in line with your park factor?
If I were trying to calculate Manny's "true talent", i.e. neutral park fielding ability, then you are correct, using only non-Fenway numbers would be the preferred methodology. But I am not. I am trying to calculate the amount of runs that Manny cost the Red Sox while playing left field for them, in their park and the parks of the opponents that they play during the season. Calculating true talent, as you do, and runs cost or gained by a player in the context of his existing team are two different questions that require different methodologies. I believe that my methodolgy gives the best answer to my question, which also happens to be the question being discussed in the newspaper article. It is not surprising that we get two very different numbers when we are not measuring the same thing.
That doesn't make sense to me.Is Manny catching 50 BIP that are short or not in his zone? And there's no requirement that the LF has to play so shallow he cannot get back on balls hit to the wall - that should be a tradeoff.
Fenway's LFs in ZR (and thus UZR) have always been significantly downgraded due to the Green Monster. That's so obvious to me after 10 years of using their data. I noted it in 1997, and that's cleearly the biggest factor in evaluating the BoSox LF performance. The other things you mention don't add up to be the same effect as 50 BIP that are too high off the wall.
Misterdirt, my methodology gives you precisely what Manny was worth given his exact distribution of balls, both in Fenway and on the road, and not a league-average distribution. I don't know where you got the idea that it was otherwise. The only thing I do which "normalizes" the data to a league average player is when giving a UZR "per 150 games" I assume a league-average number of total chances per game. However, if you simply use Manny's raw UZR number (or his UZR per 150) and apply it to his actual number of games, you get his actual value as a Red Sox given his actual distribution of balls - IOW, how he did as compared to a league-average fielder.
FWIW, here is some more data:
Here is Manny's UZR, using my typical methodology, however, his results in each zone are compared to everyone else, home and visiting players, at Fenway. So, for example, all wall balls should have a zero or near zero caught rate, so that regardless of how many wall balls Manny had, he does not get docked or credited with anything.
03 -3 (-7 per 150)
04 +8 (+17 per 150)
05 -15 (-30 per 150 games)
06 -12 (-29 per 150 games)
Here are Manny's road numbers. Basically, I used the same methodology I always use, but I removed all data from Fenway.
03 -9 (-22)
04 -5 (-12)
05 -7 (-14)
06 -9 (-22)
But if you don't attempt to make those adjustments, you're biasing the analysis *against* the home team player, because every one of those quirks affects the home team player more than it affects any single visiting team player.
A left fielder in Fenway can't physically make the same set of plays that a left fielder can make in almost every other ballpark, no matter how skilled he is. He has to play 20-30 feet closer to the infield, cutting off his ability to get to balls hit toward left-center. He can't normally go all the way back to the wall to attempt a play if he's not sure of the carry, because if his judgment is off he winds up giving the batter an extra base or two by not peeling off and playing the carom. Any system that hopes to assess defensive value accurately has to take that into account in some way, and IMO it's better to try to make the adjustments for the odd quirks and run the risk of being biased in favor of the home player than to not make the adjustments and assure yourself of being biased against the home player.
-- MWE
Here is Manny's UZR, using my typical methodology, however, his results in each zone are compared to everyone else, home and visiting players, at Fenway. So, for example, all wall balls should have a zero or near zero caught rate, so that regardless of how many wall balls Manny had, he does not get docked or credited with anything.
03 -3 (-7 per 150)
04 +8 (+17 per 150)
05 -15 (-30 per 150 games)
06 -12 (-29 per 150 games)
Here are Manny's road numbers. Basically, I used the same methodology I always use, but I removed all data from Fenway.
03 -9 (-22)
04 -5 (-12)
05 -7 (-14)
06 -9 (-22)
***
This is great! I would consider this pretty much the final word on Manny's defense, since now we're finally comparing apples to apples. Mickey, just for the heck of it, could you tell us what those home numbers look like using your current UZR methodology (e.g. compared to league average and park-adjusted)?
FWIW, the Sox ERA+ in those two two year periods went from 105/116 to 93/96. Before we declare the final word on Manny's defense it would be nice to know if the number of uncatchable yet in play wall balls against the Sox pitching staff remained roughly the same or jumped as their performances sank.
***
Since wall balls are removed in that data (or more properly, the probability of catching a wall ball is 0), the number doesn't really matter for how Manny is rated. And how is -3 runs "good"? It seems pretty clear to me from the data that Manny has been a poor and declining fielder who had a fluke good season at home in 2004.
When you see data that is so wildly inconsistent, it causes one to raise ones eyebrows and question how reliable the data is. I'm not willing to just accept it was "a fluke".
***
You're talking about 75 games! In 2005, Angel Berroa had a .787 OPS at home -- does that make him a good shortstop? (Berroa is the first guy I looked at, BTW, I'm sure you could find even better examples.) A lot can happen in a small sample -- that's why we use as much data as we can find.
But that simply doesn't work. Well, it might, but you an't know if it works primarily because the BIP distribution may not even out - teh Red Sox may have far fewer (or more) "wall balls" for the opponents LF to miss. This position assumes a relatively even Red Sox wallballs/Opponents wall balls.
my methodology gives you precisely what Manny was worth given his exact distribution of balls, both in Fenway and on the road, and not a league-average distribution.
I assume this is somewhat off: the run value of each play that hits off the wall - you use an average of those plays, not the exact value of hte play - is that not true - because using the exact value of the play is wrong.
I suppose the best compromise would be to assume a zero catch rate for all wall balls and then use one adjustment factor for everything else. What many people fail to get is that it does not make that much of a difference, Changing from for a poor park adjustment methodlogy (which I use) to a much better one, is not likely going to change the numbers all that much.
It will likely make a significant difference for Manny, when he has a FB staff - you note that given a large enough sample size it should even out, but when we want to evaluate whether or not Manny is worth his contract (or his next one), it will matter, because the difference between -32 and -17 is quite a bit, i terms of millions of dollars.
The reason people don't understand this is that there is NO BIAS in a the poor methodology I use. For a large enough sample, my poor methodology (using one adjustment number for all zones, even wall balls) is going to generate the exact same results as using a perfect methodology! Heck, Dewan does not do ANY park adjustments at all and that is fine by me.
You know, I have taken tons of heat over the last decade regarding my statements about park factors for defense, and how they were mostly not necessary - and usually I tried to make the "Park adjustment" with a "pitching staff adjusment".
FWIW, here is some more data:
That doesn't agree with Joe Arthur's work.
This is getting extremely nitpicky, but I didn' say -3 was good. I said -3 and +8 over a two year period was good. Actually I used the per 150 figures (-7 and +17) which makes it look more substantial. I suppose I should have said average to perhaps slightly above. And then he suddenly became awful. I think that's a more accurate read of the data than that he started poor with a single fluke season, but whatever.
I do find the tone of defensiveness (a lighthearted pun) and finality in the UZR camp to be very much offputting and quite a bit contrary to the spirit of open and engaged research. That mgl finds his numbers in this case "good enough" is a perfectly valid point of view. I happen to think that far too much time is spent trying to attain theoretical accuracy. "Good enough" is usually plenty "good enough". But in this case we know that there is a flaw in the data. And for some people that "good enough" is not "good enough". That's fine too.
The collegial thing to do is to step aside and let them pursue it to a point where it is "good enough" for them. It's not to unilaterally declare that something that hasn't been measured probably doesn't make much of a difference and then declare the debate over.
Was it over when the German's bombed Pearl Harbor? Yes, I'm cheekily using that as "collegial humor". It was, afterall, set at a university.
Eh ... not really, at least according to MGL, et al., who have said in the past that two years of defensive data have the same significance as one year of offensive.
As far as "why a player's numbers fluctuate" there is no answer to that when you are looking ar relatively small samples of data chunks. Any "why's" that might exist are drowned by the noise.
Most of the noise is (essentially and practically) random and cannot be eliminated completely. As far as defensive data is concerned, most of the noise is:
Where within a zone a ball is actually.
The hang time of the ball withing the various hit types.
The starting position of the fielder (which you may or may not consider part of his "skill set").
The base lines that are established for each zone - those are based on sample data and have an uncertainty level.
Park and environmental (e.g. weather) variations.
More
Some of this noise can be mitigated by using more data and watching video.
I think DSG is asking for his home values using my basic methodology. I am not sure. I gave the home values as compared to all other players in Fenway only, which means that the adjustments for Fenway are essentially per zone. My basic methodology just uses one adjustment number for all balls hit to LF at Fenway (park index of 81). The results should be similar. I don't know which would be better. One clearly is not differentiating between zones and the other is suffering from sample size issues for each zone (of which there are dozens in LF). Clearly for some large number of games, using the Fenway data only is best and for some small number of games, the individual zone adjustments for Fenway are almost meaningless and will put a lot of noise in the results for any one player.
Anyway, the home numbers using my basic methodology are the total ones minues the road ones which I posted above. These are absolutes and not per 150 games.
Year Home Road Total
03 +1 -9 -8
04 -2 -5 -7
05 -37 -7 -44
06 -24 -9 -33
Here are the home numbers side by side using both methodolgies
Year Basic Fenway only/adjustments per zone
03 +1 -3
04 -2 +8
05 -37 -15
06 -24 -12
If we were to use the "new" methodology for Manny at home and combine that with his road numbers, we get total UZR (not per 150) for Manny of:
-12
+3
-22
-21
Much better than what I have, but, as I said, pretty much no matter how you shake it or spin it, he comes out looking very bad.
Remember that we are not arguing over someone like Betancourt or Cano, someone who is young or even relatively young, someone who there is some disagreement among the scouts, or between the scouts and the statheads. That is where this "argument" mystifies me. We are talking about a slow, lazy, 25 yo left fielder who is almost universally regarded as a poor fielder. Even if we had no data at all, what would we estimate his runs cost/saved per year, given what we DO know about how much the best and worst fielders cost/save a team? -10 -15 -20? I generally tell people that, depending on the position of course, a bad fielder is -10, a very bad one is -15, and a horrendous one is -20 (a few are probably legitimately worse, like Griffey, who is data-wise the worst fielder in baseball, bar none). With Manny, take your pick.
Around the horn: Griffey to start in right
I gather Griffey would still be a below average defender in RF?
Manny being Manny.
That would mean that either Ortiz or Ramirez sits, or is exposed to an even more challenging position every day. I don't think so.
Now I think Boston would actually be well-served by trading Ortiz for some other help - I think he's great, and I believe the perception around baseball has him as the "Duke of Clutchiness". Not believing that clutch hitting is repeatable, I think that his trade value will likely never be higher than it is today.
This has the benefit not only of helping the Sox out in other ways, but of getting Manny in the DH slot on a very regular basis.
On the other hand, in the real world, the city of Boston would explode if this were done. But be on the lookout for the Boston writers to start slapping Ortiz around - that's the way to see that the FO is ready to jettison him.
You must be Registered and Logged In to post comments.
<< Back to main