Baseball Primer Newsblog
— The Best News Links from the Baseball Newsstand
Sunday, November 04, 2012
Nate Silver, Cosh, Tango, PECOTA, Marcel the Monkey!...It’s almost like the golden days of Primer! Backlasher, RossCW come on down!
The whole world is suddenly talking about election pundit Nate Silver, and as a longtime heckler of Silver I find myself at a bit of a loss. These days, Silver is saying all the right things about statistical methodology and epistemological humility; he has written what looks like a very solid popular book about statistical forecasting; he has copped to being somewhat uncomfortable with his status as an all-seeing political guru, which tends to defuse efforts to make a nickname like “Mr. Overrated” stick; and he has, by challenging a blowhard to a cash bet, also damaged one of my major criticisms of his probabilistic presidential-election forecasts. That last move even earned Silver some prissy, ill-founded criticism from the public editor of the New York Times, which could hardly be better calculated to make me appreciate the man more.
...For most players in most years, Silver’s PECOTA worked pretty well. But the world of baseball research, like the world of political psephology, does have its cranky internet termites. They pointed out that PECOTA seemed to blunder when presented with unique players who lack historical comparators, particularly singles-hitting Japanese weirdo Ichiro Suzuki. More importantly, PECOTA produced reasonable predictions, but they were only marginally better than those generated by extremely simple models anyone could build. The baseball analyst known as “Tom Tango” (a mystery man I once profiled for Maclean’s, if you can call it a profile) created a baseline for projection systems that he named the “Marcels” after the monkey on the TV show Friends—the idea being that you must beat the Marcels, year-in and year-out, to prove you actually know more than a monkey. PECOTA didn’t offer much of an upgrade on the Marcels—sometimes none at all.
PECOTA came under added scrutiny in 2009, when it offered an outrageously high forecast—one that was derided immediately, even as people waited in fear and curiosity to see if it would pan out—for Baltimore Orioles rookie catcher Matt Wieters. Wieters did have a decent first year, but he has not, as PECOTA implied he would, rolled over the American League like the Kwantung Army sweeping Manchuria. By the time of the Wieters Affair, Silver had departed Baseball Prospectus for psephological godhood, ultimately leaving his proprietary model behind in the hands of a friendly skeptic, Colin Wyers, who was hired by BPro. In a series of 2010 posts by Wyers and others called “Reintroducing PECOTA”—though it could reasonably have been entitled “Why We Have To Bulldoze This Pigsty And Rebuild It From Scratch”—one can read between the lines.
for his generous support.
You must be logged in to view your Bookmarks.
: The Calm-Before-The-Storm and Postseason Prediction OMNICHATTER, 2014
(80 - 6:19am, Sep 30)
Last: Dr. VauxNewsblog
: Madden: How dare the sabermetrics crowd and others try to diminish Derek Jeter’s greatness
(144 - 5:20am, Sep 30)Last:
cardsfanboyHall of Merit
: Most Meritorious Player: 2014 Discussion
(9 - 4:00am, Sep 30)
Last: shoewizardHall of Merit
: Most Meritorious Player: 1958 Ballot
(9 - 2:49am, Sep 30)
: Mets close season optimistic for next year
(50 - 2:06am, Sep 30)
: OT: Monthly NBA Thread - September 2014
(392 - 1:53am, Sep 30)Last:
Gold Star - just Gold StarNewsblog
: RBI Baseball, 2014 Playoff Edition
(2 - 1:42am, Sep 30)
Last: Harvey BerkmanNewsblog
: ESPN: Ron Gardenhire out after 13 Seasons with Twins
(30 - 1:04am, Sep 30)
Last: vortex of dissipationNewsblog
: Attanasio discusses Brewers collapse, changes coming for 2015
(126 - 12:24am, Sep 30)Last:
greenback calls it soccerNewsblog
: OT August 2014: Wrassle Mania I
(261 - 12:10am, Sep 30)Last:
NJ in DC (Now with temporary employment!)Newsblog
: OT: NFL/NHL thread
(8138 - 11:55pm, Sep 29)Last:
PASTE Thinks This Trout Kid Might Be OK (Zeth)Newsblog
: Baseball Past & Present: Vote: The 25 Most Important People in Baseball History.
(281 - 11:54pm, Sep 29)Last:
: Remembering George ‘Shotgun’ Shuba, 1924-2014
(4 - 11:25pm, Sep 29)
Last: Pasta-diving Jeter (jmac66)Newsblog
: The Captain’s Log: Derek Jeter’s Lady-Killing Past, From ‘Yeah, Jeets!’ to Gift Baskets
(29 - 11:21pm, Sep 29)
Last: Walt DavisNewsblog
: Primer Dugout (and link of the day) 9-29-2014
(57 - 11:13pm, Sep 29)
Last: Walt Davis