Baseball for the Thinking Fan

Login | Register | Feedback

btf_logo
You are here > Home > Baseball Newsstand > Baseball Primer Newsblog > Discussion
Baseball Primer Newsblog
— The Best News Links from the Baseball Newsstand

Friday, January 10, 2014

Rakich: Hall of Fame Post Mortem

It was an unpredictable day, although that didn’t stop us from trying. Twitter user @RRepoz aggregated all the public ballots prior to the announcement, and I took a stab at projecting final vote totals based on these “exit polls.” Both proved relatively accurate on Election Day.

...I recalculated my projections using adjustment factors averaged from just the past three years of voting history and made a startling discovery: the average error dropped to 2.9 points, and the median error plummeted to 2.1. Using three-year polling error this year would have produced more accurate results, suggesting that four-year-old data have indeed outlived their usefulness. (Curious to see if we could do even better, I also tested a version that used an average of just the previous two years; this produced an equivalent average error to the four-year average—3.0 points—but a lower median error—2.2 points. That’s still worse than the three-year calculation, though, indicating that three years is the sweet spot.) Therefore, I will use three-year calculations for my 2015 projections—accounting for the exit-poll error in 2012, 2013, and 2014 only.

Another tweak I will make to the experiment will be a subtle, yet important, change in how I calculate the polling error itself. Currently, I subtract a player’s percentage on public ballots (the polls) from his percentage on all ballots (the actual vote). However, it would be more precise to subtract his percentage on public ballots from his percentage on private ballots (i.e., all ballots minus public ballots). This is because “turnout” for the exit polls (i.e., the number of ballots publicly revealed) has increased dramatically in recent years. In 2012, we only know of 114 public ballots out of 573 total (19.9%); in 2014, a whopping 208 people out of 571 (36.4%) revealed their ballots beforehand. This necessarily creates some error because, for instance, some of the +7.9% error for Jack Morris in 2012 was eaten into by the 94 additional ballots that were public in 2014 but private in 2012. Put another way, if someday 98% of voters make their ballots public before Election Day, my adjustment factors will be pretty useless; we’ll already know that there can be only a minuscule amount of error in those polls. The very error represented by my adjustment factors by definition gets smaller with a larger sample size in @RRepoz’s exit poll.

Finally, one common denominator in both my projections’ errors and the polls’ errors was that we both guessed too high. Most players ended up getting fewer votes than we projected they would—whether because of the controversial Rule of 10, or old-school voters protesting the Steroid Era, or for some other reason. This suggests automatically building in a one- to two-point negative adjustment factor in addition to the player-specific one. However, a closer examination reveals that it is disproportionately the first-time candidates dragging the ballot in this direction; they over-performed in exit polls by an average of 3.7 points. Rather than try to devise my own method of projecting these fickle ballot rookies—an endeavor that has failed two years in a row now—perhaps I should simply dock them each a few points next year and call it a day.

Thanks to Barnald.

Repoz Posted: January 10, 2014 at 11:31 AM | 0 comment(s) Login to Bookmark
  Tags: hof

Reader Comments and Retorts

Go to end of page

Statements posted here are those of our readers and do not represent the BaseballThinkFactory. Names are provided by the poster and are not verified. We ask that posters follow our submission policy. Please report any inappropriate comments.

You must be Registered and Logged In to post comments.

 

 

<< Back to main

BBTF Partner

Support BBTF

donate

Thanks to
Shooty Survived the Shutdown of '14!
for his generous support.

Bookmarks

You must be logged in to view your Bookmarks.

Hot Topics

NewsblogDoug Glanville: I Was Racially Profiled in My Own Driveway
(282 - 4:44pm, Apr 18)
Last: Ray (RDP)

NewsblogOMNICHATTER FOR APRIL 18, 2014
(25 - 4:43pm, Apr 18)
Last: Rickey! In a van on 95 south...

NewsblogOT: The Soccer Thread March, 2014
(896 - 4:41pm, Apr 18)
Last: Swedish Chef

NewsblogRB: Carlos Beltran: more of a center fielder than Mickey Mantle, Ty Cobb or Duke Snider. So what?
(25 - 4:40pm, Apr 18)
Last: toratoratora

NewsblogOT: NBA Monthly Thread - April 2014
(312 - 4:39pm, Apr 18)
Last: Mess with the Meat, you get the Wad!

NewsblogDesign Room: Top 10 Logos in MLB History.
(73 - 4:36pm, Apr 18)
Last: My name is Votto, and I love to get blotto

NewsblogOTP April 2014: BurstNET Sued for Not Making Equipment Lease Payments
(1644 - 4:31pm, Apr 18)
Last: formerly dp

NewsblogMitchell: Now Playing First Base for the Yankees
(45 - 4:30pm, Apr 18)
Last: Best Dressed Chicken in Town

NewsblogDaniel Bryan's 'YES!' chant has spread to the Pirates' dugout
(93 - 4:19pm, Apr 18)
Last: Joe Bivens, Minor Genius

NewsblogRobothal: What a relief! A’s could use bullpen differently than other teams
(9 - 3:44pm, Apr 18)
Last: Willie Mayspedes

NewsblogNY Daily News: Secret Service Threatened To Shoot Mr. Met
(12 - 3:32pm, Apr 18)
Last: depletion

NewsblogPrimer Dugout (and link of the day) 4-18-2014
(22 - 3:20pm, Apr 18)
Last: Misirlou is on hiding to nowhere

NewsblogEscape from Cuba: Yasiel Puig’s Untold Journey to the Dodgers
(12 - 3:17pm, Apr 18)
Last: Misirlou is on hiding to nowhere

NewsblogFletcher: Foes have slowed Trout in one category so far - steals
(4 - 2:55pm, Apr 18)
Last: Shredder

NewsblogChris Resop - The Most Interesting Reliever in the World
(21 - 2:05pm, Apr 18)
Last: I Am Not a Number

Demarini, Easton and TPX Baseball Bats

 

 

 

 

Page rendered in 0.1235 seconds
50 querie(s) executed