Baseball for the Thinking Fan

Login | Register | Feedback

btf_logo
You are here > Home > Hall of Merit > Discussion
Hall of Merit
— A Look at Baseball's All-Time Best

Tuesday, July 09, 2002

Distribution list test

I sent an email last night to all ‘registered voters’, who are basically anyone I have in the address book for the Hall of Merit.

If you didn’t get one, and you want to be on the correspondence list, please let me know, by sending an e-mail to me at this address, which is different than the one below; you can copy the .(JavaScript must be enabled to view this email address) address (the one below) as well. I haven’t been checking that one below for some time, it had slipped my mind. Copying my regular home email will remind me to check the other address and get you in the address book . . .

You can also just post to this thread, leaving your email in the appropriate spot on the form.

I guess we can use this thread if someone wants to bring up an administrative issue, or anything else not related to discussing the merits of players.

Joey Numbaz (Scruff) Posted: July 09, 2002 at 11:04 AM | 118 comment(s) Login to Bookmark
  Related News:

Reader Comments and Retorts

Go to end of page

Statements posted here are those of our readers and do not represent the BaseballThinkFactory. Names are provided by the poster and are not verified. We ask that posters follow our submission policy. Please report any inappropriate comments.

Page 2 of 2 pages  < 1 2
   101. Rob Wood Posted: August 02, 2002 at 12:33 AM (#510153)
I have completed my preliminary investigation into the relative
   102. Rob Wood Posted: August 02, 2002 at 05:43 PM (#510155)
So that everyone can see the year-to-year variation in the 19th century, here are those results.

Year--Lg---Hit----Hr----BB-----SO----H$----Avg
   103. Rob Wood Posted: August 02, 2002 at 10:10 PM (#510156)
Oops, I just noticed that the H$ formula I typed above is slightly wrong. I did the calculations correctly in my analysis, but I typed the wrong formula in the post above. Of course, H$ should be written as (H-HR)/(AB-SO-HR).
   104. Rob Wood Posted: August 07, 2002 at 06:45 PM (#510157)
I did another batch of runs of my voting simulation software. To look at the "minority voting bloc" issue (aka Ross Barnes and the like), I slightly modified my simulation. I still have 100 voters each ranking 1000 players according to their personal perceptions, which are randomly distributed around some "true" values for each player. People fill out their HOM ballots according to their personal perceptions.

The modifications are as follows. Now 20% of the voters are "minority" voters and give a sizeable additional value to 5 "minority" players. These minority players (aka Ross Barnes) are randomly selected among the 6th thru the 15th truly best players. The idea is that these minority voters will all vote for Ross Barnes, say, whereas very few of the majority will. The voting schemes will perform differently in the face of this minority issue.

Here are the results. Defns are given in my previous posts.

V1: 61.4 80.9 94.7 10-9-8-7-6-5-4-3-2-1
   105. User unknown in local recipient table (Craig B) Posted: August 07, 2002 at 07:34 PM (#510158)
The way I interpret Rob's results, the differences are minimal between all systems except the widely disliked V5. I just don't see ballot structure as accomplishing anything significant to combat any "minority voting bloc" issue. (Which, as I said before, I do not think is an issue as the number of people who are going to engage in strategic voting in an election like this is incredibly small.)

On that note, we are registering voters, are we not? We will need to.

I _do_ think that asking the voter to put their judgment to good use in making disctinctions is better, and would prefer a (14 or 10)-9-8-7-6-5-4-3-2-1 ballot or a 20-19-18-17-16-15-14-13-12-11 ballot, basically anything that ensures that rank order candidates are submitted... it's part of the fun and it encourages closer study of the candidates.

I should note, by the way, that a long ballot (provided it is weighted in some way) will go a long way to neutralizing this "problem" because it ensures that the better players are ranked on all ballots. Given that we are considering 10 ballot slots for (usually) 2 or 3 candidates, I don't see a need to make it longer, but it would be a solution. But while 10 seems doable, if you ask people to put down 15 or 20 names you will start losing voters.
   106. User unknown in local recipient table (Craig B) Posted: August 07, 2002 at 07:36 PM (#510159)
Many thanks to Rob, by the way, for such wonderful and detailed studies. These are great, and very helpful. But in general, Condorcet-type voting "deficiencies" or "paradoxes" are extremely tough to combat and in actual practice, are rarely problematic.
   107. Rob Wood Posted: August 07, 2002 at 10:09 PM (#510160)
Thanks Craig for those kind words. Permit me to reply to one issue you raise. Thinking carefully about the ballot structure seems to me to be a very important issue (as you can tell by the time and effort I am putting into it). Even ignoring strategic voting and "Condorcet-type voting paradoxes", which I have done in my analyses, this may be a key issue.

What is the best way to reflect a group of experts' views on the most meritorious players throughout baseball history? I think it far preferable to delve into this issue with objective and systematic analysis (i.e., make assumptions and test different schemes) up front than have concerns linger throughout the HOM exercise.

As a personal aside, I just spent a year of my life with the Baseball Survivor group exercise in ranking the top 100 players of all time. The exercise was a lot of fun and very informative. However, in retrospect I now wish we had spent more time up front discussing the voting rules since many of our results were a direct result of our voting scheme rather than the "best" reflection of the groups' expert opinions.
   108. Rob Wood Posted: August 08, 2002 at 06:41 PM (#510161)
Here's another report of results of my voting simulator. This time all the voting schemes force voters to vote for 15 players on each ballot so as to make the comparisons more fair. Plus the "minority" issue (Ross Barnes) is in play. See the previous post for descriptions. Results are averages over 1,000 trials.

V11: 60.9 81.6 96.9 15-14-13-12-11-10-9-8-7-6-5-4-3-2-1
   109. scruff Posted: August 08, 2002 at 07:11 PM (#510162)
Rob how about this scheme, a variation on the 7-6-6-5-5-5-etc.

7-6.25-5.75-5.33-5-4.67-4.3-4.1-3.9-3.7-3.4-3.2-3-2.8-2.6.

Obviously that's a pain in the butt. But it solves Craig's ranking issue. Acutally try this, it's practically the same, but whole numbers:

70-63-58-53-50-47-43-41-39-37-34-32-30-28-26. It's the same general scheme of making the distinctions smalled as you move down the ballot, which represents the widening at the far end of the bell curve (that was my idea when I came up with the system anyway) as you move away from the end. I think the difference between 1 and 15 is a lot closer to 70-26 than 15-1, which is probably why this system keeps showing up near the top of the charts. There is a substantial penalty for not being named to a ballot, but I think that's okay, if someone doesn't think you are one of the 15 best, you are probably not one of the 2 or 3 best, generally speaking.

I don't think 15 will be too tough, especially for the first ballot. There's quite a backlog. After that, it's just a question of revising your ballot based on:

-discussion (people will change your mind, or you'll change their's)
   110. scruff Posted: August 08, 2002 at 07:14 PM (#510163)
That is a really dorky looking system though. I can imagine how we'll be called a bunch of mathmeticians, etc. if that voting scheme ever made it's way to the more mainstream media (should this project exceed expectations and take off) outlets, and as Primer's audience grows.

Do you all think that's something to be concerned with as we decide on a system or not? I don't really care, I just want the best system we can come up with, but I suppose someone should worry about things like that.
   111. scruff Posted: August 08, 2002 at 07:18 PM (#510164)
actually, Rob, try this one:

70-63-58-54-50-46-43-41-39-37-34-32-30-28-26

Just tweaked the difference for a 4th and 6th place vote from 53 and 47 to 54 and 46. Now the difference as you move down is the same or smaller each step of the way

1st-2nd 7 points
   112. User unknown in local recipient table (Craig B) Posted: August 08, 2002 at 07:57 PM (#510166)
I really really like that system. We don't need to worry about what the points look like, anyway. And in the end, as Chris F points out you as the voter just rank order 1-15 and let the point-scoring system take care of itself.
   113. MattB Posted: August 08, 2002 at 09:47 PM (#510169)
It seems to me that the "background" answer is 10-9-8 (or 15-14-13) since that is the MVP-style voting that was intended.

The question is, then, are any of the other voting systems preferable. Rob Wood's numbers don't seem to show a more than 1-2% advantage to any alternate system. That strikes me an insufficient to deviate from the norm. But, that's just one man's vote. Weigh it as you deem appropriate based on whatever voting scheme emerges as the favorite.

I assume this means that no one wants "extra points" anymore?
   114. Rob Wood Posted: August 09, 2002 at 07:46 PM (#510171)
At the risk of beating this dead horse, here's maybe the last installment of results from my voting simulator. Per Scuff's request, I have added one more voting scheme. I also sprinkled a little more variability into the simulator to see if the tally metrics would spread out; this didn't happen though.

V11: 53.4 75.7 95.0 15-14-13-12-11-10-9-8-7-6-5-4-3-2-1
   115. jimd Posted: August 09, 2002 at 10:09 PM (#510172)
Voting summary as I understand it.

To manipulate MVP style voting, I would:
   116. scruff Posted: August 11, 2002 at 04:37 AM (#510174)
Yes Josh, you and Satchel P, Oscar C and Cristobal T are all eligible. Hopefully we'll get lots of discussion from the Negro Leagues experts in the group, so we can get a good idea of where to slot these players.
   117. Marc Posted: August 11, 2002 at 10:18 PM (#510175)
Thanks for the simulations. It looks as if there are a dozen or more formats that provide about the same level of discouragement (or not) to attempted manipulation. So I would hope, therefore, that we would choose a simple, intuitive system. (As suggested, if we simply rank our choices 1 through x, and they're converted to a 76-63-whatever-whatever calculation in tabulation, that is fine.)

As I think about this, though, a bigger concern has popped up for me. It's been suggested that a really deep ballot (15 names) makes manipulation harder. But it also forces me to vote for players who I know darn good and well don't belong in the HOF. And then I'm going to justify my ballot? What if I just plain don't think there are 15 worthies on the ballot?
   118. scruff Posted: August 12, 2002 at 12:26 PM (#510176)
Marc, the question we're asking isn't "is the player worthy of the HoM?". The question is "please rank the best X eligible players from 1 to X". 'X' is still to be determined, but will probably be somewhere between 10 and 15 (I like 15). We're only going to elect between 2 and 5 players in any given year.

Think of it like an MVP ballot. In almost any year, there aren't 10 players that deserve to win the MVP (or 3 that deserve the Cy Young Award) but they still put 10 names on the ballot. Same thing here.
Page 2 of 2 pages  < 1 2

You must be Registered and Logged In to post comments.

 

 

<< Back to main

BBTF Partner

Support BBTF

donate

Thanks to
Eugene Freedman
for his generous support.

Bookmarks

You must be logged in to view your Bookmarks.

Syndicate

Page rendered in 0.1781 seconds
49 querie(s) executed