Baseball for the Thinking Fan

Login | Register | Feedback

You are here > Home > Baseball Newsstand > Baseball Primer Newsblog > Discussion
Baseball Primer Newsblog
— The Best News Links from the Baseball Newsstand

Tuesday, November 13, 2012

Camden Depot: Measuring Bullpen Management: Bucking Up the Bullpen

Jon Shepherd suggests a way to evaluate a manager’s bullpen usage over time, drawing on Dan Lependorf’s article at Hardball Times:

A Hardball Times article suggested using WPA - WPA/LI as a measure of bullpen performance that would be useful in assessing bullpen management.  WPA is the acronym for Wins Probability Added.  This is calculated as the difference in win expectancy before and after an event. LI is the Leverage Index.  It is a measurement of how consequential a specific scenario is based on the inning, outs, score, baserunners, and baserunner position.  By using the two statistics in concert, you arguably have a measure that gives you a context neutral wins added metric.

To test whether this metric would give an indication that managers have skill associated with using a bullpen well, I decided to take the last five seasons of several recent managers.  I compare each manager’s mean for WPA, WPA/LI, and WPA-WPA/LI (ANOVA).  WPA will inform us simply if certain teams wind up with better outcomes for winning based on reliever usage.  WPA/LI will neutralize all situations and measure reliever ability in general (similar to wOBA).  WPA-WPA/LI is being used to inform us about whether relievers actually perform better in clutch situations.  If one of these statistics indicate an actual skill then the numbers associated with a manager should be (1) repeatable and (2) result in managers being different from each other.  Of course, this assumes that these things are, in fact, measurable.

The results are somewhat as you might expect: Showalter, Joe Girardi, and Joe Maddon do well, Eric Wedge, Ozzie Guillen and Mike Scioscia do relatively poorly. There are a couple of surprises mixed in - Ron Washington in the upper tier, Bruce Bochy and Jim Leyland near the bottom.

Not a perfect study, but an excellent start.

Mike Emeigh Posted: November 13, 2012 at 09:57 AM | 0 comment(s) Login to Bookmark
  Tags: bullpens, managers, sabermetrics

Reader Comments and Retorts

Go to end of page

Statements posted here are those of our readers and do not represent the BaseballThinkFactory. Names are provided by the poster and are not verified. We ask that posters follow our submission policy. Please report any inappropriate comments.

You must be Registered and Logged In to post comments.



<< Back to main

BBTF Partner

Support BBTF


Thanks to
Shooty is obsessed with the latest hoodie
for his generous support.


You must be logged in to view your Bookmarks.

Hot Topics

NewsblogOTP 2016 October 24: Breitbart Radio Exclusive: Curt Schilling Joins Breitbart News Rotation Weekdays 9AM to 11AM ET
(116 - 5:44pm, Oct 24)
Last: Renegade JE (((Jason))), Fermenting Violence

NewsblogWon for the ages: After years of waiting and suffering, Cubs are in World Series - Chicago Tribune
(22 - 5:39pm, Oct 24)
Last: snapper (history's 42nd greatest monster)

NewsblogAre statheads responsible for the most exciting postseason in years
(12 - 5:35pm, Oct 24)
Last: TDF, situational idiot

Gonfalon CubsBring on the outsourced 5 minute Indians preview
(50 - 5:33pm, Oct 24)
Last: Andere Richtingen

NewsblogTigers analytics department now hiring, will soon unveil 'Caesar' |
(17 - 5:10pm, Oct 24)
Last: TJ

NewsblogChief Wahoo, Cleveland Indians' logo, heads to the World Series. Prepare for outrage. - Chicago Tribune
(35 - 5:03pm, Oct 24)
Last: Johnny Sycophant-Laden Fora

NewsblogOT: NBA 2016-17 Preseason Thread
(252 - 4:36pm, Oct 24)
Last: JJ1986

NewsblogCleveland Indians in World Series really is bigger than game -- Terry Pluto (photos) |
(5 - 4:25pm, Oct 24)
Last: John Northey

NewsblogCubs clinching pennant changed mindset that has been around far too long - Chicago Tribune
(12 - 4:21pm, Oct 24)
Last: Batman

Hall of MeritMost Meritorious Player: 1998 Ballot
(1 - 3:52pm, Oct 24)
Last: DL from MN

Hall of MeritMost Meritorious Player: 1998 Discussion
(23 - 3:29pm, Oct 24)
Last: DL from MN

NewsblogWho's cheering for the Cleveland Indians in the World Series? At least one big-name celebrity |
(25 - 3:06pm, Oct 24)
Last: SoSHially Unacceptable

NewsblogCleveland Indians' Salazar throws 3-inning simulated game; next stop World Series? |
(2 - 2:55pm, Oct 24)
Last: SoSHially Unacceptable

NewsblogEpstein on Cubs clinching NLCS |
(7 - 2:53pm, Oct 24)
Last: T.J.

NewsblogWelcome back, Kyle Schwarber! | 2080 Baseball
(34 - 2:42pm, Oct 24)
Last: Bring Me the Head of Alfredo Griffin (Vlad)

Page rendered in 0.1345 seconds
45 querie(s) executed