Wednesday, February 18, 2009

Conservative and risky football strategies (and kurtosis)

Brian from Advanced NFL stats recently posited that some NFL teams (namely, the Washington Redskins under Jim Zorn) might have been throwing too few interceptions. This was because the lack of interceptions was a symptom of playing too conservatively, and therefore costing the Redskins games.

Implicit in Brian's thoughtful article are a couple of assumptions that I want to unpack, because radically different strategies might be appropriate depending on the level of football.

  • The first assumption is that a lack of passing (or passing aggressively) costs the offense points. This is undoubtedly correct: on average, passes garner more yards per play than runs, and an equilibrium playcalling strategy will seek to maximize the returns for each play (whether in terms of yards, first downs, or points).
  • The second assumption appears to be that maximizing yards and points is the optimal strategy for an offense. Hence, the lack of interceptions means that the team is leaving points on the board, thus costing it games. This is the assumption I want to address in slightly more detail.

Is it always "optimal" to set your strategy to maximize points scored?

In the NFL -- which is what Brian focuses on -- this is likely true and the assumption holds. NFL teams are almost all competitive with each other, and even the worst teams can beat the best in a given game. So any reduction in expected points is likely to hurt a team's chances of winning because they need to maximize that out to get wins.

But is that true in college? Or in high school? Think about when Florida plays the Citadel. The Gators have a massive talent advantage compared with the Bulldogs. As a result, what is the only way they can lose? You guessed it: by blowing it. They can really only lose if they go out and throw lots of interceptions, gamble on defense and give up unnecessary big plays, or just stink it up.

A fan or some uninitiated coach might see this as a lack of effort, but another view might be that Florida used an unnecessarily risky gameplan that cost them a victory. And since we know that they would win almost every time, what did they gain by being more aggressive? Even if they gained in expected points, this is something like the difference between a forty-point and sixty-point victory, which ought to be irrelevant. (I leave aside BCS calculation questions, which very well might make it worth it to increase the risk of loss to get a bigger chance of a blowout victory.)

The upshot then is that, for the storied programs with large talent advantages, there is seemingly more downside than upside to being very aggressive, either on offense or defense. While it might increase the risk of blowing the opponent out, it also increases the risk of stumbling.

The flipside: the underdog

It's a well-worn belief that underdogs -- i.e. the kind of severely outmatched opponent that cannot win without some good luck -- must employ some risky strategies to succeed. This has long been believed but now we have a reason, though it also teaches us that there is a price to this bargain. The underdog absolutely must take the riskier strategy, whether by throwing more and more aggressively, by onside kicking, or doing flea-flickers and trick plays. They have to get lucky. In the process, however, they also increase the chance that they will get blown out, possibly quite badly. But isn't that worth the price of a shot at winning? Florida might pick off the pass and run it back for a touchdown; they might sack the quarterback and make him fumble; they might blow up the double-reverse pass. If so, then things look grim. But what if they didn't? And if the team didn't do those things, how can it beat them by being conservative? By waiting for Florida to make mistakes?

Get technical

Let's take a quick step back and talk about what is happening from a probability standpoint. What does a more aggressive (and thus more risky) strategy do to our expected outcomes? Hopefully everyone is familiar with the bell-curve, which is a graphic way of depicting the range of possible outcomes based on the probability of their occurrence. The normal distribution is the most common, and it assumes that outcomes on the left and right are as likely as the average outcome. Here, let's assume this is the curve for an offense that can be expected to score around 28 points a game.




Now, let's say they decide to ramp it up. They want to score more points, but this is a riskier strategy, and therefore the range of outcomes will vary more wildly. Below is the new curve, which has moved to the right (to reflect the greater expected points) but is also flatter -- a measure of kurtosis -- which makes the "tails," or ends of the curve "fatter."

(Remember, the height of the curve is the probability of the event happening. Although with the moved curve the whole offense now is expected to score more points, it is now less bunched around the middle because the strategy employed is riskier and hence has more variance or variety.)



What does this tell us? It really just reaffirms what we'd already guess (and assumes that we know what strategies are both riskier and more rewarding, which is an assumption but generally involves passing more). Our offense now: (a) averages more points, (b) has an increased chance of scoring in the forties and blowing out the opponent than before (represented by the shaded green area), but (c) has an increased chance of blowing it and scoring fewer points than our more conservative -- and less variant -- strategy from before. Hence, you might maximize your points but you might actually increase your chance of losing in the process.

Now, remember I'm making assumptions about the nature of the curve. There's also a probability phenomenon known as skewness, which might mean that the improved strategy actually will rarely ever incur a bad game and all the variance will be good.

But the reason I took this mathematical approach to this is that this is really the lesson of the financial crisis as applied to these Wall Street gurus, imported to football: you can "improve" your strategy, you can increase your expected gain, you can increase your chance of blowout wins, but in the process you might be sowing the seeds of your own unlikely, but catastrophic demise. Sort of Black Swans for football.

Spurrier and keeping it close

So in the NFL, where teams are almost all competitive (save, maybe the Detroit Lions), it's likely the best strategy to simply maximize expected points and to go from there. But in other levels, with talent disparities of all sorts, it is trickier, as we have seen.

In the 1990s, Steve Spurrier's Florida Gators were undoubtedly some of the most talented teams of the decade. They were also some of the most aggressive. As a result, they absolutely destroyed some teams. Of course there were the seventy-point blowouts of Kentucky, but what about when they scored more than sixty against Phil Fulmer's Tennessee Volunteers? Yet, Spurrier never once went undefeated with the Gators: his teams always seemed to drop a game or two that maybe they shouldn't have. And those losses almost always had the same profile -- too many interceptions, couldn't run the ball at all, and too many big plays given up on defense. I can't believe I'm inclined to say this, but maybe Spurrier should have been more conservative? He might not have won as many games by sixty or seventy, but maybe they would have gone undefeated and won more than one title?

On the flipside, almost every week of the season I see teams go to Southern Cal, LSU, or Ohio State, and pretty much give up all hope of winning in the name of "keeping it close and winning it in the fourth quarter." As outlined above, this might be the worst strategy against such teams. They have little chance of winning on the merits, so what they need to do is flatten the tails and increase the chance for a shocker: take risks, and hope their coin flips go in their favor. Maybe they won't. Maybe they get blown out. But not taking those chances is a surefire way to set their low chance of winning in stone.

Yet, much like with David Romer's paper where he observed that NFL coaches probably don't go for it on fourth down enough, there are external and likely irrelevant reasons that deter coaches from employing a true "risky-underdog" strategy: the risk that the coach will get fired. I am advocating here that underdogs go for it and increase the calculated risk they take on. (Keep in mind that you can go overboard on this. Chucking the ball forty yards downfield every play, while risky, would not increase your scoring or even chance of winning because you'd become predictible and downright silly. It's about calculated risk.)

But there are real costs -- at least for the coach -- of getting blown out. And make no mistake, the bargain for a greater chance of winning includes the greater chance of getting thrashed. Maybe this should be irrelevant -- a win is a win and a loss is a loss. But a blowout loss has collateral effects, even if they are purely psychological and emotional. You can lose recruits, you can lose donations, and you can lose your job. Look at Mike Shanahan with the Broncos. He was on the hotseat, but he lost his job primarily because Denver got blown out in their final game. I don't necessarily think that was because his team took on increased risk, but people do not tolerate ugly defeats, rational or not.

Similarly, there might be real gains for an underdog to just "keep it close" with a big boy without ever having a real chance of winning. People discount moral victories, but if such and such team can "keep it close" with USC, then they get all kinds of accolades and possibly even confidence going into the following weeks. But if they employed the risky-underdog strategy, then they might gain a slight marginal increase for a victory, with a steeper increase in the chance of getting buzzsawed right off the field (remember skewness).

So, from the perspective of being purely focused on winning football games, I think the implications of the risky/conservative strategy dynamic in the context of teams with wide talent disparities has some pretty dramatic implications. But in the real world, there's lots of other factors, including the felt need by the coach to protect his own skin. Yet, he might be costing his team a chance at victory.

14 comments:

  1. Great analysis. The one thing I think is missing here is a look at reducing the number of possessions in a game (screw time of possession). Beyond taking a more risky play by play strategy, reducing the number of possessions not only reduces the worst case scenario, but also expands the value of a couple big plays. The more possessions, the more tall and narrow the bell curve is (at least in relation to points/poss.). By reducing the total possessions, the underdog team has a better chance to leverage a couple successful plays, possibly due to increased risk taking, into a win.

    ReplyDelete
  2. what he said,

    touched on both in the article and the comment above me,

    one advantage to Oklahoma playing at the pace they do is that they even out the effects of a few bad plays against them,

    the more plays in a game the less a bad play here or there winds up in a loss for them

    ReplyDelete
  3. I like to start a season of NCAA football with the worst team in Division 1 on heisman level. This teaches me a lot about what strategies work with less talented teams and what might work the best with teams that have the most talent. I have found that running the ball and winning is almost impossible. You can easily get into third and long situations by running the ball on first and second down with a bad team. The strategy that works the best is an aggressive down field passing attack with an athlete at QB who can run if everyone is covered. My defense is going to get destroyed either way so I blitz as often as possible to try and get the ball back to my aggressive offense. I also slow it down in the red zone on offense that way I'm increasing time of possession and getting field goals instead of turnovers.

    -Doug
    http://www.footballburrito.com/

    ReplyDelete
  4. Not sure I would discount keeping it close and winning in the fourth quarter. I think it works when a team that would be outmanned in a shootout tries to control the ball and limit the opposing offense's possessions.

    Take Auburn vs. Florida 2007. Auburn had one of those very sound Tuberville defenses, but their offense simply struggled to score points, even against an absolutely terrible Florida defense in 2007.

    What won those games for them was playing a conservative game of keep-away and keeping Florida's offense on the sidelines and allowing their defense to create opportunities with field position and turnovers for their offense to have a better chance of scoring. Florida ended up having to play aggressive, made a couple of mistakes, and ultimately left Auburn with the opportunity to win the game at the end.

    I think the strategy of being conservative offensively can work if the offense is backed by a strong defense

    ReplyDelete
  5. I also might add that I think the optimal strategy would be to maximize margin of victory, not points. Getting into a shootout by trying to maximize points scored if your defense is overmatched isn't necessarily good either. I'd venture to say that the 2001 Florida team would have had a better chance of winning against Tennessee had they tried to extend their possessions and let their defense, which was being run ragged, catch more of a breather. When they needed a stop, they simply couldn't get one, while Tennessee could.

    I should also add that on the whole, though, I agree with your analysis and do think that many teams play far more conservatively than is necessary

    ReplyDelete
  6. I would say that the main reason Spurrier could never go undefeated was that some teams did match up well in the secondary for one (FSU or Tenn.), and two that he had no defense at all until Bob Stoops took the job. I don't think his lack of conservatism was the problem, although resting his defense would've surely helped.

    Had Spurrier ever put emphasis on his defense before hiring Stoops, he likely would've pulled down two more national titles.

    Some of those teams were just terrible on D.

    ReplyDelete
  7. Excellent analysis. A few points to add.

    1) I'm not sure Florida ever had better talent than FSU in the Spurrier era excepting 95, 96, and 01 and I always felt Tennessee should have had better success against Spurrier in the mid to late 90's.

    2) Agree completely with the underdog analysis, but there comes a point where the perception of a team being worse than its opponent isn't necessarily true. The best example I can give off the top of my head is Northwestern 95 and 96. They were underdogs according to perception, but they played pretty straight-forward football with underrated players and won 2 Big Ten titles. A coach has to draw that pretty fine line between knowing he has inferior talent and creating something special to happen to get the win or thinking he has relatively equal talent (even though outside perceptions differ) and being able to win with a more conventional gameplan (i.e. doing what you do).

    The 07 Auburn versus Florida example in an earlier comment seems that way to me. Those teams are relatively equal in talent across the board. Auburn didn't need to go blitz happy or stack 10 in the box or whatever aggressive style on defense one favors to win that game. They just lined up and executed.

    ReplyDelete
  8. As much as it pains me, i'd have to agree with DoubleB on his first part. The two years that Spurrier had truly great talent, they ran into Nebraska and then FSU (while getting the chance to redeem against FSU).

    And rather than playcalling, going undefeated in the college season seems to have much more to do with luck, health and scheduling then offensive style. Most elite teams will play at least 3 games each season against elite competition, another 2 or 3 against teams that have some kind of feasible chance, then a conference championship (unless you belong to the Pac or Big 10..) and a bowl game. Thats quite a few chances to fail..

    ReplyDelete
  9. Spurrier's offense at Florida had something in common with Manning and the Colts. They were outstanding at maximizing the gain from the smallest advantage. Spurrier did a great job of using formations and motion to isolate a mismatch and beat you to death. If you matched up at every position, you could stop him. If you were just one cover guy short of matching up, he might put up 50.

    Manning has taken that to a whole different level. The Colts routinely find a way to generate points despite being overwhelmed in the O-line and almost blanketed by coverage. They need less time from the pass pro and smaller windows for open receivers to keep the chains moving. Defenses can be "this close" to shutting them down completely and yet still give up 24 pts.

    ReplyDelete
  10. Playing slow ball increases the chances a bad play or two can burn you. That helps underdogs.

    If you do it right, for every mistake you make they make three or more. Uptempo should secure more blowouts.

    Equilibrium is a myth. Nothing occurs in a vaccum, two teams cannot both perfectly execute one vs. the other in the same game. The null exception is impossible. Events shape outcomes and influence decisions.

    You need two graph plots, one for each team, and compare from there. Playing similar styles leaves a different disparity from either playing differently.

    Where you plan on being is not where always end up in terms of play calling. You actually need to plot where the plan calls, and the optimized and minimal results to either side of that. Three plots per team, compared vs. three other plots.

    Now the low vs. high disparity plays into being to far greater levels for opposite spectrum ends in the open and guarded game styles.

    That doesn't even begin to count the main opponent of the second half- the clock. Whole new graphs would reflect those play calls and situations.

    Now you have another set of graphs to overlay for the time given in a game. The curve is steep for conservative teams that are down, etc.

    -Mr.M

    ReplyDelete
  11. Also, mistakes effect outcomes. Comparisons from a same/same call style value adjusted for mistakes is far greater than a difference of style.

    Your chances of coming back are greater for aggressive plots. you are not changing how you play to recover the difference.

    -Mr.M

    ReplyDelete
  12. As others have noted, the optimal strategy for an underdog is a strategy that combines high risk playcalling(even potentially at the expense of expected value) with a slow down style that limits the number of possesions.

    In basketball Princeton fits this MO to a tee. Slow the game down and take lots of high risk/high reward three pointers. And they regularly gave the big boys fits come NCAA tourney time.

    I think GT/Navy might fit the bill in football.

    ReplyDelete
  13. Great analysis. I think that it happens a lot where coaches just think about what seems like it would be a good strategy instead of really looking at the numbers without the emotion behind them.

    I read an article a few weeks back about a high school team that had punted twice in four years or something. The coach looked at the numbers and realized that punting only netted him an average of 20 yards of field position and increased the risk of a big play. Instead it became less risky to just go for it in almost every situation.

    I should also say that the team had a great record, doing great in the state playoffs and everything, so it wasn't simply an experiment.

    ReplyDelete
  14. Wow, excellent post. Nice to see some smart analysis being applied to football. A nice change from the "so and so will go at this position in the draft," blather i've been hearing the last few weeks.

    ReplyDelete