Sunday, June 8, 2014
| [+/-] |
Infinite Field Football |
Physicists are always talking about ideal environments, like infinite planes with zero friction. What if we extended that to football and had teams play on an infinite field with an infinite clock?
How would it work? One team would start with the ball, drive some number of yards down field, and then turn the ball over to the other team. At that point, the other team would take the ball, drive some amount of yards in the other direction, before turning the ball over to the first team. And so on.
They would go back and forth, except for one strange exception. That exception is when the ball carrier is the fastest guy on the field and he gets through the defense. Can he run for infinity? The short answer is yes. But, for the moment, let's assume that doesn't happen and, later, I'll tell how to handle when it does.
It's pretty obvious that "winning" on the infinite field means that your team, when it possesses the ball, moves the ball further than when the other team possesses it. So, the thing we want to compute is the expected length of a drive.
The most informative way to calculate that is to break the drive into series of downs. Each series either ends in a new first down or a turnover. So let's define:
P = probability of a series ending in a new first down
D1 = expected length of series that ends in a new first down
D4 = expected length of a series that doesn't end in a first down
Now, we can build an equation for the expected length of a drive by looking at the number of first downs that occurred in it.
Exactly 0 first downs occurs (1-P) of the time
Exactly 1 first downs occurs P*(1-P) of the time
Exactly 2 first downs occurs P*P*(1-P) of the time
...
Exactly N first downs occurs P^N*(1-P) of the time
In probability, this is the geometric distribution. The Wikipedia page gives us the mean: P/(1-P). (NOTE: if you check the Wikipedia page, they're answer is (1-p)/p. This because their p is equal to my 1-P.) Now, knowing the number of first downs, we can write the expected length of a drive:
Expected length of a drive = (P/(1-P))*D1 + D4
Now, suddenly, P becomes very interesting. As it gets bigger, the length of the drive grows faster than linear.
P=.75 ---> Expected first downs = 3
P=.80 ---> Expected first downs = 4
P=.85 ---> Expected first downs = 5.666
Regarding the other factors, I don't expect the "expected distance to a new first down" to vary much between teams. Team with better offenses will produce more yards but some of those yards will go to reaching the first down in fewer downs. The "expected distance without a first down" will probably only differ between teams that punt after 3 downs and those who "go for it" on fourth.
When should a team "go for it"? Well, there we need to know the chance of making a first down. If that times the expected length of drive is longer than your punt, the team should go for it. Teams that "go for it" on fourth will have a larger probability of getting a first down, which we saw above, is the key metric in infinite field football.
What does this mean to finite field football?
The first conclusion to draw is that first down percentage and drive length are key stats to look at. We all knew they were important before, but I think they are worth considering as _the_ team metrics to look at. Likewise, for defenses, their affect on first down percentage is important.
My second conclusion is that first down percentage has a non-linear affect on drive length. A lot of analysis techniques assume linear relationships between terms. We need to be careful about how we apply those techniques.
My third conclusion is actually a supposition. I believe that EPA by field position is based on the Ps of the two teams. Brian Burke in 2008 said it wasn't linear. The graph he produced was based on data for all teams, but he also said "Another complication is that various teams have different curves." I think with Ps, we can determine what EPA by field position should look like from a theoretic point of view.
What no data?
This post doesn't have any data. I spend my days programming, so that muscle is exhausted when I have time off. So, if you like the idea, I'd love to see data too.
If we took a team's downs between their own 10 and the opponent's 20, I think we'd see some clear trends. Monte carlo techniques at the series-of-downs level (or at the down-by-down level) could be used to estimate the length of drives. Long plays that resulted in touchdowns (that is, those infinite runs on the infinite length field) could be sidestepped by computing the median length of drive rather than the expected. I'll be interested to see if the data is significant enough to measure differences.
Another important thing to measure is the finite field aspects. How well does an estimate of performance on an infinite field predict performance inside your own 10 and inside their 20? Brian Burke in 2008 said that QBs weren't statistically significantly better (or worse) inside the red zone. Good outside was good inside. Is that true for the whole offense? If so, I think the infinite field model is worth keeping around.
Tuesday, January 7, 2014
| [+/-] |
How does weather affect a QB's QBR |
A few years ago when I interned with ESPN, I had the pleasure of meeting the ESPN Analytics team. This was back when Total QBR was first being rolled out. After listening to a presentation the team gave on QBR, I became a fan of the metric. One of the things I was curious about was how weather impacted QBR. Does QBR go up in domes? Does QBR go down when it’s really cold? Dean Oliver, one of the creators of the statistic, was nice enough to send me the QBR data and I obtained the weather data by scraping the NFL gamebooks. I completed the study a few years ago but never thought of posting the results. Now, with the Green Bay-SF game expected to be bone-chillingly cold, I'm putting this post out.
When I conducted the study, I used an ANOVA to test if two samples of different weather data were significantly different. For example, one of the tests was rain
vs. no rain. I looked at a number of different categories: rain, hot/cold, wind, wind chill, domes, etc. Here were the results:
Monday, December 9, 2013
| [+/-] |
EP forfeited |
What the heck? The QB just spiked it. What a bizarre play call from the coach. It’s now second-and-ten. What is going on? Is the coach deliberately trying to lose this game?
Some time not much later in the game, with the score still tied, the coach faces fourth-and-two from the opponents 25. Out trots the field goal unit to attempt to give them the lead. “The field goal here is the right call”, proclaims Aikman. “You need to get points on the board. You don’t want to risk going for it and not coming away with something”
I’m sure you know where this is going. The opening spike, which would have been rightly called as crazy by everyone watching, cost the team 0.48 expected points. The field goal attempt, which would have been hailed as a no-brainer by the standard voices, cost them an almost identical 0.49 EP over going for it.
I got thinking about this after seeing a response to this tweet from the 4th Down Bot
@conorsen I think it cost them about 0.3 points. http://t.co/BDqKt95QGY
— NYT 4th Down Bot (@NYT4thDownBot) December 8, 2013In reply, @MattSantaMaria confidently stated that fractional points aren’t possible. Please go away and try again.
To be fair to him, he’s not wrong. Stating that a team cost themselves half a point is almost meaningless to someone who doesn’t have a grasp of probability. Explaining that attempting the field goal is as damaging to a team’s chances of winning as spiking the ball on the opening play of the game, however, might be more comprehensible.
Some other ‘crazy decision’ EP equivalents
- Taking a deliberate delay-of-game penalty on third-and-five costs around 0.4 EP
- Accepting an offside penalty when you’ve just gained 15 yards on a first-and-twenty play costs around 0.2 EP
- Taking a knee on a second-and-five would cost around 0.65 EP
Tuesday, November 5, 2013
| [+/-] |
Should Colts have gone for 2 |
by Ian Simcox
So there I am, browsing my Twitter feed and I see this
Re HOU FG scenario: IND should still have gone for 2. Failed att means being down 15, which still gives 2 more bites at the 2-pt apple.
— Brian Burke (@Adv_NFL_Stats) November 4, 2013
Predictably the replies featured people as sure of the value of kicking the XP as Brian was of going for the 2.
At a 45% success rate on the 2-pts, the WP calculator says Indy have a 0.10WP if they kick the XP, comparing favourably to 0.09WP if they go for it (0.12 on success, 0.07 on failure). So, marginally the XPers have it. I must admit though, I plugged starting the 4th qtr down 10, 11 and 12 on 1st down into the calculator, to simplify the second part of this article.
What really interests me is the uncertainty around these numbers, which is always important on these tight calls. The XPers may have it on the WP calculator, but if those numbers are +/- 0.03WP then it’s impossible to say which is right.
Saturday, November 2, 2013
| [+/-] |
The Colts and their New “Run-Heavy” Offense |
When the Indianapolis Colts hired Pep Hamilton to be their offensive coordinator in January, the team’s buzzword this past offseason was “balance,” with coaches stressing the need to run the ball to win.
While that may be cringe-worthy for anyone familiar with this site and Brian’s work on the topic, the Colts stand at 5-2, so there is a sentiment of vindication for Hamilton and head coach Chuck Pagano’s conservative coaching. Mike Wells of ESPN.com, formerly of the Indianapolis Star, went as far as to say the team “got their record by being a run-first team.”
Leaving aside how foolish molding a team led by prodigal quarterback Andrew Luck into a “run-first” club seems, we can use numbers to assess if Wells’ statement and others like it are true.
Are the Colts actually a run-based team and are they winning because of a newfound emphasis on running?
Friday, October 18, 2013
| [+/-] |
NFL Team snapshots - Week 6 |
by Tom McDermott
(This submission of a repost and can be found at its original home here. ED)
I've added a few more things to the Snapshots this week, namely, correlation values. I thought it might be interesting to see how the various Expected Points totals correlate with Margin of Victory and Win Percentage. For those of you unfamiliar with correlation (I know I was until I started getting into all this stat stuff): a correlation of 1.0 is perfect correlation, a correlation of 0.0 is no relationship. As far as Win Percentage, it makes sense that the offense and defense EPA correlations are the same - the way EPA works, for every point gained on offense, there is a point lost on defense (or vice versa). But I was surprised to see the higher Special Teams correlation. I'm not sure this means anything yet - the numbers will most likely regress as the season goes on. But it is interesting to note that the top three teams in terms of Margin of Victory - Denver, Kansas City, and Seattle - also have the top three special teams EPA scores.
| [+/-] |
Conversion percentage VS win percentage |
The intent of this study is to see how much more likely strong teams are to convert third or fourth downs compared to weak teams.
In this study I plot various conversion probabilities of 3rd and 4th downs, as a function of team strength (and distance to go). The measure of team strength that I use is the offense’s end of season winning percentage minus the defense’s end of season winning percentage. For the purpose of this study offensive conversion percentage is the number of times a team coverts a third and fourth down divided by the number of attempts to make that conversion. And of course the defensive conversion percentage is the number of times the defense holds on third and fourth down divided by the number of attempts.
So my X and Y variables are:
X =(Offense end of season winning percentage) – (Defense end of season winning percentage)
Y = 1 (successful conversion or TD), 0 (failed conversion)
I know there are much better ways to measure how good an offense or defense is than the end of season winning percentage; but I think this is a good first step. I also think it’s accessible. If a coach wants to get a better idea of how likely they might be to convert in a certain situation the win-loss records might be the first thing they think of. It’s probably how they think of their team strength – “we are a 12 and 4 team”.
I then plot a linear fit from all the 1 and 0 y data points. This means I am assuming that the “true” probability of conversion is a linear function of team W-L record.
I use data from 2002 to 2011 (regular season plus playoffs). I use most of the “normal football” assumptions, but not all. I was slightly more aggressive with time, allowing the 2nd quarter to be counted all the way up to 7 minutes left. The 4th quarter is excluded; all of the 1st and 3rd quarters are included. The plays are only included if the line of scrimmage is between a team’s own 25 and the opponents 20. The score differential is limited to 10 points.
Monday, December 31, 2012
| [+/-] |
Should JJ Watt win the MVP award? |
DPOY? Hands Down…
Stat
|
JJ Watt (Hou)
|
Aldon Smith (SF)
|
Von Miller (Den)
| |||
Sacks
|
20.5
|
1st
|
19.5
|
2nd
|
18.5
|
3rd
|
Tackles
|
69
|
50
|
55
| |||
Passes Defended
|
16
|
10th
|
1
|
2
| ||
Interceptions
|
0
|
1
|
1
| |||
Fumbles Forced
|
4
|
10th
|
3
|
22nd
|
6
|
3rd
|
Yards per Pass Attempt (Team)
|
6.7
|
7th
|
6.1
|
2nd
|
6.4
|
5th
|
Yards per Rush Attempt (Team)
|
4.0
|
9th
|
3.7
|
3rd
|
3.6
|
2nd
|
Stat
|
JJ Watt (Hou)
|
Aldon Smith (SF)
|
Von Miller (Den)
|
% adv
| |||
+WPA
|
2.96
|
1st
|
1.04
|
1.53
|
22nd
|
25%
| |
+EPA
|
122.1
|
1st
|
58.5
|
12th
|
74.2
|
2nd
|
65%
|
Success Count
|
109
|
1st
|
60
|
65
|
32nd
|
4%
| |
Tackle Factor
|
1.36
|
13th
|
0.67
|
0.71
|
-13%
| ||
QB Hits
|
43
|
1st
|
24
|
4th
|
27
|
5th
|
34%
|
Defensive GWP (Team)
|
9th
|
2nd
|
1st
|
-
| |||
Thursday, December 27, 2012
| [+/-] |
Wins above average: a statistical nightmare |
by Clark Heins
Introduction: Davis Wylie (pen name of researcher Neil Paine), after much complicated math resulting in each QB‘s stats being “adjusted“ to 2006 levels (through a process known as “translation“, i.e., normalization without standard deviation, converted everything into a final stat “Wins Above Replacement Player” totals in his "The 100 Greatest QBs of the Modern Era” opus which he used to rank QBs.
In football, there is no clearly established formula for determining WAR figures, but Football Outsiders originally estimated that a “Replacement Level” QB was some 13.7% less effective (valuable) than an “average” QB. This percentage was later changed to 13.3% and now rests at 12.5%. All these figures were arbitrary and consisted of some educated guesswork and “value judgments” about “players“ who never existed! It would have been much easier if Wylie had simply used the stat “Wins Above Average” which we can all understand instead of an incomprehensible abstract.
The problem for me was converting these WAR totals to WAA so as to compare with Doug Drinen’s figures in his own WAA opus.
Thursday, December 20, 2012
| [+/-] |
Kelly Criterion on 4th down |
It's 4th and 1 from your opponent's 43-yard line. You're up 3 points, and there is 5:16 remaining in the 1st quarter. Should you go for it?
According to the 4th Down Calculator, the answer appears clear. Based on history, there is an estimated 74% chance of converting a 4th down in that scenario. Success yields 0.68 WPA; punting yields 0.61 WPA, and failure yields 0.55 WPA.
These odds tell you that on average, it is a good decision to go for it - just the same as on average you'll make money if you take a bet with those odds and that probability of winning. The "Expected Value" (EV) in this scenario is 3.62. This means that on average, you will gain .0362 WPA by going for it.
However, average doesn't always cut it. Because if it's not certain, you could still lose.
EV enthusiasts often object to that observation, but let's briefly consider an alternate scenario. Pretend that you come across a certain state lottery. For $1, you have a chance of winning $500,000,000 profit. And your chances of winning are 1 in 350,000,000. (Also pretend, for the sake of argument, that there's a new identical lottery every second, and there can't be multiple winners in a round.) Since 500 > 350, those are good odds. Say you can play only once. Should you buy a ticket? What if you could play multiple times, or buy multiple tickets? Should you spend your $5,000 in hard-earned savings on lottery tickets?
Tuesday, December 11, 2012
| [+/-] |
1st Down Game Theory: Equilibrium and Exploitable Strategies |
by Mike Sommers
You are faced with a first and 10 on your own 20 yardline, what percentage of the time should you run vs pass? You are on the 40 yardline, what percentage do you run vs pass?
Equilibrium Strategy
This is a problem that is solvable, but it depends upon your objectives. I used average NFL data. The average pass attempt yields about 11.6 yards per catch with a 60.5% completion rate. I rounded this down to 11 yards and 60% completion rate. The average rush attempt yields 4.36 yards (2011 data) I rounded this down to 4 yards. Now if you approach the problem as an “equilibrium” strategy, your goal is actually to reduce the expected effect on the play to no change in score either way. For those familiar with “EP” (expected points), this doesn’t mean that the EP result would be zero, but that over the long run, the EP would not increase or decrease from it’s current levels. That is, no change in expectation of how many points you score, so if your expected points on first and 10 is .34, using an equilibrium strategy, it will remain .34. This is based upon the assumption that in the very long run, the opponents will either adapt or correctly anticipate how to adapt to exploit whatever strategy you come forward with, so the best plan is to just produce “average” results”. I don’t believe this to be true, but the equilibrium strategy is still valid as a “base strategy”.
| [+/-] |
When to sacrifice yards for situation |
by Mike Sommers
In "A Response To Brian Burke’s Washington Post Article", I stated that a team would actually be better served coming up short of the first down on 1st down. They would be better off setting up a 2nd and short than 1st and 10, unless they were able to surpass the threshold of 4 yards beyond the first down marker. All of these stats are based on normal teams who typically punt on 4th down. If they planned to go for it more optimally on 4th down, I suspect they would need even more than 4 yards to justify getting a conversion.
Before I go on about the exceptions, I thought it would be useful to get a bit more specific about the situations in which a 1st down conversion is not better than a 2nd and short.
Here is a graph and table of the expected points given the situation. While any 1st and 10 is more favorable than a 2nd and 3, a 2nd and 1 would still be 5 yards better than a 1st and 10. In other words, a 2nd and 1 on your own 29 yard-line is worth more expected points than a 1st and 10 on the 34.
Monday, November 5, 2012
| [+/-] |
Are punters getting better? |
Punts
The second most unloved play in the NFL (behind the extra point and, possibly, the Blaine Gabbert pass). When they show a punt on DirecTV's Redzone Channel, Andrew Siciliano actually apologizes, as if it were an errant f-bomb that made it past their tape delay.
The purpose of this post is to show some statistical love for this less glamorous element of the game. Much has been made of the improvement in field goal accuracy over the years. Do we see a similar improvement in punting? What I found is that punters are improving, having added about 4 net yards to their punts over the past ten years.
Data
For this analysis, I used the play by play data Brian Burke posts on his site, looking at seasons 2002 through 2011. From the fields and the play description, I was able to parse out which plays were punts, as well as the following data fields:
- Field Position (where the team punted from)
- Gross Yards (how far the kick went)
- Net Yards
- Result - Did the play end in a touchback, fair catch, downed by the kicking team, muff, return, or block?
- Penalty Yards (if any) assessed on the punt








