Showing posts with label Misses. Show all posts
Showing posts with label Misses. Show all posts

Wednesday, August 03, 2011

Defining The Scoring Chance

The 6-Minute Abs?

By now, a hockey fan, you've heard plenty about advanced stats and the rise of the scoring chance.

When I was a much more naive stats geek, I used to make a lot of assumptions about what I was hearing and extrapolate that information to make my own (ultimately flawed) interpretations. I can tell you that when I first found out the working definition of scoring chance being used by the squadron of scoring chance trackers around the league, I was more than a little bit surprised.

I want to show you all some work I've been doing with scoring chances over the last couple of seasons. So as a service to those who are starting from where I was just a little while ago, I thought I'd clear up the assumptions before we start.

How better to do that than to ask the Patriarch of Habs Scoring Chances, Olivier of En Attendant les Nordiques, the question:

"Just what is a scoring chance anyway?"

I asked him more questions than that, and he kindly answered them all. But by the end of this, we should, agree or disagree about the methodology, at least be on the same page about the stat in question.

Without further ado:

What is a scoring chance?

My definition: a scoring chance is a shot on goal or a missed shot unleashed from the "home plate" area. The home plate area goes from goalposts, up to the face-off dots, then up toward the blue line to the top of the face-off circles.
(image taken from Copper and Blue, 2010)


So every shot is not a scoring chance?

No, when the shot is taken from outside the zone and doesn't result in a goal, it isn't a scoring chance.


And some non-shots are scoring chances?

That's right. Both missed shots and shots on goal from inside the home plate area are accounted for because I see them as successful attempts to challenge the opposition's goaltender. A blocked shot is not, in my opinion, a scoring chance because a defender actually thwarted the challenge.

I should say here that I give myself some leeway; if a guy floats a feeble backhander from the top of the plate and the goaltender easily follows it, I don't give a chance. A hard shot from the limit of the zone will be counted as a chance.



You say a shot can also be a scoring chance if it results in a goal?

A goal scored from outside that zone is counted as a scoring chance *if* it's an actual attempt to challenge the goaltender. So, Gill floating a wrister from the blue line is a scoring chance. Other guys recording scoring chances have some variations to their definitions: some count screened shots from the blue line, some never allow a chance from a shot from outside the home plate even if it's a goal.


So not every goal is the result of scoring chance then?

Not in my record of chances, no. Best example is a goal scored by Jeff Halpern early in the 10-11 season: he was behind the net and attempted a pass in front, only to see the puck deflect on a defender's skate into the net.

But that doesn't mean being behind the goal rules out a chance. I've also given a chance on a Moen Goal where he was behind the goal line and clearly shot it on the goaltender's leg to bounce it into the net.

Basically, to be a chance, there has to be an attempt at challenging the net.



So we are left with:

1) A shot released from inside the home plate or a goal, that
2) "Challenges the net"

is a scoring chance.




This is probably at odds with what a lot of people think at this point. It was definitely at odds with what I thought before knowing the definition being used by trackers myself. I used to think of a scoring chance as a shot that "challenged the net" basically from anywhere. I think I was also quite surprised to find out that missed shots were scored in the same way that shots on net were.

To me there still exists a massive undescribed hierarchy of scoring chances within the scoring chances that are being tracked around the league. Call them good scoring chances, great scoring chances, quality scoring chances, whatever you like. I think many like me are left thinking on the inherent difference between miss from inside the home plate and save on a breakaway or two on one.

I brought it up with Olivier and he was unfazed.


But with this definition all scoring chances are equal. Are all scoring chances equal?

As far as scoring chances are concerned, quantity *is* quality. A scoring chance is a shot attempt from a zone that leaves almost no reaction time for the goaltender. Whatever difference in quality one can find between scoring chances is, I think, drowned by the fact that you actually *got* a scoring chances.

Let me put it this way: over a normal game, I record around 35 scoring chances. Of those, maybe 25 are at even strength. One team getting 15 ES scoring chances in a game is huge, below 10 is feeble. So, is this scoring chance better or worse than that scoring chance? I think the important point is that scoring chances are very dangerous events, 15% of which ending in goals while maybe 4% of Shots+Missed shots are converted in goals.



Why not at least track whether the shot was on net or off net? That could be an interesting aspect of quality to look at down the road.

That might actually be doable trough a script. But I don't think it would tell us about the "quality" of the scoring chance.

What is more dangerous: a 20 foot wrister that Cammalleri sends 6 inches over the cross bar, or a 20 foot wrister Moen buries into the goalies crest?

Missed or not, the guy tried to bury it by unleashing a shot from a given spot. When you talk about "quality", it seems to me you see that said quality comes from the spot the shot was unleashed from, not what the shot looked like going toward the net. That's an important point.



I think there'd be disagreement about this from observers of the game. Just as the scoring chance people have broken away from simply using shots. In "Something About Mary" the hitchiker has just thought of 6-minute abs as a revolutionary idea to replace 7-minute abs. Ben Stiller's character asks what will happen when someone invents 5-minute abs.

So what if scoring chances as they are now is the 6-minute abs? What if someone comes along and ranks shots from the zone where people score most often calling them really good scoring chances?


Are Scoring Chances the 6-minute abs? Yes they are, I am absolutely certain of that.

I record scoring chances for three main reasons, and I list them in order of importance to me: 1) I enjoy doing this 2) bunched together in a multi-game data stream, they give a better idea of who's driving the bus 3) If I take said data, make cool table out of them and write my toughest about them on a blog, people come around and we end up having very enjoyable discussions about stuff I enjoy.

Can someone come up with a better ranking of where shots are coming from? Yes, probably. I have an iPad and am fairly convinced that I could, should I beat myself into building the right tool, use it as a too for recording scoring chances in a more interesting fashion. Somebody, somewhere, will eventually hammer out such a thing and we'll end up with richer data. The question is, where will this data come from?

The NHL is putting charts up on the game centers pages of each game where you have a goaltender's save% on shots from different spots in the defensive zone. The 5 minute abs may very well be just around the corner.



Anyway, agree or disagree about the detail of the statistic, they are still useful to fans looking for more, right? On their use, is a scoring chance a team or an individual statistic?

Both. Scoring chances are useful because they are a "purer" from of shot-based metric. That is, they give you a more precise understanding of who was more challenging to the opposition. Even tough they are a team metric, they are more useful as an individual measure. They give a more reliable understanding of who is generating offense, even over a short span of time (that is from 10 games to a full season) and help weed out the luck factor.

I see two levels of individual statistics: individual achievements (Andrei Kostitsyn had a shot from between the dots, accounting for a scoring chance) and on-ice events (AKost, Cammalleri, Pleks, Gill and Subban were on the ice for a scoring chance). From my perspective, scoring chances as on-ice events is where they are more revealing about a given player.

As I wrote earlier this summer, Scott Gomez was terribly unlucky this past season: he was on the ice for the same amount of time at even strength as in 09-10 (about 1190 minutes) and the team had about the same amount of scoring chances while he was on the ice, about 370. Yet, the team scored 20 goals less in 10-11 (35 to 55) and Gomez ended up with 20 ESPoints instead of 40 (his career norm up until then). That is bad luck, pure and simple. I think scoring chances tells you who's actually driving the offense, luck be damned. Obviously, wingers will get more individual scoring chances than centers, who will get more than defensemen, but that's a structural reality.



How do you think scoring chances will be used in future stats analysis (by fans)?

It's all about the data made available. You look at advanced stats analysis done by fans and they mostly use behindthenet.ca and timeonice.com's outputs as building blocks. The managers of those two sites are, by the way, to be recognized as the enablers of the whole scoring chance projects you see left and right. Desjardins, of BehindThenet, used his site as a hub of analysis of data collected by Chances Recorders and timonice is the site that gives public access to a script that allows anybody to punch in time codes and notes and get a nice set of HTML tables of scoring chances data. Without these guys, there is no "Scoring Chances" as we see them being batted around in the hockey blogosphere nowadays. Making multiple years of scoring chances data on multiple teams available to fans is what will allow them to take these data stores and cross reference them with other sources such as Behindthenet.ca and timeonice.com and come up with some new analysis.

On what? Off the top of my head: defining shot quality, quality of competition faced by goaltenders (who, of Halak and Price, saw the highest rate of scoring chances against in 09-10? If I'm not mistaken, Halak), luck-independent offensive and defensive output. Stuff like that, y'know.



When are fans on the laggard teams gonna get on this? Any word, because with the small sample now, it might as well be the Habs alone

The problem is, we aren't pooling the data already being collected so it's hard to tell who's on board. Of the 2010-11 season, I'm fairly certain the Habs, Leafs, Caps, Flames, Rangers, Flyers were recorded. I think some work was done with Chicago.

The next step would be some form of aggregation of data; seeing the data store would probably be an incentive for fans of uncharted teams to do the legwork.



The NHL teams record scoring chances, do you ever foresee these stats being available to fans?

No. Actually, I think NHL teams data stores are way more granular than anything we ever see out in the open (touches? Zone time?) and I think the NHL's data stores are way more refined than what we see on their website. But team's data stores are an asset that they manage so to give them a competitive advantage. They will *never* publish current data. The data published by the NHL is, if I'm not mistaken, the only data eligible for salary arbitration process. So whatever data we currently have from the big guys, it will all stay the same unless the new CBA states so or, maybe, if the NHL comes up with something akin to MLB's Pitch F/X. I'm not holding my breath.

What would be insanely cool is if some historian/researcher could convince old franchises such as the Habs, Rangers or Wings, to open up whatever archives they have so to give us a glimpse of how they approached stats in, say, the 40's, 50's or 60's.



Thanks again of course to Olivier for answering all of my basic questions so fully and clearly (even under challenges).

In our unending search for the 5-minute abs, and new and more interesting ways of crunching data in 6 minutes, we'll share some scoring chance extrapolations with you in the upcoming while.

At least now we can all start on the same page.

Thursday, January 07, 2010

Canadiens Shots Allowed

Flawed Implementation Or Implementing Flawed Approach

If you're like me, I think you thought that the addition of Jacques Martin to the fold would be a boon for the goalies, and perhaps ultimately the fans, as the haphazard defensive manner to which we were accustomed would be banished and replaced with simple play and reduced shots.

Now that we've given the system until the New Year (like we said we would), I think it's time to air a grievance: this isn't at all how I thought this would work.


Currently, the Canadiens sit in 11th position for GAA in the league. Not bad, but consider where they'd be without two 0.920 save percentage goalies, as they are also 28th in the NHL in shots allowed per contest. Their total currently stands at 32.8 SA/G (which may sound like a miraculously low total considering the recent onslaughts).

Certainly some of the onus for this high shot total must fall at the feet of the penalty takers (or victims of Chris Lee, if you prefer), since the Habs have given up the most PPs in the league (193). However, that might slightly gloss over the fact that their ES play is actually the bigger contributor to their SA totals. in fact, the Habs are one of the elite teams at preventing shots on the PK (analyse that...), but would allow a massive 31.5 shots per contest if they were penalty free.

Given that Jacques Martin is supposedly in charge of organizing and plotting team strategy for the 5-on-5, I was wondering what on earth was going on. If we don't have possession stats, we certainly have eyes – and those tell me that the Habs trend (espcially lately has been to sit and wait for shots and chances to come). Perhaps the comfort of two good goalies prevents fretting over the defensive pitfalls of this approach, but a look at ES scoring shows that a little more possession for the good guys might help to pad a few leads, win a few more close games.


Chances for and against

As I said, we don't have possession stats per se, but we do have some proxies. One of the better proxies at even strength is the CORSI numbers. However, as you know, though i like the number, I find it often oversimplifies matters. After all, there are several ways to get a good CORSI number: play bad defensively but take a lot of shots (misses and blocked shots count for you), play really well defensively and take shots, play unbelievable defence and take barely more than average shots. In light of that, I like to present the whole story (i.e., chances for and against), and relate those to what the league is doing. I present the status quo for the Habs below, with shots for (SF), chances for (ChF), shots against (SA), chances against (CA), and the differences between offense and defence:

NAME
GP
SFON/60
ChF/60
SAON/60
ChA/60
Sh Diff
Ch Diff
Andrei Kostitsyn
40
24.3
49.8
27
53.8
-2.7
-4
Andrei Markov
9
30.4
56.2
42.5
70.6
-12.1
-14.4
Benoit Pouliot
19
32.3
57.1
28.3
55.7
4
1.4
Brian Gionta
23
29.9
61.9
30.2
57.6
-0.3
4.3
Geln Metropolit
38
24.8
50
26.5
58.6
-1.7
-8.6
Georges Laraque
23
15
32.3
28.6
68.5
-13.6
-36.2
Hal Gill
30
20.9
45.6
28.5
57.1
-7.6
-11.5
Jaroslav Spacek
42
26.3
54.1
29.5
59.5
-3.2
-5.4
Josh Gorges
44
21.8
44.6
26.7
56.6
-4.9
-12
Marc-Andre Bergeron
37
24.5
53
27.8
56.2
-3.3
-3.2
Matt D'Agostini
29
20.4
48.1
27.9
55.4
-7.5
-7.3
Max Pacioretty
43
25.7
52.7
28.3
56.1
-2.6
-3.4
Maxim Lapierre
44
18.4
44.5
30.5
61.5
-12.1
-17
Michael Cammalleri
44
25
54.2
28.9
57.8
-3.9
-3.6
Paul Mara
34
22.3
49
30.7
59.4
-8.4
-10.4
Roman Hamrlik
37
25.1
52.4
26.4
55.8
-1.3
-3.4
Ryan O'Byrne
24
20
43.7
31.3
59.4
-11.3
-15.7
Ryan White
13
14.4
37.1
31.1
62.6
-16.7
-25.5
Scott Gomez
40
28.5
56.7
30.1
56.3
-1.6
0.4
Sergei Kostitsyn
19
21.8
44.2
31.2
59
-9.4
-14.8
Tom Pyatt
19
19.2
40
31
63
-11.8
-23
Tomas Plekanec
44
23.1
47.6
28.6
58.2
-5.5
-10.6
Travis Moen
44
24
46.5
28.8
57
-4.8
-10.5

Legend
Top 10% NHL
11-20% NHL
21-40% NHL
Average NHL
61-80% NHL
81-90% NHL
Bottom 10% NHL

As you can see, chances for with the Habs is a mixed bag. Gionta, Gomez, Pouliot and Markov generate top tier chances, while the offensive laggards (Laraque and co.), well, lag. I'm sure there's lots to be mined from the numbers and the relationships between them, but not today.

Chances against are more homgenous. They are all blue. It is systematic. This, for me, is most interesting. Once again, the bad players are bad. However, even the players we heap praise on for defensive awareness are allowing above average number of shots to be released from opponents' sticks.

Leaving the offensive stats behind, I delved deeper into the defensive numbers to try and figure out what is happening. I present the numbers for you to consider below for shots against (SA), missed shots against (MA), blocked shots (BF), chances against (ChA) and percentage of shots against making the net (SA%):

NAME
GP
SAON/60
MAON/60
BFON/60
ChA/60
SA%
Andrei Kostitsyn
40
27
11.4
15.4
53.8
50.2%
Andrei Markov
9
42.5
13.7
14.4
70.6
60.2%
Benoit Pouliot
19
28.3
13.7
13.7
55.7
50.8%
Brian Gionta
23
30.2
13.2
14.2
57.6
52.4%
Geln Metropolit
38
26.5
13.9
18.2
58.6
45.2%
Georges Laraque
23
28.6
18.6
21.3
68.5
41.8%
Hal Gill
30
28.5
13.4
15.2
57.1
49.9%
Jaroslav Spacek
42
29.5
12.2
17.8
59.5
49.6%
Josh Gorges
44
26.7
12.9
17
56.6
47.2%
Marc-Andre Bergeron
37
27.8
11.7
16.7
56.2
49.5%
Matt D'Agostini
29
27.9
9
18.5
55.4
50.4%
Max Pacioretty
43
28.3
10.7
17.1
56.1
50.4%
Maxim Lapierre
44
30.5
12.4
18.6
61.5
49.6%
Michael Cammalleri
44
28.9
12.6
16.3
57.8
50.0%
Paul Mara
34
30.7
12.3
16.4
59.4
51.7%
Roman Hamrlik
37
26.4
12.2
17.2
55.8
47.3%
Ryan O'Byrne
24
31.3
10.6
17.5
59.4
52.7%
Ryan White
13
31.1
12.7
18.8
62.6
49.7%
Scott Gomez
40
30.1
12.1
14.1
56.3
53.5%
Sergei Kostitsyn
19
31.2
11
16.8
59
52.9%
Tom Pyatt
19
31
13.1
18.9
63
49.2%
Tomas Plekanec
44
28.6
12.4
17.2
58.2
49.1%
Travis Moen
44
28.8
11.9
16.3
57
50.5%

Legend
Top 10% NHL
11-20% NHL
21-40% NHL
Average NHL
61-80% NHL
81-90% NHL
Bottom 10% NHL

This table is most interesting for those who want to get to the bottom of the Jacques martin system, I think. Column by column, it's pretty consistently league average or below, or league average and above.

The breakdown of chances across the whole team seems to be summed up by lots of shots attempted against, an enormous amount blocked, many opponents forced to shoot wide, but still more than average shots getting to the net.

Shots against (as we noted earlier) is troubling, even if it doesn't result in goals 92% of the time. Most Habs are belowe the league average in preventing shots on their goal.

Blocked shots is an interesting category. It must be the only statistic in the league where the Canadiens could look like such a star outfit. No less than 12 Habs fall into the top 10% of the league in blocked shots at ES while they're on the ice. The rest are above average (only Pouliot, with his Wild numbers incorporated, spoils the whitewash). Missed shots is similar, if not quite as dominant, almost all Habs being above the league average.

Add up below average shot prevention, more than average missed shots and more than average blocked shots and you get the blue mess that follows in chances against. The numbers in that column are sub-optimal by most standards and some are downright abysmal (see >60 ChA/60).

It seems to me (and maybe to you as well, dear readers) that this is a bit of a red flag for the passive approach to defence that is currently being employed by Martin and his boys. While the defensive clogging of the slot is surely leading to some impressive blocked and missed shot totals, it seem to me that the Canadiens aren't perhaps negotiating the next part of the strategy very well at all – which should be making the shot a turnover by recovering the puck.


System performers

So, we've got to the bottom of the system (at least the one used so far). Allow the shot from the outside – block it or force the player to shoot wide – then recover the puck and start an attack. As a system it's not stupid, the team that seems to use it best this season is Pittsburgh who translate above average chances against into below average shots against. However, it must also be said that most teams we think of as defensive outfits don't trust this way of defending. New Jersey, Boston, Detroit, these teams all reduce chances overall and limit the number of shots that have to be blocked or forced wide.

In addition to the Penguins, there are players on the Habs who seem to get this system and can play it with some success. To me, these are the players that have warmer shades in the SA column and top rankings in the missed and blocked columns. The standouts seem to be Glen Metropoilt, Josh Gorges and Roman Hamrlik. All three players (and observation I think would back this up) play their position well and are good at jumping to retrieve the loose stuff after the initial chance.


System failures

Troublingly, the successes are outnumbered by the strugglers. Ignore Markov for now (he's had offense on the mind in his return), but do cast an eye to O'Byrne, Lapierre and Mara. These three players all allow 59 chances an hour or more. They are all on the ice for plenty of blocked shots and missed shots, but the sheer number of reloads they are allowing means they are also on the ice for a shot every 2 minutes or less.

Add to these players, Spacek, Gill, Gomez, Sergei Kostitsyn and even Gionta and we're in trouble.


When to change?

45 games into a season and many players appear on paper (and on TV) to be having significant trouble with a system that demands passivity, patience and then quickness to make it work properly. It begs the question, should Martin persist with this system.

If not, how late is too late to change? After all, it seems to be unravelling more than it is coming together at this point in the season. What's more, i think we've al seen enough proof that it doesn't work as well against good teams as it seems to against the Islanders.

If I were the coach, I'd be having a little think about all this.

I'd like to know what all of you think...