Dr Bill Gerrard, Former Tactical Data Analyst at Saracens and Professor of Business and Sports Analytics, Leeds University Business School
With the dust now settling despite the early exit of the host nation, the Rugby World Cup 2015 has been widely acclaimed as an exciting tournament that enthralled fans around the world, producing an array of memorable moments; none more so than Japan’s thrilling last-gasp win over South Africa. It was a tournament in which the Southern Hemisphere exerted its dominance by taking all four semi-final places and the Webb Ellis Trophy was ultimately lifted by New Zealand to claims that this All Blacks team is arguably the best ever.
So what did we learn from the 2015 Rugby World Cup – specifically from the All Blacks – about what makes for effective, tournament-winning rugby?
Statistically the main lesson of the 2015 Rugby World Cup was the triumph of what we could call ‘pragmatic’ rugby. Winning required an all-round game with excellence in all aspects of play and the All Blacks were the strongest all-round team in the tournament and, crucially, produced excellence when required under pressure as we saw in the arm-wrestle with South Africa in the semi-finals and then responding in style to the second half comeback by Australia in the final.
When it comes to analysing rugby union, team performance can be broken down into six aspects: set piece, exit play (i.e. own-half possession), the kicking game, defence, attack and discipline. There has been, and always will be, differences in opinion over the most effective tactics. As I have discussed in a previous guest blog, rugby has its own version of the artist-versus-artisan debate in discussing the relative merits of the kicking game and the running game and there is some evidence to support the efficacy of the kicking game in the Aviva Premiership in recent seasons.
What is notable about the 2015 Rugby World Cup is that no single style of play predominated as a winning tactic. Defence did not predominate over attack; kicking did not predominate over running the ball. The more successful teams, particularly the All Blacks, excelled across all six aspects of the game.
Table 1 (see below) displays the results of analysing all 48 games in the tournament and comparing winning and losing performances. Using a t-test with a 10% significance level as indicative of strong evidence of a systematic (i.e. non-random) difference in performance, 20 key performance indicators (KPIs) can be identified with 18 of these KPIs showing a significant difference between winning and losing performances (colour coded yellow). These KPIs span all six aspects of the game. Winning teams were strong in the set piece, conceded fewer turnovers in their own half, kicked more, defended effectively missing few tackles, passed and carried the ball more, making more clean breaks, rucked and mauled successfully, and conceded fewer penalties especially in their own half.
Importantly, pragmatic rugby is not about kicking more, and passing and carrying less. Winning teams averaged 27.8 kicks from hand per game compared to a game average of only 24.7 kicks from hand by losing teams. And winning teams gained more metres from kicking, averaging 445.7 metres gained from kicking compared to losing teams who averaged only 402.4 metres gained from kicking. But winning teams also passed more than losing teams, averaging 153.4 passes per game compared to an average of only 127.7 passes by losing teams. And winning teams made more carries beyond the gainline and carried for more metres. Winning teams gained 488.3 metres per game from carrying compared to only 342.1 metres gained by losing teams.
Table 1 also includes the game averages for the 20 KPIs for the All Blacks and their ranking relative to all other teams with first representing best-in-class (e.g. highest points scored, least points conceded, and so on). A top-five ranking is colour-coded green while a middle ranking (6th – 15th) is colour coded amber and a bottom-five ranking is colour coded red.
Table 1: Key Performance Indicators, Rugby World Cup 2015
Key Performance Indicator
|
Game Average | New Zealand | ||
Wins | Loses | Game
Average |
Ranking | |
Set Piece | ||||
Lineout Success | 92% | 82.74% | 95.5% | 2nd |
Scrum Success | 90.71% | 86.43% | 97.14% | 6th |
Exit Play | ||||
Turnovers Conceded. Own Half | 5.21 | 7.19 | 4.571 | 2nd |
Kicking Game | ||||
Kicks From Hand | 27.79 | 24.69 | 27.57 | 6th |
Kicking, Metres Gained | 445.67 | 402.42 | 412.43 | 12th |
Defence | ||||
Poins conceded | 14.19 | 36.63 | 13.86 | 1st |
Tackles Success | 87.75 | 82.55% | 89.66% | 1st |
Tunovers Won | 7.6 | 6.813 | 7.71 | 6th |
Attack | ||||
Points Scored | 36.63 | 14.19 | 41.43 | 1st |
Carries Beyond Gainline | 51.96 | 40.52 | 54 | 6th |
Carries, Metres Gained | 488.25 | 342.1 | 568.14 | 2nd |
Passes | 153.42 | 127.71 | 181 | 3rd |
Defenders Beaten | 25.29 | 16.23 | 25.29 | 3rd |
Clean Breaks | 8.56 | 4.33 | 11.43 | 1st |
Ruck Success | 95.45% | 94.04% | 95.3% | 9th |
Maul Success | 85.46% | 72.14% | 86.67% | 7th |
Mauls, Metres Gained | 24.36 | 8.67 | 14.57 | 12th |
Discipline | ||||
Penalties Conceded, All | 9.92 | 11.67 | 9.14 | 2nd |
Penalties Conceded, Own Half | 5.34 | 7.44 | 5.14 | 5th |
Yellow Cards | 0.4 | 0.69 | 0.71 | 6th = |
The All Blacks were best in class for points scored, clean breaks, points conceded and tackle success. Although their ball-in-hand game ranked very highly, the All Blacks also used the kicking game with an average of 27.6 kicks from hand per game, the 6th highest across all teams.
The full overall rankings for all teams are reported in Table 2 (see below). The total score is defined as the sum of the ranks for all 20 KPIs. These total scores are then ranked with the team having the lowest total score ranked best overall.
Table 2: Overall Teams Rankings, Rugby World Cup 2015
Rugby World Cup 2015 Rankings | All Games | Games Betweeen Top 12 Teams Only | ||
Total Score | Ranking | Total Score | Ranking | |
Argentina | 182 | 7 | 127 | 6 |
Australia | 184 | 8 | 118 | 4 |
Canada | 256 | 17 | ||
England | 143 | 4 | 140 | 10 |
Fiji | 218 | 12 | ||
France | 186 | 9 | 120 | 5 |
Georgia | 236 | 13 | 172 | 12 |
Ireland | 97 | 1 | 82 | 3 |
Italy | 239 | 14 | 164 | 11 |
Japan | 172 | 6 | 130 | 7 |
Namibia | 340 | 19 | ||
New Zealand | 100 | 3 | 62 | 1 |
Romania | 254 | 15= | ||
Samoa | 254 | 15= | ||
Scotland | 213 | 10 | 134 | 9 |
South Africa | 98 | 2 | 76 | 2 |
Tonga | 215 | 11 | ||
Uruguay | 344 | 20 | ||
USA | 275 | 18 | ||
Wales | 153 | 5 | 131 | 8 |
When all teams and all games are included, the All Blacks rank only third overall behind Ireland and South Africa. Surprisingly England, despite their early exit, rank fourth overall ahead of both Wales and Australia. But, of course, the problem with rankings based on all games is that they include the games against the weaker teams which can skew the results massively. A more informative comparison is provided by only including the games between the ‘top 12’ teams defined as those teams finishing third or better in the group stages.
When the rankings are based only on these 20 games the All Blacks emerge as the strongest team with South Africa as their closest rivals. The only Northern Hemisphere team to figure in the top four is Ireland, reinforcing the disappointment of all Irish rugby fans that this should have been the year they finally got the monkey off their back of never winning a knock-out game in the Rugby World Cup.
Based on their performances against Wales and Australia, England rank 10th out of 12 with only Italy and Georgia below them. Perhaps fittingly the last word goes to the team who won many admirers with their entertaining, never-say-die style of play and will host the 2019 Rugby World Cup, Japan, who on the basis of their performances against South Africa and Scotland ranked 6th out of 12. On the basis of the 2015 Rugby World Cup, the Land of the Rising Sun is a rising power in the world of rugby.