Is the ICC's pitch-rating system fit for purpose?

Why is Brisbane 2022 below average, while Ahmedabad 2021 is not? Here’s why using technology to assess pitches would help weed out many of the shortcomings of the current process

Scott Oliver30-Mar-2023No other sport obsesses quite as much as cricket over the surfaces on which it is played. Pitches are not only a perennial object of fascination but also the subject of controversy. Take the preliminaries for the Border-Gavaskar Trophy series, with the usual dance of pre-emptive suspicion and defensiveness. A bullish Ravi Shastri called for pitches that turned from the outset, and Ian Healy talked up Australia’s chances thus: «I think if they produce fair Indian wickets that are good batting wickets to begin with… we win. If they’re unfair wickets … then I think India play those conditions better than us.»Then the covers came off in Nagpur and it was apparent that the pitch had been selectively watered, mowed and rolled, and that this «differential preparation» — which left bare patches outside the left-handers’ off stump on a spinner’s length at both ends — had ostensibly been tailored to suit the home team, who had one leftie in the top seven to the visitors’ four, and two left-arm spinners to the visitors’ none. Australia’s players maintained a strategic silence, but was this pushing home advantage too far?The match referee, Andy Pycroft, ultimately decided that the pitch was not worthy of sanction, yet questions around pitch preparation were nevertheless again brought into sharp focus. In the age of bilateral series, with World Test Championship points on the line, will pitch-doctoring become an ever greater temptation, as Rahul Dravid observed recently? And, more broadly, what is a «good» or «fair» pitch, and how is it determined?Related

• Why are only spinning wickets classified as poor?

• The pitches in India were great. Won't you agree, Australia?

• India seem to have forgotten how they won in Australia

• What's the big deal with the Nagpur pitch?

• ICC rescinds demerit point for Rawalpindi pitch that hosted Pakistan-England Test

How the ICC’s pitch-rating system works now

The ICC’s Pitch and Outfield Monitoring Process was introduced in 2006 and updated in January 2018 in an effort, they say, to reflect the variety of conditions worldwide and make member boards more accountable for the pitches they produce, as well as to introduce greater transparency in the rating of pitches.One of six potential ratings applies to both pitch and outfield for each game: very good, good, average, below average, poor and unfit, with the bottom three incurring demerit points (1, 3 and 5 respectively for the pitch, 0, 2 and 5 for the outfield). Pick up five demerit points in a rolling five-year period and your ICC ground accreditation is suspended for 12 months. Pick up ten and it is two years without international cricket. Hugely consequential for the local association, perhaps less so for the national board. In situations where a pitch underperforms, match referees must consult umpires and captains before assigning a rating.The Rawalpindi pitch for the England Test in 2022. Below average? Okay. No, wait…•Anjum Naveed/Associated PressA pitch is deemed to be «below average» if there is «either very little carry and/or bounce and/or more than occasional seam movement, or occasional variable (but not excessive or dangerous) bounce and/or occasional variable carry». Fine, but how do you determine this?A pitch is deemed «poor» if it «does not allow an even contest between bat and ball», whether that favours batters or bowlers. The ICC’s guidance goes on to invoke «excessive seam movement», «excessive unevenness of bounce», «excessive assistance to spin bowlers, especially early in the match» and «little or no seam movement or turn at any stage in the match together with no significant bounce or carry» as well as «excessive dryness» and «excessive moistness». Fine, but how exactly do you determine all that?The notes for «clarification» in Appendix A to the ICC’s literature for the ratings tell us that «Excessive means ‘too much'». Sure, but how exactly do you measure that?

Too much is left to interpretation in the pitch-marking process

The truth is that it is rare for pitches to be given any of the bottom three marks. From the men’s World Cup in July 2019 to the end of 2022, only six Test pitches out of 135 (and one outfield) were given a «below average» rating, five of them in 2022.
Two of 2022’s «below average» marks were for Rawalpindi. The first was given by Ranjan Madugalle when Australia’s visit in March produced 14 wickets across the five days for 1187 runs. The second was given by Pycroft after England’s visit last December, although this was subsequently overturned on appeal, which is heard by the chair of the ICC’s Cricket Committee, currently Sourav Ganguly, and the ICC general manager for cricket, currently Wasim Khan, the former CEO of the Pakistan Cricket Board. How did they arrive at this judgement?Ahmedabad 2021: A mini dust storm when the batter plays the ball? No problem, that’ll be an «average» rating•BCCIThe official explanation was that, «having reviewed footage of the Test Match, the ICC appeal panel […] were unanimous in their opinion that, while the guidelines had been followed by the Match Referee […] there were several redeeming features — including the fact that a result was achieved following a compelling game, with 37 out of a possible 39 wickets being taken. As such, the appeal panel concluded that the wicket did not warrant the ‘below average’ rating.»This is a curious logic. Ben Stokes’ team scored at a historically unprecedented rate (921 runs at 6.73 runs per over) to «put time back into the game», thus drastically increasing the chance that wickets would be lost (every 43.2 balls to Pakistan’s 75.6), and they won with just ten minutes’ light remaining on the fifth evening. It is almost certain that England’s strategy was devised after contemplating the Australia Test match in March. Is the ICC saying that such a pitch is adequate provided the Bazball approach is adopted?When approached, in the spirit of transparency, about exactly how much of the match footage was reviewed, the ICC would only refer to the press release.According to the pitch-ratings guidelines, an «average» pitch «lacks carry, and/or bounce and/or occasional seam movement, but [is] consistent in carry and bounce». Fine, but consistency is a property determined by frequency, and adjudicating on this implies one would watch the whole game — that is, have the full data set, as would a match referee — to be able to assess how regularly deliveries misbehaved. Was this done by the appeal panel?What emerges from all this is a sense that the process for marking pitches contains too much «interpretative latitude» in the criteria, and as such, lacks empirical robustness — borne out by how the judgement of a person who watched an entire game (and, presumably, consulted umpires and captains, as per ICC protocol) can be overturned by those who did not. This makes it likely that a match referee who has had a «below average» mark rescinded on appeal will, the next time he finds himself deciding between «average» or «below average», be inclined to play safe, not least because the criteria plausibly allow it. Why put one’s neck out?The Indore pitch from earlier this year on the morning of day two of the Australia Test•Getty ImagesPycroft’s next two Tests after the Rawalpindi appeal verdict was returned in January were the first two of the Border-Gavaskar series. Both the «differentially prepared» Nagpur strip (on which a wicket fell every 47.1 deliveries, albeit with Australia only selecting two frontline spinners, one of whom was a debutant) and the pitch in Delhi (a wicket every 38.8 deliveries, both sides playing three front-line spinners) were marked as «average».The pitch for the third Test, in Indore (a wicket every 38.5 deliveries, same spin-bowling line-ups) was rated «poor» by Chris Broad, initially incurring three demerit points. The strip for the bore draw in Ahmedabad (a somnolent 1970s run rate of 2.9 and a wicket winkled every 115.7 deliveries, 22 in five days on a surface that barely changed) was rated «average», entirely understandable after the Rawalpindi overrule but surely not healthy for Test cricket.The BCCI appealed the Indore decision; Ganguly had to recuse himself from the review process, nominating a proxy, Roger Harper. It mattered little, as the outcome was again the same: Wasim Khan and Harper «reviewed the footage» of the match and despite feeling that «the guidelines had been followed» by Broad, ultimately decided «there was not enough excessive variable bounce to warrant the ‘poor’ rating». Not enough. Okay then.As opaque as all this sounds, it was evidently a good outcome for the BCCI, although one can imagine circumstances in which it may not even have bothered appealing — after all, it is not really the national board that is being sanctioned but the local association, which loses both revenue and prestige. And here is where the scope for abuse lies: Crucial matches with WTC points at stake could, in theory, be assigned to a country’s second-tier grounds, with instructions to produce doctored, advantage-seeking pitches in full knowledge of the risk, or even likelihood, of demerit points, and the venue’s potential loss of ICC accreditation — taking one for the team, as it were — would be duly compensated by the board.

Why not use ball-tracking to refine and add precision to the pitch-rating process?

Ultimately, the subjective, interpretative element, the lack of empirical rigour in the pitch-ratings criteria, does little to help match referees (none of whom are permitted to express an opinion about the system), and in some instances could place them under an onerous degree of «political» pressure. Presumably, then, they would welcome a more objective and data-driven framework for their assessments.The solution, potentially, is staring cricket in the face: not neutral curators but the ball-tracking technology that has been a mandatory part of the infrastructure at all ICC fixtures since the DRS was introduced in November 2009.Essentially, match referees are rating a pitch’s performance properties: pace, bounce, lateral deviation, consistency, deterioration over time. The majority of these are already measured by ball-tracking technology providers for use in their broadcasts. It is not beyond the realms of technological possibility that these properties could be given precisely calibrated parameters, within which pitches must fall to attain the various ratings, beyond which they are considered extreme.How much better would the pitch-ratings system be if its judgements were based on data from Hawk-Eye’s ball-tracking?•International Cricket CouncilThe first step would be a deep dive into those 13-plus years of ball-tracking data (565 Tests and counting), establishing the relationships between the quantified performance properties exhibited by the various pitches and the marks assigned them. Cricketing common sense would suggest that there ought to be a fairly coherent set of correspondences between referees’ verdicts and the data.From there, you start to build the parameters. There would be some complexity here, even if some of the variables ought to be straightforwardly amenable to «parameterisation». In particular: loss of pace after pitching, consistency of pace loss (and its deterioration across the match), bounce, consistency of bounce (and its deterioration). Beyond certain thresholds, pitches would be sanctioned accordingly.Less amenable to parameterisation, and thus more difficult to use to build a regulatory framework, would be lateral deviation, for both seam and spin (even if one would expect the deep dive to yield strong correspondences between pitch ratings and the ball-tracking data for sideways movement). Deviation upon pitching is immediately visible, of course, but the bowler’s skill plays a big part. For spinners, the relevant input variables producing the degree of turn are numerous: the revolutions imparted on the ball by the bowler, the axis of rotation, the pace of the delivery, the angle of incidence with the pitch, and the age of the ball.These variables can overlap and interact in ways that offset each other and potentially resist any one-size-fits-all parameterisation. For instance, a pitch may show «excessive» turn (once this has been defined) but it might be fairly slow turn with relatively uniform bounce. One might, in this instance, use the technology to model a relationship between pace loss and degree of turn for spinners, which would be calibrated against consensus notions of bat-ball balance.For all the complexity around lateral deviation (where do you set the parameters, and how rigidly?), a couple of things need to be said here.First, however difficult it is to create the framework, none of this lies beyond the scope of the existing technology. (Whether for contractual or commercial reasons, Hawk-Eye declined to comment on the viability of using its technology to assess pitch performance.)How green was my valley: the Brisbane pitch for the South Africa Test last year tries hard to blend into the background•Bradley Kanaris/Getty ImagesSecond, the goal is to improve the existing system, not make one that is absolutely prescriptive and infallible. The difficulties in devising an all-encompassing model should not be seen as a weakness but rather a simple recognition of complexity. Seatbelts don’t prevent 100% of road-accident fatalities, but having them is better than not. Thus, while it might be justified to mark down a surface on the basis of a precisely quantified pace loss after pitching, it might not be desirable to do so automatically on the basis of a fixed amount of lateral deviation. Other factors would have to be weighed up — but this would be done, precisely, by using the information provided by the ball-tracking technology.Third, nothing is necessarily going to change. These are heuristic tools that make for a more robustly scientific way of using the criteria that are already in place and the values set out there in relation to the balance of the game. However, by supplementing the qualitative (the ICC’s pitch-ratings criteria descriptions) with the quantitative (ball-tracking data), you would inevitably increase match referees’ confidence in their assessments, particularly in the face of querulous and powerful national boards, and thus boost the public’s confidence in the process as a whole. As such, those 565 Tests would perhaps serve as «legal precedent» of sorts: «Pitch X was marked ‘poor’ because it exhibited an average of n degrees of lateral deviation for seamers’ full-pace deliveries on the first day, similarly to Test Y in city Z.» And these verdicts would be reached independently of how the teams played on the wicket, since the latter involves facets of the game such as intent, strategy and competence that ought to be extraneous to the pitch-rating process.Will developing a technology-backed framework for marking pitches mean pitches become homogenous across the international game, bleeding it of variety? No. The ball-tracking technology would simply establish a set of rigorous performance parameters a pitch would need to reach in order to be classified as «average», «good», «very good», and so on. It then becomes a question of the optimal way of achieving those in any given environment — which would also build knowledge about pitch preparation that could be hugely beneficial to the emerging cricketing nations, where such expertise is thinner on the ground.

A technology-backed pitch-ratings method would reduce cultural tensions

Of course, if sanctions for substandard surfaces impacted national teams (through the docking of WTC points), it would immediately remove the incentive for their boards to «request» egregiously advantage-seeking pitches whenever it became expedient — be that for sporting, political or other reasons.Less conspiratorially, developing a more precise, data-backed framework would increase the confidence of and in referees around what is often a politically charged issue. This might prove analogous to the introduction of neutral umpires (or even the DRS, which potentially obviates the need for match officials needing to be seen to be neutral).And here is arguably the most important, though perhaps least tangible, benefit: The type of cultural tensions that crop up when pitch ratings are discussed — the defensiveness and suspicion, the accusations and denials — would be deprived of most of their oxygen. Sensitivities would be defused. This is not a trifling point in the age of social media, which have proven to be state-of-the-art antagonism machines. As the not-so-old joke has it, in a poll asking whether society had grown more divided, 50% said yes and 50% no.An example of these simmering sensitivities being stirred came with the most recent pitch before Indore to pick up a demerit point: last December’s Brisbane Test between Australia and South Africa, completed inside two days. Close observers were quick to point out the game’s almost identical duration (especially the distribution of overs across the four innings) to the day-night Ahmedabad Test between India and England in February 2021.