APPENDIX 1 CRITERIA FOR CHOOSING HEADLINE INDICATORS
Measures of Australia's Progress (MAP) is designed for the Australian public, and the summaries are meant to be easily understood by readers who may not be expert in either the subject matter or statistical methods. In many cases, our choice of indicator has had to strike a balance between considerations of approachability, technical precision, and the availability and quality of data.
The headline indicators in MAP are concerned with assessing dimensions of Australia's progress, not with explaining the underlying causes of change.
In the view of the ABS, ideally a good headline indicator should:
- be relevant to the particular dimension of progress
- where possible, focus on outcomes for the dimension of progress (rather than on say, the inputs or processes used to produce outcomes)
- show a 'good' direction of movement (signalling progress) and 'bad' direction (signalling regress) - at least when the indicator is considered alone, with all other dimensions of progress kept equal
- be supported by timely data of good quality
- be available as a time series
- be available at a national level
- be sensitive to changes in the underlying phenomena captured by the dimension of progress
- be summary in nature
- preferably be capable of disaggregation by, say, geography or population group
- be intelligible and easily interpreted by the general reader.
For some dimensions, it is not yet possible to compile an ideal indicator meeting all these criteria. So an example of a relevant indicator, which sheds light on one aspect of the dimension of progress, has been presented.
PROCESS OF DEVELOPING HEADLINE INDICATORS
When deciding which indicators should be used to encapsulate each aspect of Australian life, the ABS was guided by expert advice as well as the criteria listed above. During the development of MAP, the ABS undertook wide-ranging consultation with experts and the general community of users. This consultation considered the indicators that would be ideal for each aspect of Australian life, and the best currently available approximations to those ideal indicators. For some aspects - health, crime, income, productivity and air quality, for example - there was already some broad consensus regarding indicators that would meet MAP's criteria. But for other aspects - social cohesion, democracy and governance and biodiversity, for example - the effort to develop statistical indicators is more recent, and stakeholder agreement has not yet been reached. For the newer or less settled aspects, MAP generally provides an array of indicators and invites readers to form a view about progress.
Our first step was to take each dimension of progress in turn, and to ask ‘Why is this dimension particularly important to Australia's progress? What are the key facets of progress in that dimension that any headline indicator should seek to express?’
There were usually several competing indicators that might be included. In choosing among them, each of the criteria were considered, as illustrated below.
Indicators should focus on the outcome rather than, say, the inputs or other influences that generated the outcome, or the government and other social responses to the outcome. For example, an outcome indicator in the health dimension should if possible reflect people's actual health status and not, say, their dietary or smoking habits, or public and private expenditure on health treatment and education. Input and response variables are of course important to understanding why health outcomes change, but the outcome itself should be examined when assessing progress.
It was also judged important that movements in any indicator could be positively or negatively associated with progress by most Australians. For instance, the number of divorces could be considered as an indicator for family life. But an increase in that number is ambiguous - it might reflect, say, a greater prevalence of unhappy marriages, or greater acceptance of dissolving unhappy marriages.
Applying this criterion depends crucially on interpreting movements in one indicator, assuming that the other indicators of progress are unchanged. For example, some would argue that economic growth has, at times, brought environmental problems in its wake, or even that the problems were so severe that the growth was undesirable. Others would argue that strong environmental protection might be retrograde to overall progress because it hampers economic growth. However, few would argue against economic growth or strong environmental protection if every other measure of progress was unaffected: that is, if economic growth could be achieved without environmental harm, or if environmental protection could be achieved without impeding economic growth. Of course, although keeping other things equal might be possible in theory, it seldom, if ever, occurs. The links between indicators are important, and Measures of Australia's Progress 2006 (cat. no. 1370.0) discusses some of these links after trends in the individual indicators have been described.
Print Page
Print All