|Page tools: Print Page Print All|
If the value of this test statistic is greater than 1.96 then there is good evidence of a statistically significant difference between the two population estimates with respect to that characteristic. Otherwise, it cannot be stated with confidence that there is a real difference between the population estimates.
The ABS advises care in the interpretation of the results of significance testing, particularly for fine level aggregate comparisons. It should be first noted that significance testing only provides information on the probability of a specific event (eg. the difference between two means) occurring randomly when the null hypothesis is true. It does not test if the null hypothesis is actually true. Indeed, it should be expected that there will always be some level of difference between any two subpopulation sample estimates because of demographic and socio-economic heterogeneity in the samples. Hence if 100 fine level aggregate statistical significance tests are conducted (eg. at state by SEIFA decile level) using a significance level of (1-alpha=5%) then 5% of the tests are expected by chance to show statistically significant differences. The interpretation of such analyses should not be arbitrarily conclusive, (ie. that there is a definite difference) but consider the calculated p-value or z-score, the confidence interval of the estimates and the heterogeneity of Australian population characteristics at CD by SEIFA decile level to draw a balanced judgement on the likely level of evidence (weak, good, very good etc) for a real difference in two subpopulations versus the possibility of false positive findings.
For more information, see ABS Research Paper: Socio-Economic Indexes for Individuals and Families (Methodology Advisory Committee), Jun 2007 (cat. no. 1352.0.55.086)
These documents will be presented in a new window.