4159.0.55.002 - General Social Survey: User Guide, Australia, 2010  
ARCHIVED ISSUE Released at 11:30 AM (CANBERRA TIME) 07/12/2011   
   Page tools: Print Print Page Print all pages in this productPrint All  
Contents >> Data quality >> Interpretation of Results

INTERPRETATION OF RESULTS

Care has been taken to ensure that the results of this survey are as accurate as possible. All interviews were conducted by trained ABS officers. Extensive reference material was developed for use in the field enumeration and intensive training was provided to interviewers in both classroom and on-the-job environments. However, there remain other factors which may have affected the reliability of results, and for which no specific adjustments can be made.

The following factors should be considered when interpreting estimates for the 2010 GSS:

  • information recorded in this survey is essentially 'as reported' by respondents, and hence may differ from information available from other sources or collected using different methodologies. Responses may be affected by imperfect recall or individual interpretation of survey questions.
  • some respondents may have provided responses that they felt were expected, rather than those that accurately reflected their own situation. Every effort has been made to minimise such bias through the development and use of culturally appropriate survey methodology.

For a number of GSS data items, some respondents were unwilling or unable to provide the required information. No imputation was undertaken for this missing information. Where responses for a particular data item were missing for a person or household they were recorded in a 'not known' or 'not stated' category for that data item. These 'not known' or 'not stated' categories are not shown in the publication tables. However, the person or household has been included in the total for most data items. The exception is the equalised gross household income data item where it was more appropriate to calculate percentages excluding the missing values. Below is a table showing the number and proportion of missing values for key GSS data items.

KEY GSS DATA ITEMS WITH A 'NOT KNOWN OR NOT STATED' CATEGORY

Estimated number of persons
Percentage
Data Item
('000)
(%)

Landlord type
12
0.1
Weekly mortgage payments
689
4.1
Weekly rent payments
125
0.7
Personal gross weekly income
1 887
11.2
Equivalised household gross weekly income
3 091
18.4
Principal source of personal income
273
1.6
Principal source of household income(a)
224
1.3
Whether government support has been main source of income in last 2 years
5
(b)0.0
Time spent on government support as main source of income in last 2 years
89
0.5
Type(s) of cash flow problem(s) (and Number of different types of cash flow problems in last 12 months)
485
2.9
Types of dissaving actions taken in last 12 months (and Number of different types of dissaving actions taken in last 12 months)
436
2.6
Value of dwelling
528
3.1
Equity in dwelling
1 108
6.6
Type(s) of selected assets
440
2.6
Type of consumer debt
359
2.1
Type(s) of personal stressors experienced in last 12 months
2
(b)0.0

(a) For persons or households reporting nil or negative total income, the principal source of income has been classified as 'undefined'. An estimated 488,000 people (3%) live in households where the principal source of income was 'undefined'
(b) nil or rounded to zero (including null cells)



Comparison of estimates

Published estimates may also be used to calculate the difference between two survey estimates. Such an estimate is subject to sampling error. The sampling error of the difference between two estimates depends on their SEs and the relationship (correlation) between them. An approximate SE of the difference between two estimates (x-y) may be calculated by the following formula:

Equation: sexy

While the above formula will be exact only for differences between separate and uncorrelated (unrelated) characteristics of sub-populations, it is expected that it will provide a reasonable approximation for all differences likely to be of interest in this publication.


Significance testing

For comparing estimates between surveys or between populations within a survey it is useful to determine whether apparent differences are 'real' differences between the corresponding population characteristics or simply the product of differences between the survey samples. One way to examine this is to determine whether the difference between the estimates is statistically significant. This is done by calculating the standard error of the difference between two estimates (x and y) and using that to calculate the test statistic using the following formula:

Equation: Significance testing

If the value of the test statistic is greater than 1.96 then we may say there is good evidence of a statistically significant difference between the two populations with respect to that characteristic. Otherwise, it cannot be stated with confidence that there is a real difference between the populations.

The imprecision due to sampling variability, which is measured by the SE, should not be confused with inaccuracies that may occur because of imperfections in reporting by respondents and recording by interviewers, and errors made in coding and processing data. Inaccuracies of this kind are referred to as non-sampling error, and they occur in any enumeration, whether it be a full count or sample. Every effort is made to reduce non-sampling error to a minimum by careful design of questionnaires, intensive training and supervision of interviewers, and efficient operating procedures.


Calculating standard errors for proportions and percentages

Proportions and percentages formed from the ratio of two estimates are also subject to sampling errors. The size of the error depends on the accuracy of both the numerator and the denominator. For proportions where the denominator is an estimate of the number of persons in a group and the numerator is the number of persons in a sub-group of the denominator group, the formula to approximate the RSE is given by:

Equation: RSE equation


Seasonal effects

The estimates from the 2010 GSS are based on information collected from August to November 2010, and due to seasonal effects they may not be fully representative of other time periods in the year. For example, the GSS asked standard ABS questions on labour force status to determine whether a person was employed. Employment is subject to seasonal variation throughout the year. Therefore, the GSS results for employment could have differed if the GSS had been conducted over the whole year or in a different part of the year.




Previous PageNext Page