2963.0 - Census Working Paper 93/4 - Comparison of Census and PES Responses, 1991  
ARCHIVED ISSUE Released at 11:30 AM (CANBERRA TIME) 06/01/1994   
   Page tools: Print Print Page Print all pages in this productPrint All


Census Working Paper 93/4

1991 PES: COMPARISON OF CENSUS AND PES RESPONSES

Julie Evans
Population Census Evaluation
September 1993


CONTENTS

Introduction
Age
Marital Status
Birthplace
Aboriginal/Torres Strait Islander Origin
Conclusion


Introduction

Census Data Quality
Census counts are inevitably subject to inaccuracies resulting from errors or omissions by respondents, either unintentional or deliberate. Information

collected as a part of the Post Enumeration Survey (PES) can be compared with information collected in the Census and the consistency of responses
analysed for implications for data quality.

Post Enumeration Survey
The PES is conducted shortly after the collection of Census forms has been completed. A sample of private dwellings across Australia is selected.

At all selected dwellings, interviewers ask Any Responsible Adult (ARA) a series of questions for each person in the household concerning personal
characteristics and location on Census night. If the ARA is unable to provide the information required for each person, another household member may
be asked, or a personal interview may be arranged. There are five questions common to both the Census and the PES: sex, age, marital status,
birthplace and Aboriginal/Torres Strait Islander origin.

There are a number of differences between the two collections which may have affected respondents. The PES is conducted several weeks after
Census night and some differences are inevitable, for example, someone may have been married in that period. In the Census, people completed their
own Census form and thus may have made errors in interpreting the question or may have skipped questions which requested sensitive information. In
the PES, a trained interviewer directly asked householders questions and could prompt them for the relevant information, thus responses may differ and
omissions were less likely.

While PES data is likely to be of a higher quality (because it is collected by a trained interviewer), it cannot be regarded as necessarily 'correct' by

objective standards. Interview responses are still subject to the inaccuracies of recall and insufficient knowledge about other household members,
as well as to the effects of interviewer-respondent interaction. For example, people may feel uncomfortable revealing personal information to a
stranger. While the comparison of results will not show how many people made errors in completing the Census form, it may still reveal information
about the quality of the data obtained in the Census.

Analysis
The population used in this analysis consists of people in the PES sample who were enumerated in the Census and for whom the extraction of

Census responses from the IFURF was complete.The analysis is based on unweighted data of 86,226 records. Sampling error should be taken into
account when comparing the figures. The data was analysed in a number of ways. Firstly, for people who responded in both the Census and PES,
responses were compared. Secondly, non-response in the Census was examined. Thirdly, where information is available on responses imputed in
the Census (see 1.4), the imputed values can be compared with the responses given in the PES.

Non-response and Imputation
The procedure for imputation in the Census for non-response differs between questions. During pre-capture, a value was derived for sex if it was not

stated. No record is available of how many people did not respond to this question, thus analysis of imputation is not possible. During preliminary
and main processing, responses were imputed where missing for age and marital status and PES information is available on the people for whom
responses were imputed. Some imputation was performed for missing responses for Aboriginal/Torres Strait Islander origin or birthplace but no record
is available on the number of responses involved. The non-response rates stated in this report for these questions refer to those persons for whom no
response was provided and for whom no response was imputed.

In the PES, the interviewer would sometimes estimate the age of the respondent and in the following analysis such cases have been treated as not
responding in the PES.

Overall comparison
Table 1 below contains some summary information on the comparison of Census and PES responses for the five questions common to both collections,

and on the non-response rates for these questions in the Census and in the PES.

TABLE 1: Percentage of persons whose Census and PES responses agree and non-response rates in the Census and PES
Imputation/
Applicable
    Question
Agree
Disagree
Response
non-response
Non-resp.
PES
in both
in Census a
in PES
Population
%
%
No.
%
%
No.
    Sex b
99.79
0.21
86,209
..
0.02
86,226
    Age c
85.55
14.45
84,499
0.51
1.15
86,226
    Marital Status d
96.91
3.09
64,099
3.72
0.17
66,687
    Birthplace
98.80
1.20
86,310
0.91
0.16
86,226
    Aboriginal / Torres Strait Islander origin e
99.53
0.47
65,158
2.96
0.16
66,877
a
        Calculated from the PES file. No rate available for sex. Imputation rates for age and marital status. Non-response rates (after imputation) for birthplace and Aboriginal/Torres Strait Islander origin.
b
        Includes persons for whom a response was derived in the Census
c
        There are two sources of age in the PES; age calculated from birthdate, rather than age given, is used here
d
        Persons with an age 15 years or older in the PES
e
        Persons with a birthplace of Australia in the PES

Discrepancy between Census and PES responses was greatest for marital status and age and least for the questions on sex and Aboriginal/Torres Strait
Islander origin. Most of the differences between Census and PES age were small, however, with 98.15% of persons having an age in the PES which was
within one year of the Census response.

As expected, non-response generally was much lower in the PES than in the Census, with the exception of age. This could be due to the number of people

for whom the interviewer estimated age who have been treated as not responding.

There is very little inconsistency among responses to the question on sex, and the few cases observed are probably due to the imputation performed at

pre-capture. This question will not be examined in more detail in this report.

Age
As noted in the introduction, there was a surprisingly large level of disagreement between age given in the Census and age given in the PES. These

inaccuracies in age data will be explored in detail in this section.

The analysis is complicated by the fact that two questions on age were included in the PES: the first question requests the age last birthday and the
second requests the date of birth. A comparison of responses to these two questions is included as well as comparisons between responses in the
Census and PES. Persons who did not respond in the Census, and so for whom age was imputed, are considered separately in the analysis.

Age in the PES
Over 3.5% of respondents in the PES gave an age and date of birth which did not agree, although most differences were of only one year. Tables 2 and 3

below shows the difference between responses and the non-responses rates to each question. AGE yrs is the age last birthday from the first question and
AGE dob is the age calculated from the date of birth from the second question.

TABLE 2: Response status for AGE yrs and AGE dob in PES
    Response given to
    AGE yrs
AGE dob
No.
%
    Yes
Yes
84,435
97.92
    No
Yes
490
0.57
    Yes
No
800
0.93
    No
No
501
0.58
    Total
86,226
100.00

The non-response rate was slightly higher for the date of birth question, indicating that this question may have been slightly more difficult for interviewees to answer.


TABLE 3: Comparison of AGE yrs and AGE dob in PES
Difference in years
Number
Percentage
AGE yrs AGE dob
of cases
distribution
-100 to -11
23
0.03
-10
56
0.07
-9 to -6
29
0.04
-5 to -2
127
0.16
-1
1,255
1.62
0
74,494
96.37
1
1,126
1.46
2 to 5
83
0.11
6 to 9
18
0.02
10
58
0.08
11 to 100
31
0.04
Sub-total
77,300
100.00
People excluded *
7,135
Total
84,435

* People whose date of birth was between Census night and the final day that the PES was in the field. Depending on the date of birth, the answers of many

of these people could legitimately differ by one year.

Nearly all responses (96.4%) had age and date of birth within one year of each other. Of those respondents whose age from the date of birth was different to

that given, 1.9% gave an age lower than that indicated by their date of birth, while 1.7% gave an age that was higher than that indicated by their date of birth.
For differences greater than 1 year, the difference tended to cluster around 10 and -10.

Comparison of Census and PES responses for age
The 'age last birthday' question included in the PES was similar to the question in the Census, although they were not identical. In the PES the interviewer
recorded the answer while in the Census the respondent had to mark an answer box in a grid.

Table 4 shows the level of agreement between Census and PES responses to both age last birthday AGE yrs and age calculated from date of birth AGE dob

TABLE 4: Consistency of Census and PES responses for age
PES Age from
PES Age in years *
date of birth
No.
%
No.
%
    Agree
69,967
90.04
76,064
90.02
    Disagree by 1 year
6,349
8.17
6,680
7.91
    Sub-total
76,316
98.21
82,744
97.92
    Disagree by
    more than 1 year
1,389
1.79
1,755
2.08
    Total
77,705
100.00
84,499
100.00

* People whose date of birth was between Census night and the final day that the PES was in the field are excluded. Depending on the date of birth, the
answers of many of these people could legitimately differ by one year.

Even excluding people whose birthday was between the Census and PES, 8.2% of the population had answers to the two 'age in years' questions which
differed by one year, and a similar level was found comparing the Census age and that from the PES question on date of birth. This high incidence of small
errors may partly be due to the fact that, in both the Census and the PES, one person may respond for the entire household. A respondent may be unsure
of another person's exact age or date of birth, and answers may differ in the two collections, especially if different people complete the Census and PES.

Table 5 compares the Census and PES responses by 5 year age groups. Persons born between the Census and the end of the PES are not included.

The lowest level of agreement (between 96% and 97%) was found for people aged between 40 and 74 while the highest level of agreement was found in the

age group 0 to 4 years, at 99.5%. The other age groups (75 years and over and 5 to 19 years) had levels of agreement between 98.4% and 98.9%.

For people aged between 20 and 70 years, the errors tended to be within the same 10 year age range. That is, for example, a person who gave an age

between 40 and 44 in the Census and whose age in the PES differed was more likely to be in the 45-49 age group in the Census than 35-39. This difference
was often in the range of 1% of respondents.

From an analysis of persons whose age from date of birth data differed from the age given in the Census by more than 50 years, it appeared that some
people gave their year of birth in the Census rather than their age in years. Table 6 includes the details of some of these cases.

TABLE 6: Examples of persons who may have given their year of birth in the Census
Age given
Age given
Birthdate
in Census
in PES
in PES
79
11
29/9/79
22
69
31/7/22
26
64
11/12/26
64
26
3/12/64

A search of the PES file revealed about 51 people (12% of those who had differences of two years or greater) who may have made this error.

Analysis of PES responses for age for cases of non-response in the Census
Non-response to age in the Census for PES respondents was relatively low at 0.51%. The responses recorded in the PES for people for whom no response

was given in the Census are contained in Table 7 below.

TABLE 7: PES responses AGE yrs for all PES respondents and for cases of non-response in the Census
Non-response
All persons
in the Census
Non-response rate
    PES AGE yrs
No.
No.
%
    0-4
6,416
24
0.37
    5-9
6,592
25
0.38
    10-14
6,431
16
0.25
    15-19
6,854
87
1.27
    20-24
6,549
23
0.35
    25-29
6,652
31
0.47
    30-34
6,941
30
0.43
    35-39
6,761
19
0.28
    40-44
6,698
27
0.40
    45-49
5,228
14
0.27
    50-54
4,213
26
0.62
    55-59
3,538
13
0.37
    60-64
3,492
11
0.32
    65-69
3,138
23
0.73
    70-74
2,443
22
0.90
    75+
3,289
38
1.16
    Not Stated in PES
991
12
1.21
    Total
86,226
441
0.51

The rate of non-response was highest for those identified as being 15 to 19 years old in the PES, although the reasons for this are not clear. Non-response
in the Census was also high amongst those with their age in the PES as being over 75 years. This could indicate that elderly people had difficulty in
completing the question on age in the Census.

Comparison of PES responses to age and values imputed in the Census
Table 8 contains data for all persons in the PES for whom age was imputed in the Census. The older age groups are combined as the sample sizes are much

smaller and the major point of interest is among the younger age groups.

TABLE 8: PES responses for AGE yrs persons with age imputed in the Census
Imputed Census response
PES
0-4
5-9
10-14
15-19
20-24
25-29
30+
Total
response
No.
No.
No.
No.
No.
No.
No.
Sample
0-4
14
3
1
2
2
0
2
24
5-9
2
14
6
2
0
0
1
25
10-14
1
1
10
1
0
0
3
16
15-19
7
9
60
4
0
2
5
87
20-24
9
1
7
0
1
0
5
23
25-29
7
2
0
3
2
2
15
31
30+
13
4
4
12
13
13
164
223
Not stated
2
0
0
1
0
0
9
12
Sample
55
34
88
25
18
17
204
441

There is a much lower correspondence between age in Census and age in PES here, as would be expected. Most cells in the table contain very few records
with the exception of those with imputed age in the Census of between 10 and 14 and given age in the PES of between 15 and 19. There were 60 people in
this category, indicating that the imputation system may have given many people ages of younger than 15 years when in fact they were 15 years or older. For
all PES age groups in the table, including the combined 30 years and older group, about 40% had a lower age imputed and only 11% had a higher imputed age.

Marital Status
If Marital Status was not stated in the Census then it was imputed according to dwelling type, income, student status, educational institution attended,

relationship and age. This analysis will compare both the stated and the imputed responses in the Census with the responses in the PES.

Only people identified as being aged 15 years or older in the PES will be considered here. There was very little inconsistency in the remainder as nearly all

children aged under 15 years had a response of 'Never Married'. If a response was not stated in the Census then a response of 'Never Married' was imputed.
It appears that no response was given for many children for whom the question would have appeared irrelevant. The non-response rate for children under 15
was 11.5%, compared to 3.7% for people aged 15 or older.

Comparison of Census and PES responses for marital status
Table 9 shows the extent of consistency between the PES and the Census responses for marital status.

TABLE 9: Consistency of Census and PES responses for marital status
% of responses
% of total persons
No.
stated in both
aged over 14 years
    Agree
62,119
96.91
    Disagree
1,980
3.09
    Responses stated
    in PES and Census
64,099
100.0
96.12
    Not stated in Census only
2,472
3.71
    Not stated in PES only
105
0.16
    Not stated in either
11
0.02
    Total persons 15+
66,687
100.00

Marital Status has a slightly lower rate of agreement than most other variables. This may be the result of responses varying between the self-enumerated
and interviewer based collections because of the sensitivity of the question for some people.

Table 10 provides more information on the comparison of Census and PES responses, comparing the responses given in the Census and the PES.


The response categories which are subject to the greatest change between the Census and the PES are 'Separated' and 'Divorced'. Of those persons with

marital status of 'Separated' in the Census, almost 10% are shown as married in the PES. Persons who are shown as divorced in the Census and had a
different response in the PES were not concentrated in a particular group, with between 4.3% and 6.2% responding in each of the categories 'Never Married',
'Married', and 'Separated'. While some minor change could be expected between the Census and the PES as persons became married, widowed or divorced,
such changes would not account for the variations shown.

A number of possible reasons for the inconsistencies can be postulated but any conclusions about actual causes are bound to be speculative. Two factors
that are likely to be influential are respondent confusion in the Census (eg. uncertainty between legal marital status and status in a current relationship) and
greater sensitivity towards disclosing legal marital status under some circumstances to interviewers.

TABLE 10: Responses in the Census and PES for marital status
Census response
PES
Never
Total
response
Married
Married
Separated
Divorced
Widowed
Sample
COUNT
Never Married
17,563
307
41
142
19
18,072
Married
504
36,861
175
207
26
37,773
Separated
29
85
1,457
158
8
1,737
Divorced
22
12
83
2,767
36
2,920
Widowed
17
46
9
54
3,471
3,597
Total responding
18,135
37,311
1,765
3,328
3,560
64,099
PERCENT
Never Married
96.85
0.82
2.32
4.27
0.53
28.19
Married
2.78
98.79
9.92
6.22
0.73
58.93
Separated
0.16
0.23
82.55
4.75
0.22
2.71
Divorced
0.12
0.03
4.70
83.14
1.01
4.56
Widowed
0.09
0.12
0.51
1.62
97.50
5.61
Total
100.00
100.00
100.00
100.00
100.00
100.00

Analysis of PES responses for marital status for cases of non-response in the Census
For PES respondents, marital status had a relatively high non-response rate in the Census, at 3.72%. Table 11 below shows the responses given in the

PES by those people who did not give a response in the Census.

TABLE 11: PES responses for cases of non-response to marital status in the Census
Non-response
All persons
in the Census
Non-response rate
    PES response
No.
No.
%
    Never Married
18,968
896
4.72
    Married
38,965
1,192
3.06
    Separated
1,819
82
4.51
    Divorced
3,041
121
3.98
    Widowed
3,778
181
4.79
    Not Stated
116
11
9.48
    Total
66,687
2,483
3.72

People who were identified as being married in the PES were slightly more likely to have had a response provided in the Census than other people.

Comparison of PES responses to marital status and values imputed in the Census
Marital status was imputed for people who did not respond in the Census. Overall, two thirds of the imputations performed were borne out by the PES.

Table 12 below compares the imputed values with the responses given in the PES.

TABLE 12: PES responses for marital status; persons with marital status imputed in the Census
Imputed Census response
Never
Total
PES
Married
Married
Separated
Divorced
Widowed
Sample
response
No.
No.
No.
No.
No.
No.
Never Married
537
295
11
23
30
896
Married
67
1,080
10
14
21
1,192
Separated
20
52
1
2
7
82
Divorced
29
79
0
6
7
121
Widowed
32
116
4
6
23
181
Not Stated
4
6
0
0
1
11
Total Sample
689
1,628
26
51
89
2,483

The imputation algorithm appears to have been able to correctly classify married people, with over 90% of those identified as married in the PES having had a
marital status of married imputed in the Census. The algorithm also appeared to work well for those identified as never married in the PES, with almost 60%
having had that response imputed in the Census. The level of agreement between the imputed Census response and the PES response was much lower for
the other categories of separated, divorced and widowed, which is not surprising given the relatively small number of people in these categories in the population.

Birthplace
The first stage of this analysis compares the responses of those for whom birthplace was stated in the Census with the response in the PES. The second

stage of the analysis considers the PES responses of persons with their birthplace not stated in the Census. The sample size for many countries was very
small and this should be taken into account in drawing conclusions from the following analysis.

The comparability of responses could be affected by the different lists of countries in the PES and the Census. In the Census, there were separate categories

for England and Scotland, while in the PES one category of UK/Ireland was provided. Yugoslavia, Germany and Vietnam were listed in the PES but not in the
Census.

Comparison of Census and PES responses for birthplace
The overall percentage of persons whose Census and PES responses agreed was 98.8%. Table 13 compares the responses in the Census and the PES

across categories.

There was a very high correspondence among those who gave Australia as their birthplace in the Census and the PES, with 99.6% of persons who said they

were born in Australia in the Census giving Australia as their birthplace in the PES.

Between 94% and 99% of persons giving UK/Ireland, Italy, Greece, Netherlands, Germany, New Zealand, Vietnam, Other Europe or Other Asia as their
birthplace in the Census gave the same result in the PES. For many of these countries a common change is to give Australia as birthplace. Other common
responses tended to be in the 'Other Europe' (for European countries), 'Other Asia' (for Vietnam) and 'Other' categories. Of those whose birthplace was coded
as 'Other' in the Census, only 87.6% were coded as 'Other' in the PES. This could be due to slightly different names being used for birthplaces.

The highest rate of change among the countries was observed for those who gave Yugoslavia as their country of birth in the Census, where 9.6% of persons

gave a different country of birth in the PES. This could partly be due to the political instability in that country. A response of 'Macedonia' to a birthplace
question would have been coded to Yugoslavia, according to ASCCSS codes. However there has been contention over the use of the term 'Macedonia' as
some people born in Greece also identify as Macedonian. Over 5% of people who were identified as being born in Yugoslavia in the Census had a birthplace
of Greece in the PES and it appears likely that this is the result of the situation mentioned above.

Analysis of PES responses for birthplace for cases of non-response in the Census
Birthplace was not stated for 2.0% of persons in the Census. Table 14 shows the birthplaces stated in the PES for these persons.

TABLE 14: PES responses for cases of non-response to birthplace in the Census
Non-response
All persons
in the Census
Non-response rate
    PES response
No.
No.
%
    Australia
66,877
575
0.86
    UK/Ireland
6,478
33
0.51
    Italy
1,344
12
0.89
    Greece
698
2
0.29
    Yugoslavia
738
12
1.63
    Netherlands
462
1
0.22
    Germany
646
11
1.70
    New Zealand
1,382
8
0.58
    Vietnam
562
14
2.49
    Other Europe
1,785
19
1.06
    Other Asia
2,778
52
1.87
    Other
2,342
43
1.84
    Not Stated in PES
134
4
2.99
    Total
86,226
786
0.91

Those people who didn't respond in the Census were more likely to indicate in the PES that they were born in countries other than those (Australia, England,
Scotland, Italy, Greece, New Zealand, The Netherlands) listed on the Census form. Thus it appears that there was a 'list effect' in the Census and people were
more likely to respond if they only had to mark a box rather than write in a response.

Aboriginal/ Torres Strait Islander Origin
As for birthplace, the first stage of this analysis compares the PES and Census responses of those for whom Aboriginal/Torres Strait Islander origin was stated

in the Census while the second stage of the analysis considers the response in the PES for persons where the question was not answered in the Census.

Comparison of Census and PES responses for Aboriginal/Torres Strait Islander origin
The percentage of persons whose Census and PES responses agree appears to be very high at 99.53%. It can be seen in Table 15 below that this is due

largely to the high proportion of the population that were classified as being of neither Aboriginal or Torres Strait Islander origin in both the Census and the PES.
The level of agreement was much lower for the other two response categories.

TABLE 15: Responses in the Census and PES for Aboriginal/Torres Strait Islander origin
Census response
Torres Strait
    PES response
Non-indigenous
Aboriginal
Islander
Total
COUNT
    Non-indigenous
63,888
134
58
64,080
    Aboriginal
157
809
15
981
    Torres Strait Islander
17
4
76
97
    Total Sample
64,062
947
149
65,158
PERCENT
    Non-indigenous
99.73
14.15
38.93
98.35
    Aboriginal
0.25
85.43
10.07
1.51
    Torres Strait Islander
0.03
0.42
51.01
0.15
    Total
100.00
100.00
100.00
100.00


Of those people who said they were of Aboriginal origin in the Census, 85% said they were of Aboriginal origin in the PES, with most of those who gave a
different response indicating that there were of neither Aboriginal nor Torres Strait Islander origin in the PES. Only 50% of those who said they were of Torres
Strait Islander origin in the Census said they were of Torres Strait Islander origin in the PES, with the majority of those who gave a different response saying
they were of neither Aboriginal or Torres Strait Islander origin in the PES.

Analysis of PES responses for Aboriginal/Torres Strait Islander origin for cases of non-response in the Census
The level of non-response to this question in the Census was 2.98%. Table 16 shows the responses given in the PES by persons who did not respond in the Census.


TABLE 16: PES responses for cases of non-response to Aboriginal/Torres Strait Islander origin in the Census
Non-response
    PES response
All persons
in the Census
Non-response rate
No.
No.
%
    Non-indigenous
65,664
1,584
2.41
    Aboriginal
1,014
33
3.25
    Torres Strait Islander
102
5
4.90
    Not Stated
97
1
1.03
    Total
66,877
1,623
2.43


A higher than expected proportion of people who did not state a response in the Census identified themselves as being of Aboriginal or Torres Strait Islander
origin in the PES.

Conclusions
This analysis of Census and PES responses for variables common to the two collections has a number of implications for the quality of Census data and for

Census form design.

The responses given for age appear to be subject to a large number of small errors, although as most analysis is performed using five year age groups the

implications for the quality of data may not be great. Non-response appeared to be higher for people in older age groups.

The imputation system resulted in many people identified in the PES as being aged between 15 and 19 years (the group most likely not to respond to this

question) being given an age of younger than 15 years. There is also evidence in this analysis of the Census imputation process under-estimating ages
across all broad age groups.

Response to marital status appeared to be reasonably sensitive to variation between the two collections, in particular responses of 'separated' and
'divorced'. The imputation was consistent with PES responses in two thirds of all cases, although the rate was much lower than this for 'separated', 'divorced'
and 'widowed' imputed values.

There was a reasonably high correspondence between responses in the Census and PES to the question on birthplace. Most discrepancies that occurred

involved Australia, Yugoslavia or 'Other' birthplaces. The presence of countries in the list on the Census form appeared to lower non-response for people born
in those countries.

While the overall level of agreement for responses to the question on Aboriginal or Torres Strait Islander origin appeared to be good, this did not apply for

the response categories of 'Aboriginal' or 'Torres Strait Islander' when taken separately. In particular, only half of the Census 'Torres Strait Islander' responses
were borne out by the PES with 40% of the corresponding PES responses being 'Other' (non-indigenous). For about 85% of Census responses of Aboriginal,
the PES responses were consistent. For almost all of the remainder, the PES response was 'Other' (non-indigenous). On the other hand, about 89% of PES
'Aboriginal' responses were consistent with Census responses with most of the remainder being recorded as 'Torres Strait Islander' in the Census.