Demography

Data Integration Project Register
Released
13/12/2021

Rename of MADIP to PLIDA

The Multi-Agency Data Integration Project (MADIP) was renamed the Person Level Integrated Data Asset (PLIDA) in 2023. Historical documents and projects retain their references to MADIP.

Key data assets:

Australian Census Longitudinal Dataset (ACLD)
The Multi-Agency Data Integration Project (MADIP)
(see: Data assets)

2021 Census - Post Census Review

Commencement date: November 2021
Project status: Approved, not started

Project Summary

The Post Census Review (PCR), formerly called the Post Enumeration Survey, is run immediately following the Census of Population and Housing, and has been conducted for every Census since 1966.

The PCR measures the overcount and undercount of the Census. This is achieved by linking PCR records to Census records to determine which persons in Census were counted once, which were counted more than once (overcount), and which were not counted at all (undercount).

PCR requires a very high standard of linkage to produce accurate estimates, requiring personal identifiers (name, date of birth, address) from both PCR and Census. This is done within tight security provisions consistent with Census protocols. Personal identifiers are erased from all PCR environments per the time frames in the Census Privacy Statement. Only aggregate estimates are published from the PCR.

Benefits

The Post Census Review provides a critical component to 2021 Census rebasing of the Australian Estimated Resident Population (ERP).

It also provides users with an assessment of the completeness of Census counts, allowing them to take this into account when using Census information; and independently evaluates the effectiveness of Census enumeration procedures so that improvements can be made for future Censuses.

DatasetData Custodian
2021 Census of Population and Housing
2021 Post Census Review (September - October 2021)
Australian Bureau of Statistics

2020 Census Operational Readiness Exercise (ORE)

Commencement date: October 2020
Project status: In progress

Project Summary

A critical path to ensuring the success of the five yearly Australian Census is through large scale testing. The 2020 Census Operation Readiness Exercise (ORE), previously called the Census Dress Rehearsal, and its subsequent review, will provide the necessary data to support testing of Census linking procedures and systems, ahead of the main event in August 2021.

Benefits

Field tests are an important part of development for ABS collections. They provide feedback on systems, processes and respondent behavior that enables improvement of the collection and smoother participation for respondents.

DatasetData Custodian
2020 Census Operational Readiness Exercise (October 2020)
2020 Post Census Review Operational Readiness Exercise (December 2020)
Australian Bureau of Statistics

Census Person Asset and Contingency Research

Commencement date: September 2020
Project status: In progress

Project Summary

This project will support the research required to develop and implement low-response contingencies to improve data that ABS provides to the community through the Census of Population and Housing.

Low response contingencies will help us maintain high-quality Census data, even if an unexpected event occurs that impacts on the Census response. This research will involve several different approaches: 

  • Improving and repairing the Census with administrative data
  • Improving the linkage rate between Census and administrative data (MADIP)
  • Exploring how a 5% sample of 2011 Census data linked to 2016 Census data can be used to improve Census data quality.

The integrated data from this project will be for internal ABS Census Program use in researching new methodologies in the lead up to the 2021 Census. To promote transparency of the work that is being conducted, some public-facing outputs will be produced, for example research articles and high-level communications. No data will be published.

Benefits

The Census of Population and Housing (Census) is one of the ABS’ most critical, legislated functions. High quality Census data is critical to informing the planning and delivery of Government and community services, business decisions and academic research.

This research will support improvements to 2021 Census data, including in the event of an unacceptably low response

DatasetData Custodian
Multi-Agency Data Integration Project (MADIP)Australian Bureau of Statistics
Census of Population and Housing (2011 and 2016)
Census Post Enumeration Survey (2016)
ABS Address Register
Australian Bureau of Statistics

Proof of Concept for Crime and Justice Data Integration

Commencement date: August 2020
Project status: In progress

Project Summary

The Australian Institute of Health and Welfare (AIHW) and the Australian Bureau of Statistics (ABS) have established a project to enhance the suite of national crime and justice data collections to enable person-level data linkage, and to undertake data linkage with key justice, health and welfare services datasets.

The initial phases of this project have linked together administrative datasets from Police, Criminal Courts, Corrective Services and Juvenile Justice criminal justice agencies across several Australian jurisdictions, in order to assess data linkage methodologies and test the development of an NCCJS Justice Spine which can potentially be linked to other datasets.

Benefits

This project will support the analysis of employment and financial outcomes of people who have come into contact with the criminal justice sector, addressing a key data gap highlighted by the Prison to Work report. It also tests the viability of using existing linkage methodologies to link crime and justice data with other administrative datasets.

DatasetData Custodian
Multi-Agency Data Integration Project (MADIP)

- Personal Income Tax (2010-11 to 2017-18)
- Payment Summary (2010-11 to 2017-18)

- Medicare Consumer Directory (2011 to 2016)

- Social Security and Related Information (2012 to 2016)
Australian Bureau of Statistics

- Australian Taxation Office

- Department of Health

- Department of Social Services

Prisoner Census
- Tasmania (2013-14 to 2017-18)

Recorded Crime
– Offenders
- New South Wales (2008-09 to 2017-18)
- Tasmania (2013-14 to 2017-18

Criminal Courts, Australia
- Tasmania (2013-14 to 2017-18)

Australian Bureau of Statistics
- Tasmania Justice Department
- Tasmania Police force
- New South Wales Police force

Exits from Income Support

Commencement date: August 2019
Project status: In progress

Project Summary

This project, led by the Department of Social Services, aims to build a broader picture of income support recipients’ pathways once they leave the system, and, if possible, the interventions that occurred in the lead-up to this outcome.

Benefits

This project will be used to better understand outcomes of recipients once they leave income support to assist with designing effective income support policies and employment programs. Linking administrative income support data to recent employment history, health and education data will provide insight into who needs more support in finding work.

DatasetData Custodian
Multi-Agency Data Integration Project (MADIP)

- Census of Population and Housing (2016)

- Personal Income Tax (2010-11 to 2018-19)
- Payment Summary (2010-11 to 2017-18)
- ATO Client Register (2006 to 2020)

- Pharmaceutical Benefits Scheme (2011 to 2020)
- Medicare Benefits Schedule (2011 to 2020)

- Medicare Consumer Directory (2006 to 2020)

- DOMINO Centrelink Administrative data (2006 to 2020)

- Australian Apprenticeships Incentives Programme and Training Contracts (2006 to 2019)
- Higher Education Information Management System Data (2005 to 2019)
- Total VET Activity (2015 to 2019)

- Death registrations (2007 to 2019)

- Migration (2005 to 2018)

Australian Bureau of Statistics

- Australian Bureau of Statistics

- Australian Taxation Office
 

- Department of Health
 

- Services Australia
 

- Department of Social Services

- Department of Education, Skills and Employment
 

- State and Territory Registrars of Births, Deaths, and Marriages

- Department of Home Affairs

Data Exchange (DEX) data (2015 to 2020)Department of Social Services
Employment Services System (ESS) and Post-Program Monitoring Surveys (PPM) (2015-16 to 2018-19)Department of Education, Skills and Employment
Business Longitudinal Analysis Data Environment (BLADE) – Core ABS Economic Units Model Level (2001-02 to 2018-19)
- Indicative Items
- Business Activity Statement (BAS)
- Pay As You Go (PAYG)
- Business Income Tax
- Business Locations

Australian Bureau of Statistics

- Australian Bureau of Statistics

- Australian Taxation Office (ATO)

Intergenerational Welfare Dependence

Commencement date: October 2019
Project status: In progress

Project Summary

This project, led by the Department of Social Services, aims to broaden the picture of the impact of intergenerational welfare dependence by investigating the relationship between a child’s social, health, education and employment outcomes and their parent’s use of income support.

Benefits

This project will provide policy makers across government agencies with detailed insights into the characteristics and protective factors associated with pathways out of childhood disadvantage, as well as the effect of geographical location on these pathways.

It may also identify possible points of intervention, to guide the development of policy and support programs aimed at breaking the cycle of disadvantage, allowing the government to develop targeted interventions with the potential to reduce lifetime welfare spending.

DatasetData Custodian
Multi-Agency Data Integration Project (MADIP)

- Census of Population and Housing (Census) (2016)

- Australian Apprenticeships Incentives Program (AAIP) and Training Contracts (2011-2016)

- Death Registrations (Deaths) (2005-2017)

- Higher Education Information Management System data (HIEMS) (2005-2016)

- Migration data:
• Visa information & Citizenship grants (2000-2018)
• Client information (1984-2018)
• Traveller data (2004-2018)
• Skilled Migration Points (2005-2019)

- Medicare Benefits Schedule (MBS) (2011-2016)
- Pharmaceutical Benefits Schedule (PBS) (2011-2016)

- Medicare Enrolments Database (MEDB) (2006-2016)

- Personal Income Tax (PIT) (2010-11 to 2015-16)
- PAYG Payment Summaries (2010-11 to 2015- 2016)

- Social Security and Related Information (SSRI) (2009 - 2016)

Australian Bureau of Statistics

- Australian Bureau of Statistics

- Department of Employment, Skills, Small and Family Business

- Registrars of Births, Deaths & Marriages

- Department of Education, Skills and Employment

- Department of Home Affairs
 


- Department of Health

-Department of Human Services


- Australian Taxation Office


- Department of Social Services

Transgenerational Data Set (TDS) extract (1995 to 2014)Department of Social Services

Intergenerational Drivers of Entry into the Victorian Child Protection System

Commencement date: 30/08/2019
Project status: Completed

Project Summary

This project will support the Victorian Department of Health and Human Services to identify intergenerational drivers of entry into the Victorian Child Protection system. It will provide new insights from Commonwealth data and will act as a proof of concept for linking Victorian Government data with Commonwealth data.

The analysis will seek to answer the question: What factors influence children and young people entering the Child Protection system including out-of-home care before the age of 5.

The research will identify socio-economic and demographic protective and risk factors that influence a child’s likelihood of interaction with the Child Protection system.

Benefits

This information will be used to design services to promote the safety, stability and development of vulnerable children, young people and their families.

DatasetData Custodian
Multi-Agency Data Integration Project (MADIP)
- 2011 Census of Population and Housing
- Social Security and Related Information (2009 to 2013)
Australian Bureau of Statistics
- Australian Bureau of Statistics
- Department of Social Services
Victorian Linkage Map (1991 – Dec 2018)
- Alcohol and Drug Information System (2006 onwards)
- Birth Registry (1998 onwards)
- Child Protection and Out of Home Care (1996 onwards)
- Death Index (1994 onwards)
- ChildFIRST (2008 onwards)
- Dental Health Program Dataset (2011 onwards)
- Disability Services (2015 onwards)
- Family Services (2007 onwards)
- Family Violence Services (2007 onwards)
- Homelessness Services (2015 onwards)
- Mental Health Community Support Services (2002 onwards)
- National Disability Insurance Scheme Dataset (2013 onwards)
- Public Housing Applications (1991 onwards)
- Public Housing Tenancies (1991 onwards)
- Public Mental Health Services (1993 onwards)
- Sexual Assault Services (2007 onwards)
- Victorian Admitted Episodes Dataset (1993 onwards)
- Victorian Emergency Minimum Dataset (1993 onwards)
- Youth Justice Data
Victorian Department of Health and Human Services

Social Housing Metadata for the ABS Address Register

Commencement date: 26/10/2018
Project status: In progress

Project Summary

This project will combine social housing address lists with the ABS Address Register to create new social housing metadata that will enhance ABS collections, such as the Survey of Income and Housing and the Census of Population and Housing. These quality improvements for accuracy, coverage, and coherence of ABS statistical indicators (such as those used in the National Housing and Homelessness Agreement) will assist policy makers at Commonwealth and state level.

Benefits

Better measures of the performance of social housing policy will allow policy makers to develop more targeted and effective policies and services. This will contribute to the objective of all Australians having access to affordable, safe, and sustainable housing that contributes to social and economic participation.

DatasetData Custodian
Address RegisterAustralian Bureau of Statistics
Social Housing Address ListsState and Territory Housing Authorities

Aboriginal and Torres Strait Islander Mortality Project 2016

Commencement date: 04/07/2017
Project status: Completed

Project Summary

Almost all deaths of Aboriginal and Torres Strait Islander Australians are registered, but some are not identified and recorded as such when registered. Therefore, registration data underestimates the actual number of deaths and death rates and consequently their application can result in overestimates of life expectancy of Aboriginal and Torres Strait Islander Australians. Hence the number of registered deaths needs to be adjusted before compiling life tables.

This project linked the 2016 Census data with all deaths that were registered within one year following the Census to estimate factors for adjusting registered deaths. Adjusted deaths were used to compile life tables.

Benefits

Benefits of the project include:

  • A more accurate measure of Aboriginal and Torres Strait Islander life expectancy - a critical measure under the Closing the Gap agenda.
  • Life expectancy has been produced for three categories of remoteness compared to two in the previous release: Major Cities, combined Inner & Outer Regional, and combined Remote & Very Remote (keenly sought after).
  • Life expectancy by Index of Relative Socio-Economic Disadvantage was also produced for the first time.
DatasetData Custodian
2016 Census of Population and HousingAustralian Bureau of Statistics
Death Registrations (August 2016 – September 2018)State and Territory Registrars of Births, Deaths, and Marriages

 

Publications/Results

10/12/2018 - Linking Death registrations to the 2016 Census, 2016-17 (cat.no. 3302.0.55.004)
This information paper describes the background and rationale for the 2016 Census to Death Registrations linkage project.

29/11/2018 - Life Tables for Aboriginal and Torres Strait Islander Australians, 2015-2017 (cat. no. 3302.0.55.003)
This publication presents life tables for male and female Aboriginal and Torres Strait Islander Australians for the reference period 2015-2017, for Australia, selected states and territories, Remoteness Areas and Index of Relative Socio-Economic Disadvantage.
 

Publications on the 2011 Project:

16/06/2016 - Data Integration Case Study: Life Expectancy

09/03/2016 - Research Paper: Death Registrations to Census Linkage Project - A Linked Dataset for Analysis, Mar 2016 (cat. no. 1351.0.55.058)
This paper describes the creation of the linked dataset and provides necessary background material and advice for potential users.

15/11/2013 - Life Tables for Aboriginal and Torres Strait Islander Australians, 2010-2012 (cat. no. 3302.0.55.003)
This publication presents life tables for male and female Aboriginal and Torres Strait Islander Australians for the reference period 2010-2012, for selected states and territories and Australia.

15/11/2013 - Information Paper: Death registrations to Census linkage project - Key Findings for Aboriginal and Torres Strait Islander peoples, 2011-2012 (cat. no. 3302.0.55.005)
This paper presents information from the 2011-12 project, and examined the differences in the reporting of Indigenous status in death registrations compared with Census records.

28/08/2013 - Information Paper: Death registrations to Census linkage project - Methodology and Quality Assessment, 2011-2012 (cat. no. 3302.0.55.004)
This paper details the methodology used in the linkage process, the outcomes of the project and the quality of the resultant datasets.

Publications on the 2006 Quality Study:

11/03/2010 - Research Paper: Linking Census Records to Death Registrations, Mar 2010 (cat. no. 1351.0.55.030)
This paper builds on previously released papers, elaborating on the probabilistic data linking methodology used

17/11/2008 - Information Paper: Census Data Enhancement - Indigenous Mortality Quality Study, 2006-07 (cat. no. 4723.0)
This paper outlines the findings from the Indigenous Mortality Quality Study.

17/11/2008 - Discussion Paper: Assessment of Methods for Developing Life Tables for Aboriginal and Torres Strait Islander Australians, 2006 (cat. no. 3302.0.55.002)
This discussion paper highlighted the issues associated with compiling life tables and life expectancy estimates for Indigenous Australians.

Census Post Enumeration Survey (PES)

Commencement date: 12/10/2016 (PES 2016)
Project status: Ongoing

Project Summary

The Census Post Enumeration Survey (PES) has taken place shortly after each Census since 1966, in order to provide an independent measure of Census coverage. It determines how many people should have been counted in the Census, how many were missed, how many were counted more than once, and how many were counted in error.

The PES:

  • Provides estimates of net undercount that are used to calculate population estimates for Australia and its states and territories
  • Provides users with an assessment of the completeness of Census data, allowing them to take this into account when using Census information; and
  • Independently evaluates the effectiveness of how a Census is run, so improvements can be made in future Censuses

Benefits

Accurate estimates of the resident population are required for a wide range of uses including:

  • The allocation of seats to States and Territories in the House of Representatives of the Australian Parliament
  • The distribution of Commonwealth payments to States and Territories
  • Planning and performance reporting
  • Demographic, social and economic research
DatasetData Custodian
Census of Population and Housing
Census Post Enumeration Survey
Australian Bureau of Statistics

 

Publications/Results

23/02/2018 - Census of Population and Housing: Details of Overcount and Undercount, Australia, 2016 (cat. no. 2940.0)
This publication presents estimates of undercount and overcount for the 2016 Census, resulting from the 2016 Census Post Enumeration Survey.

21/06/2012 - Census of Population and Housing - Details of Undercount, 2011 (cat. no. 2940.0)
This publication presents estimates of net undercount for the 2011 Census of Population and Housing, resulting from the Census Post Enumeration Survey (PES).

PES results from earlier Censuses can be found on the Past & Future releases tab of the publications above.

Personal Income Tax and Census Data Integration Feasibility Study

Commencement date: 01/06/2015
Project status: Completed

Project Summary

This project tested the feasibility of combining 2011 Census of Population and Housing and Personal Income Tax data, looking at the linkage rates and linkage accuracy to inform future projects.

Benefits

This project demonstrated the feasibility of linking nationally important datasets.

DatasetData Custodian
2011 Census of Population and HousingAustralian Bureau of Statistics
Personal Income Tax (2010/11 and 2011/12)Australian Taxation Office

 

ABS and Department of Social Services Joint Data Integration Initiative

Commencement date: 09/01/2015
Project status: Completed

Project Summary

This three year data integration project by the ABS and the Department of Social Services demonstrated that combining Social Security data with ABS datasets can provide national statistical assets for policy related research and evaluation. It was a pre-cursor to the Multi-Agency Data Integration Project (MADIP), and helped inform various technical aspects of that project.

This project produced additional information such as education and qualifications, work (including hours worked, occupation and industry), ethnicity, income, and housing with information about people who interact with the social security system. The statistics are experimental, given various limitations related to the linking and weighting of records. For more information, refer to Limitations section in “Microdata: Australian Census Longitudinal Dataset with Social Security and Related Information, experimental statistics, 2006-2011 (cat. no. 2085.0)”.

Benefits

This project helped to build the evidence base available to inform the development of policies to improve the well-being of Australians.

DatasetData Custodian
2011 Census of Population and Housing
2006-2011 Australian Census Longitudinal Dataset
Australian Bureau of Statistics
Social Security and Related InformationDepartment of Social Services

 

Publications/Results

21/09/2021 - Not in Employment, Education or Training (NEET); more than a youth policy issue
This paper builds on the authors' February 2021 working paper to investigate extending standard reporting of NEET to include all working age persons 15-64 years of age. A new three-category classification is proposed for the working age NEET population. The authors highlight the importance of collaborative data integration projects for social policy design and development.

01/02/2021 - Not in Employment, or Training (NEET): More than a Youth Policy Issue
This working paper uses analysis from this project to suggest that standard reporting misses out on information concerning 80 per cent of the working age NEET population in Australia. Combined with other demographic insights, these results have implications for welfare policy, and indicate a wider range of demographics should be considered under the NEET classification. This may also have implications for international reporting.

23/08/2017 - Microdata: Australian Census Longitudinal Dataset with Social Security and Related Information, experimental statistics, 2006-2011 (cat. no. 2085.0)
This experimental statistical release brings together data from the Department of Social Services' Social Security and Related Information with the 2006-11 ACLD. This publication provides information about the microdata available in TableBuilder and DataLab, and selected analytical insights including two infographics.

Back to top of the page