This is not the latest release View the latest release

Administrative data

Labour Statistics: Concepts, Sources and Methods
Reference period
2021
Released
15/02/2022

The ABS regularly uses administrative data to support the collection of data in business and household surveys. The ABS also uses combined data assets, such as those supplied by the Australian Tax Office (ATO), to develop labour statistics to provide unique insights into the Australian labour market from both a jobholder and employer perspective:

More granular demographic and employer characteristics are available in these statistics than in survey based outputs, providing detailed insights into jobs, jobholders, wages and income.

ATO administrative data assets used in the generation of these labour statistics include:

  • Australian Business Register
  • Business taxation information (BIT) for owner managers of un-incorporated enterprises
  • Client Register (CR)
  • PAYG payment summary
  • Personal Income Tax return (PIT)
  • Single Touch Payroll (STP)

Differences from traditional collection methods

Administrative datasets are not typically designed with statistical production in mind. The underlying concepts relate to administrative policy or procedures, rather than statistical constructs. This can result in coverage, definition and quality differences compared to survey based outputs.

Administrative data can cover large populations in more detail and therefore provide different levels of insight than traditional collection methods. However, administrative data can capture very specific populations or sub-populations, compared to surveys which collect information from a representative sample of the population.

While more detailed statistics are available, the estimates may present unique views of the population, particularly where adjustments are not applied to broaden the population represented.

In addition to more variable reporting quality, administrative datasets are significantly larger than those obtained from business and household surveys. The timeliness of outputs is weighed against the quality assurance of individual records. As such, the increased speed of statistical production may require macro level adjustments to address anomalous reporting (such as in WPJW). Where more time and information are available to resolve anomalous records, micro level adjustments may be in use.

Producing statistics from administrative data requires an alternative approach to processing and quality assurance than those used in survey based statistics. However, administrative datasets are an increasingly valuable source of new data, providing a rich variety of alternative insights into the labour market.

More information on the methodologies supporting the current suite of Labour statistics derived from administrative data can be found in the respective statistical releases: Jobs in Australia; Personal Income in Australia; and Weekly Payroll Jobs and Wages in Australia.

Linked Employer-Employee Dataset (LEED)

The Linked Employer Employee Dataset (LEED) is a cross-sectional database which is built using Australian Tax Office (ATO) administrative data linked to ABS Business Longitudinal Analytical Data Environment (BLADE).

The LEED enables simultaneous analysis of met supply and demand in the Australian labour market, through:

  • providing supplementary labour statistics and facilitates labour market research at industry and regional levels.
  • enabling analysis of the Australian labour market at macro and micro levels;
  • enabling analysis of how specific events impact employees and employers;
  • helping to understand structural changes in the labour market.

The LEED consists of three cross-sectional files:

  • a person file;
  • a jobs file; and
  • an employer file.

    The LEED associates information about a person with information about their employing business. This is done by establishing the existence of a job. An employed person can have one or more jobs throughout the year with one or more employers, some of which may be held concurrently with others. A job can be created either by an employing business or the personal enterprise of the individual (an owner manager).

    LEED overview

    Scope

    The LEED contains information for all persons who interacted with the Australian taxation system with reference to financial years after 2011-12. The LEED includes data for all persons who either:

    • submitted an individual tax return (ITR); or
    • individuals who had a Pay As you Go (PAYG) payment summary issued by an employer and then remitted to the ATO.

    Employees who did not submit a tax return and have not provided their Tax File Number to their employer will not appear in the LEED. Owner managers of unincorporated enterprises (OMUEs) who did not submit an ITR are also excluded.

    The LEED includes all employers present on the BLADE who have at least one employee linked to them. Some small businesses are excluded from the BLADE (e.g. those that do not meet the turnover threshold at which they must register for Goods and Services Tax) and do not appear on the LEED. Synthetic records are created for these records where they are both unincorporated and owned by an Owner Manager of an Unincorporated Enterprise present on the LEED.

    The LEED includes all sources of income, regardless of whether the income provider resides within Australia's economic territory.

    Integration methodology

    Initial data cleaning is undertaken to remove duplicate and erroneous records. In particular, job records are repaired to minimise the impact of administrative noise on output statistics, such as annual payment summaries issued in two separate parts.

    Before the linkage takes place, an input job level file is created largely based on the PAYG payment summary file. This file is also enhanced with job records derived using ITR information, to cover jobs without payment summary information, such as OMUE jobs. Data quality is enhanced by using occupation information from ITR, and the best available age, sex, and geographic information between the PAYG, ITR and CR data.      

    Jobs are integrated with the employer by one of two methods. The method is dependent on which ABS Business register population the employer is grouped into.

    Non-profiled population (businesses with a simple structure): a deterministic approach using the Australian Business Number (ABN).

    Profiled population (businesses with a complex structure): a more detailed approach to linking is used, detailed below.

    Where an employer is part of the profiled population, the relevant jobs are assigned to the type of activity units based on a logistic regression model developed using 2016 Census data. The model references independent variables common to both Census and personal income tax data, including sex, age, occupation, and region of usual residence. These are used to predict the industry of employment, which conceptually aligns to a type of activity unit. 

    Where an employee has multiple job relationships with the same reporting ABN in an enterprise group, each job relationship is assigned to the same type of activity unit.

    Based on the model, each job record is assigned a probability of being in any of the type of activity units present in the employing enterprise group. Iterative random assignment is undertaken using these probabilities until employment benchmarks are met. Benchmarks are based on Quarterly Business Indicators Survey (QBIS) data where a unit is in scope. Otherwise, BLADE employment levels are substituted where possible, otherwise no benchmarking is done.

    The above process is applied to link the different input datasets for each financial year. Records have not been integrated across years and therefore, the LEED is a cross-sectional database and is not longitudinal.

    Legislative environment

    The LEED incorporates:

    • person level ITR data, job level PAYG payment summary data and Client Register data supplied by the ATO to the ABS under the Taxation Administration Act 1953 - which requires that such data is only used for the purpose of administering the Census and Statistics Act 1905; and
    • employer level data that include the ABS's BLADE data and the ABS Business Register data supplied by the Registrar of Australian Business Register (ABR) to the ABS under A New Tax System (Australian Business Number) Act 1999 - which requires that such data is only used for the purpose of carrying out the functions of the ABS. 

    The data limitations or weakness outlined here are in the context of using the data for statistical purposes, and not related to the ability of the data to support the ATO's or ABR's core operational requirements.

    Legislative requirements to ensure privacy and secrecy of these data have been followed. In accordance with the Census and Statistics Act 1905, results have been confidentialised to ensure they are not likely to enable identification of a particular person or organisation. All personal information is handled in accordance with the Australian Privacy Principles contained in the Privacy Act 1988.

    ABS data integration practices comply with the High Level Principles for Data Integration Involving Commonwealth Data for Statistical and Research Purposes.

    The LEED is comprised of a person file, a job file and an employer file

    The LEED is comprised of a person file, a job file and an employer file
    Figure 1 gives an overview of the LEED and shows how it is cross-sectional database. It is comprised of a person file, a job file and a business (employer) file. The LEED includes person and employer level information provided to the ABS by the ATO and the Registrar of the Australian Business Register (ABR). LEED uses this data via the Business Longitudinal Analysis Data Environment (BLADE). The persons filed classifies persons as either not employed or employed. The jobs file is a complete list of the job relationships held at any time during the reference year. Whilst the employer file contains all employers in a job relationship with someone on the person file at any point during the reference year.

    Person file

    Each person file contains data for all persons who either submitted an Individual Tax Return (ITR) or who were identifiable on a payment summary in the reference year. Each record includes de-identified demographic and geographic data, and aggregate income information.

    Employed persons may be either employees (including Owner Manager of Incorporated Enterprises or OMIEs), Owner Managers of Unincorporated Enterprises (OMUEs), or both. Employees are identified by the presence of aggregate employee income and at least one linked employee job.

    Employees who have not submitted an ITR but who have provided their Tax File Number to their employer are imputed from Pay As You Go payment summary data.

    OMUEs are identified by the presence of any of the own unincorporated business income types and a linked OMUE job.

    Tax lodgers who are not employees or owner managers (such as persons with only investment incomes) are included on the person file to support statistical analysis that requires a more complete view of the tax lodger population.

    Jobs file

    The jobs file is a complete list of the job relationships held at any time during the reference year. It is constructed primarily from Pay As You Go (PAYG) payment summary data. PAYG payment summaries describe the payments made to an individual by an employer within a financial year. Conceptually, payment summary data should include most employee/employer job relationships. OMUE jobs are derived from ITR data and are added to the jobs file, some of these link to businesses in the Business Longitudinal Analysis Data Environment (BLADE).

    The LEED jobs file does not capture voluntary jobs and unpaid contributing family worker jobs.

    In some cases a synthetic employee job record has been created based on information in the person file. This has occurred when a person has recorded wage or salary information that cannot be identified in payment summary data. Sometimes, an employee job may not be able to be linked to an employing organisation due to reporting errors or missing information.

    A person can hold several jobs during the year, either concurrently (as a multiple job-holder) or consecutively. For a person who is an employee of several employers, each relationship is listed as a separate job. Due to data limitations, only one self-employment job can be recorded for any OMUE even if a person owns and manage more than one enterprise. An OMUE can hold other jobs as an employee.

    Data on multiple job holders can also be found in the Labour Account Australia, however there are a number of differences between the two sources.

    PAYG payment summary start and end dates are used to

    • determine the start and end of a job relationship,
    • identify concurrent job-holding, and
    • determine the duration of the job.

    These dates are known to have high measurement error rates, which are likely to inflate job and concurrent job counts. Some of this error may be due to misinterpretation and recording errors, but it is also expected that payroll system and report design have an influence.

    Some treatments have been applied to address over counts of jobs or concurrent job-holding, including:

    • In cases where a person has received several PAYG payment summaries from the same employer, and the time between the end of the first payment summary and the start of the next payment summary is 31 days or less, this is counted as a single job.
    • In cases where a person has received several PAYG payment summaries from different employers, they are only considered to be concurrent if they overlap by more than 31 days.
    • In cases where a person has more than 10 jobs, those within the same industry sub-division (2-digit ANZSIC industry) are counted as a single job in the 2011-12 to 2016-17 data. From 2017-18 reference year, a lower level of industry classification - those within the same industry class (4-digit ANZSIC industry), was used to collapse jobs. This change has improved data quality  but has brought in a negligible increase to the number of total jobs reported compared with reported numbers in the old approach.

    These treatments are aimed at minimising the impact of administrative errors while also reflecting a reasonably accurate view of differing job structures.

    Employer file

    In the LEED, an employer is identified when a job has been linked to any legal entity in the non-profiled population or any type of activity unit in the profiled population.

    The employer file contains business units present in BLADE that could be linked to a job, as well as unincorporated entities. Some unincorporated entities are identified in personal income tax data and are not otherwise included in BLADE or cannot be identified in BLADE. Industry and several other employer variables are not available for these unincorporated entities.

    LEED outputs

    Key outputs

    The LEED provides cross-sectional information relating to employees and owner managers of unincorporated enterprises

    Key data/series include:

    • Employed persons and their jobs (employees and owner managers of unincorporated enterprises)
    • Multiple job holders
    • Income at job and person levels
    • Regional spotlights of jobs and employed persons

    Other data includes (but is not limited to):

    For people with income:

    • Income types: Total, Employee, Investment, Own unincorporated business, Superannuation
    • Counts of earners
    • Distributional information: mean, median, quartiles, percentile ratios, gini coefficient, income share
    • Geography - region of residence (at State and Territory, Local Government Area, Statistical Area 4, 3, and 2 levels)
    • Demographic information: age, sex

    In addition, for persons with jobs:

    • Counts: Employed persons, Jobs, Employees, Owner-Managers of Unincorporated Enterprises, Multiple job holders
    • Status in employment: Employee, Owner-manager of Unincorporated Enterprise
    • Income: Employment, Employee, Own Unincorporated Business, Duration adjusted income per job (annualised)
    • detailed occupation and skill levels of persons
    • detailed industry of job
    • Sector (public/private)
    • Number of jobs held (employee jobs and owner manager of unincorporated enterprise jobs)
    • Duration of jobs
    • Concurrent and non-concurrent jobs

    Information relating to employers:

    • employment size
    • detailed industry of business activity
    • type of legal organisation (TOLO)
    • institutional sector (SISCA)

    Statistical releases

    LEED data is disseminated through the publications listed below. Additional data is available through Customised Data Requests.

    Jobs in Australia
    Frequency: Annual, from 2011-12
    Jobs in Australia (JIA) provides aggregate statistics from the Linked Employer-Employee Dataset. It provides information about filled jobs in Australia, the people who hold them, and their employers. JIA provides data across 2,288 Statistical Areas as well as Local Government Areas.

    Personal Income in Australia
    Frequency: Annual, from 2011-12
    Formerly Estimates of Personal Income for Small Areas, Personal Income in Australia (PIiA) provides a comprehensive range of income indicators across small geographic areas. PIiA is now based on the LEED, ensuring better consistency with Jobs in Australia.

    Tablebuilder: Jobs in Australia
    Frequency: Annual, from 2011-12
    Release of Jobs in Australia data through TableBuilder. This enables users to build their own customised tables from the Linked Employer-Employee Dataset microdata, including for State and Commonwealth Electoral Divisions.

    Single Touch Payroll (STP)

    The Australian Taxation Office (ATO) receives payroll information from employers through Single Touch Payroll (STP) enabled payroll and accounting software each time the employer runs its payroll. The ATO provides selected employer and job level data items from the STP system to the ABS for the production of official statistics. STP replaces the need for businesses to provide a payment summary annual report or 'group certificates.'

    STP data is used to produce near real-time weekly indexes of payroll jobs and wages, including weekly changes in the number of payroll jobs, changes in wages and average weekly wages by jobs at the national, state and territory and ANZSIC industry level by selected personal characteristics, including sex and age group.

    Scope and coverage

    The scope and coverage of these estimates are largely defined and constrained by the characteristics of the data sources from which these estimates are produced. As such, users should note that not all jobs and wages in the Australian labour market are captured within these estimates.

    Payroll jobs

    Payroll jobs as reported to the ATO through STP are in scope of these estimates. All payroll jobholders regardless of age or Australian residency status are included. Persons reported via STP must hold either a Tax File Number (TFN) or an Australian Business Number (ABN).

    A payroll job is a relationship between an employee and their employing enterprise, where the employee is paid in the reference week through STP-enabled payroll or accounting software and reported to the ATO. Where an employee is paid other than weekly, the established payment pattern is used to include payroll jobs paid in weeks outside the reference week.

    Payroll jobs reported via STP exclude owner managers of unincorporated enterprises (OMUEs), which are more prevalent in the Construction and Agriculture, forestry and fishing industries. 

    Employers with 20 or more employees (large employers) commenced transition to STP reporting on 1 July 2018. Employers with less than 20 employees (small employers) began transitioning to STP on 1 July 2019. Any reporting concessions that were made available for small employers ended on 30 June 2021. At the time of this release, almost all large employers and eligible small employers are reporting through STP.

    In addition, payroll jobs reported in the Defence Industry (ANZSIC Class 7600) are excluded from these estimates by the ABS to better align with other Labour estimates.

    Wages

    The STP reported wages associated with each payroll job are in scope of these estimates. Wages are gross amounts, prior to taxation and deductions and include:

    • salary payments and allowances,
    • labour hire payments and foreign income,
    • the value of payments in kind (where a fringe benefit amount is recorded),
    • bonuses where they are reported in the same field as normal payments.

    The total wages concept broadly aligns with the Australian System of National Accounts (ASNA) definition of wages and salaries, with the exception of payments to employee's superannuation and severance and termination payments which are excluded.

    More specifically, the following STP reported income items are included in the production of wages estimates;

    • gross income amount (including bonuses),
    • allowance income,
    • fringe benefit amount (reportable, taxable),
    • fringe benefit amount (reportable, tax exempt),
    • other income (not specified),
    • foreign income amount including tax exempt income,
    • Community Development Employment Project income.

    Other data sources

    The STP data are enhanced through combining other administrative data held by the ABS (also sourced from the Australian taxation system).

    Sex, age and residential geography variables are primarily sourced from Client Register data (supplied by ATO to the ABS as part of the transfer of Personal Income Tax data). Sex can only be sourced from Client Register data. When age and residential geography are not available from Client Register data, they are sourced from STP data. The ABS receives annual snapshots of de-identified Client Register data from the ATO, for use in the production of statistics.

    Industry of activity, sector and employment size variables of the employing business are sourced from the ABS Business Register (ABSBR).  

    STP outputs

    STP data are compiled into weekly indexes of payroll jobs and wages. These are published in Weekly Payroll jobs and Wages in Australia on a monthly basis.

    Each release contains both payroll jobs and total wages indexes and percentage change movements. Estimates are available at the national, state and territory and Australian and New Zealand Standard Industry Classification (ANZSIC) division by selected jobholder and employer attributes. Australian Statistical Geography Standard sub-state regions (Statistical Area 4, Statistical Area 3 and Greater Capital City Statistical Area) and ANZSIC subdivision estimates are also updated in each release. 

    Levels for jobs and wages are not available for release at this time. The payroll jobs index provides a measure of changes in jobs over time since the week ending 14 March 2020. Information on levels for jobs are best sourced from estimates of filled jobs from Labour Account Australia and estimates of employed persons from Labour Force, Australia. More information on the relationship between payroll jobs and LFS employment is included in the Weekly Payroll Jobs and Wages methodology page.

    The data underlying these estimates are revised in each release and reflected in percentage change movements and indexes.

    The estimates are presented as an original series only. Seasonally adjusted and trend estimates are not yet available. A number of years of data will be required before seasonal patterns can be observed and adjusted for.