DataLab

Analyse the most detailed microdata in the secure DataLab for your statistical research or modelling, find out about costs and how to access

Released
4/11/2021

\(\Large ⚿\) Log into DataLab
 

What is DataLab

DataLab is the analysis solution for high-end users who want to undertake real time complex analysis of detailed microdata. Compare data services to see if detailed microdata in the DataLab is the right service for you.

Features

  • view and analyse unit record information
  • recent versions of analytical software, including R, SAS, Stata and Python
  • virtual access to files that remain in the secure ABS environment
  • all analytical output that you want to use outside DataLab are checked by the ABS before release

Who can access DataLab

Researchers who meet ABS safe people criteria, including:

  • ability to use at least one of the statistical analytical languages available in the DataLab
  • at least three years of either quantitative research experience or university study with a significant component working with quantitative data, or have a referral from an experienced researcher working on the same project
  • located in Australia when accessing the microdata
  • belong to an Australian organisation (international researchers and organisations will be considered on a case by case basis)
  • have completed ABS safe researcher training and refresher training as per ABS refresher policy
  • have completed all relevant undertakings and declarations
  • belong to an organisation with a Responsible Officer Undertaking in place with the ABS
  • have an approved safe project that is for statistical and/or research purposes and demonstrates public value
  • meet additional criteria that apply to specific microdata

Detailed microdata in the DataLab

  • designed specifically for use within the DataLab environment
  • direct identifiers (such as names and addresses) removed
  • further appropriate confidentiality applied within the context of the other security features of the DataLab
  • topics include Census, health, education, labour force, Aboriginal and Torres Strait Islander peoples, migrants, crime, business, disabilities, ageing and carers
  • datasets include ABS survey results, administrative data collected by other organisations and integrated datasets
  • data item lists are linked in detailed microdata topics in the DataLab

Limited release detailed microdata in the DataLab

Some datasets have been released on a limited basis. This includes BLADE and custom MADIP detailed microdata, which are available for approved projects to the following approved users:

  • government employees
  • government contractors and individuals sponsored by government
  • academics
  • researchers from public policy research institutes

Cost

Approved users can access standard detailed microdata in DataLab for approved projects. This includes:

  • ABS survey and census collections
  • Data ABS has collected from other organisations (with custodian approval)
  • Integrated microdata such as:
    • Multi-Agency Data Integration Project (MADIP) modular product
    • Business Longitudinal Analysis Data Environment (BLADE) Core plus BLADE standard module (various ABS surveys), Intellectual Property Longitudinal Research Data (IPLORD) and Merchandise Imports and Exports
    • MADIP/BLADE linked data

Additional charges apply for customised data integration services.  

DataLab charges - 1 July 2022 to 30 June 2023

Standard DataLab access incurs an annual fee. This fee is based on the number of users with virtual machine access in a project. The fee covers annual costs of: 

  • Project establishment and ongoing administration
  • Standard virtual machine access for users
  • Standard software access for users (e.g. R, Python, Stata)
  • Changes to users and discussants within a project
  • Project storage

Charges for new projects commencing within the 2022-23 financial year will be calculated quarterly, based on the timing of the project commencement. These costs will be charged at the commencement of the project.

For example, for a project commencing in October 2022, charges for the annual fee, use of SAS and use of machines above large will be calculated on the basis of three quarters of the 2022-23 financial year. 

Type of userAnnual fee (per project)

Government (Commonwealth, State and Territory, Local)

GST not applicable

$2,000 up to 5 users with standard virtual machine access
$4,000 up to 10 users with standard virtual machine access
$10,000 up to 25 users with standard virtual machine access

  • Individual quotes will be prepared for projects with over 25 users 
  • An increase in the number of users with virtual machine access to the next tier will incur an additional charge
    E.g. If a project increases from 5 to 6  users, a charge of $2,000 will be incurred, equivalent to the next tier
  • Users need to be removed from project proposals to avoid moving to next tier
  • Changes in project scope will result in establishment of new project
  • The annual project fee will be waived for all existing projects for 12 months, with charges applicable from 1 July 2023
  • Non-standard charges applicable (see table below)

Approved non-government researchers (including public policy research institutes and academics not covered by the ABS/Universities Australia agreement)

GST applicable

$2,200 up to 5 users with standard virtual machine access
$4,400 up to 10 users with standard virtual machine access
$11,000 up to 25 users with standard virtual machine access

  • Individual quotes will be prepared for projects with over 25 users 
  • An increase in the number of users with virtual machine access to the next tier will incur an additional charge
    E.g. If a project increases from 5 to 6  users, a charge of $2,200 will be incurred, equivalent to the next tier
  • Users need to be removed from project proposals to avoid moving to next tier
  • Changes in project scope will result in establishment of new project
  • The annual project fee will be waived for all existing projects for 12 months, with charges applicable from 1 July 2023

    Non-standard charges applicable (see table below)

Academics working on academic projects at universities covered by the ABS/Universities Australia agreement
  • Projects with up to 10 researchers are covered under the ABS/Universities Australia agreement. These projects will not be charged an annual fee for the duration of the current ABS/Universities Australia agreement
  • Annual fee applies for projects with more than 10 users
  • Non-standard charges applicable (see table below)
MADIP/BLADE enduring data custodians
  • No annual fee 
  • Very large or ongoing projects may require a Memorandum of Understanding (MOU)
  • Non-standard charges applicable (see table below)

Non-standard DataLab access charges

Annual charges per person per projectGST not applicableGST applicable
Use of SAS$500$550

Virtual machines above large (standard virtual machines are included in the annual fee and comprise machines up to and including the large size)

$6,500 (minimum)$7,150 (minimum)

Applying for and using DataLab

Step 1. Register and activate your account

Register and agree to conditions of use

  • Use your organisation email address when registering to join your organisation automatically
  • Receive an email asking you to activate your account by clicking on the link
  • If you are not sure if you have previously registered, contact microdata.access@abs.gov.au before re-registering
  • If you are a user in more than one organisation, you will need to register separately using each organisation's email address

Step 2. Submit project proposal

Project proposals

  • Projects must be for statistical and/or research purposes and provide public benefit
  • Projects must not be for compliance or regulatory purposes
  • Include the purpose and expected outcomes of your project
  • List the datasets you will be analysing and members of your research team
  • Describe your statistical and analytical experience

Contact the ABS to discuss your project requirements and data options before completing a project proposal

Project proposal templates

\(\Huge 🗎\) ABS DataLab integrated microdata project proposal.docx

\(\Huge 🗎\) ABS DataLab detailed microdata standard project proposal.docx

Step 3. Seek approval

User approval

  • You must have statistical experience or be referred by an experienced researcher on your project team
  • You must be able to use the analytical languages in the DataLab
  • You must have a commitment to protect the confidentiality of data
  • Every member of your project team who will see or discuss uncleared output (whether or not they will be using DataLab) needs to be approved

Project approval

  • Every project needs to be approved by ABS
  • Some projects also require consideration by data custodians

Step 4. Complete safe researcher training

Step 5. Submit documentation

There are legal documents you must sign before accessing microdata in the DataLab

Step 6. Access DataLab

ABS creates your DataLab account

  • We set up a DataLab account for you
  • Request input clearance for your code, notes or data that you need to be loaded for your project in DataLab
  • Use analytical software, including R, SAS, Stata and Python
  • Project work spaces can be created to allow you to work with other approved project users within DataLab

Step 7. Output clearance

Contact us when you want output cleared

  • You must not directly remove anything (data, code, notes etc.) from the DataLab
  • All analytical output that you want to use outside DataLab are cleared by the ABS before release
  • Request output clearance
  • Output will be cleared and provided to you, or you may be contacted for further information

Step 8. Publishing results

Publications

  • Publications referencing data in the DataLab must be provided to the ABS for review prior to release.
  • The ABS will consult with custodians where relevant
  • Once published, the link to the publication must be sent to the ABS.

Information and research using ABS data must be acknowledged. See How to cite ABS sources to correctly reference ABS material.

Contact us

Contact us via email at microdata.access@abs.gov.au. This email account is monitored and we will respond to your query during business standard hours, Monday to Friday.

Privacy policy

The ABS privacy policy and DataLab privacy notice outline how the ABS handles any personal information that you provide to us.

Post release changes

20/07/2022 - DataLab pricing update for 2022-23