TECHNICAL NOTE DATA QUALITY
1 Non-sampling errors may arise as a result of errors in the reporting or processing of data. These errors can be introduced through inadequacies in the collection instrument, treatment of non-response, inaccurate reporting by data providers, errors in the application of survey procedures, incorrect recording of answers and errors in data capture and processing.
2 The extent to which non-sampling error affects the results is difficult to measure. Every effort is made to minimise non-sampling error by careful design and testing of the collection instrument, the use of efficient operating procedures and systems, and the use of appropriate methodologies.
Reliability of statistics
3 When interpreting the statistics in this release, the reliability and comparability of the estimates may be affected by the following specific non-sampling errors:
- Many institutions provided estimates due to a lack of separately recorded data on R&D activity.
- Data were self-classified by institutions to Fields of research (FOR), Socio-economic objective (SEO) and Type of activity at the time of reporting. Some institutions may have experienced difficulty in classifying their R&D projects. The ABS makes every effort to ensure correct and consistent interpretation and reporting of these data by applying consistent processing methodologies.
- The estimation method for R&D related overhead costs varied across institutions and reference periods. See Explanatory Notes 11 to 13.
Revisions to previous cycle data occur on discovery of errors in the data, typically a result of the specific non-sampling errors outlined in the Reliability of statistics section above.
Revisions are only applied where the impact on:
- R&D expenditure is equal to $5 million or more; or
- Human resources devoted to R&D is equal to 25 PYE or more.
In processing 2010 data, revisions were applied to 2008 estimates. Revisions impacted three states and territories for expenditure and/or human resource effort devoted to R&D. Most significantly, revisions were applied to source of funds estimates for General university funds; this was primarily a result of data being re-categorised due to misreporting in the 2008 survey.
Users are advised to refer to the most recently released data cubes (which can be found on the Downloads
page of this release), as revisions must be taken into consideration when interpreting results, particularly when comparing estimates over time.
COMPARABILITY OF ESTIMATES OVER TIME
In addition to the non-sampling errors outlined in the Reliability of statistics section, factors which may affect the comparability of 2010 estimates with those of previous cycles are described below:
- Additional reporting requirements for Excellence in Research for Australia initiative have led to improved record keeping within higher education institutions. Since 2008, this resulted in more accurate reporting of data by a number of institutions for some R&D items included in this release.