|Page tools: Print Page Print All|
USE OF TRANSACTIONS DATA IN THE AUSTRALIAN CPI
FIGURE 15.1 THE 'CHAIN DRIFT' PROBLEM
15.7 The limitations of traditional bilateral index formulae have motivated research by NSOs and academics into new methods for compiling price indexes from transactions data. Typically, multilateral index methods have been used in the spatial context to compare price levels across different geographic regions, however academics and NSOs are proposing they be used to make price comparisons across multiple (three or more) time periods. Multilateral methods have a number of advantages for temporal aggregation including:
b) Weighting products at the product and elementary level by expenditure share;
c) Price indexes that are free of 'chain drift'; and
d) Reduced resources to produce indexes.
METHODS FOR COMPILING TRANSACTIONS DATA
15.8 Multilateral methods possess a number of desirable qualities, both theoretical and practical, to produce temporal price indexes from transactions data. The following details the practical and methodological decisions for aggregating transactions data in four sub-sections: aggregation structure, multilateral method, extension method and multilateral window length. This discussion returns to the framework established in the Information paper: Making Greater Use of Transactions Data to compile the Consumer Price Index (cat. no. 6401.0.60.003) which linked the ABS Data Quality Framework (DQF) to six main criteria for an NSO to evaluate different multilateral methods (Table 15.1).
15.9 The definition of a homogeneous product where the calculation of a unit value occurs remains largely consistent with previous practices in the CPI. The ABS defines products using product classifications provided by Australian proprietors known as the stock keeping unit (SKU). The unit value is calculated using expenditure and quantity information across all stores from the same proprietor for each capital city in Australia (e.g. SKU ‘xxx’ from Company 1 for Sydney).
15.10 The unit value is calculated on a quarterly frequency to align with the publication frequency of the Australian CPI. The quarterly unit value is calculated using approximately 2.5 months of revenue and quantity data in order to meet the timeliness constraints for publication - this is consistent with current ABS and international practices. This calculation of quarterly unit values differs slightly with previous CPI practice, where unit values were derived at both monthly and quarterly frequencies. Research has shown that the unit value calculation should align with the publication frequency of the CPI (Diewert, Fox and de Haan 2015).
15.11 The calculation of the unit value should occur across products that are considered equivalent from the perspective of a consumer. Research by other NSOs has shown that matched model multilateral indexes can have a downward bias if price increases are missed when the same item is ‘relaunched’ using a different product identifier (Chessa 2016). The issue of relaunches is a known problem when identifying products using barcodes for certain commodities, while the choice of a broader product definition such as SKU (which is an aggregation of multiple barcodes) should mitigate this problem. The ABS will continue to monitor the suitability of defining products using the SKU.
15.12 In order to maximise the use of transactions data using multilateral methods, the ABS has modified the aggregation structure below the published (EC) level. Figure 15.2 details the aggregation structure implemented in the CPI, which uses respondent classes as elementary aggregates (EAs) when these are available from transactions datasets. The direct Törnqvist index formula is used to aggregate respondent EAs together to compile ‘Respondent x EC’ price indexes in order to capture changes in consumer expenditure patterns overtime. ‘Respondent x EC’ indexes are weighted by expenditure (market) share using the Lowe Index formula, with weights being reviewed on an annual basis using both transactions and other data sources.
FIGURE 15.2 AGGREGATION STRUCTURE FOR TRANSACTIONS DATA ECS
15.13 The index structure described in Figure 15.2 includes contributions from transactions data respondents only. The 28 ECs that have this index structure are provided below in Table 15.2. The motivation to compile these ECs using transactions data only is based on evidence of high expenditure (market) share, as well as the resources required to maintain a high quality non-transactions data index component.
15.14 In recent years there has been an increase in the range of multilateral methods proposed for use in CPI aggregation when using transactions data. The Information paper: Making Greater Use of Transactions Data to compile the Consumer Price Index (cat. no. 6401.0.60.003) outlines research by the ABS into four multilateral methods considered for implementation into the Australian CPI(footnote 1) . These methods were:
15.15 Testing the different multilateral methods in practice, the ABS found little difference in the empirical results generated from each different multilateral method. Comparing the different methods to the framework described in Table 15.1, the ABS preferred method for compiling price indexes using transactions data is the GEKS-Törnqvist. The two main criteria that differentiate the GEKS-Törnqvist from the other multilateral methods are its theoretical properties (economic approach to index numbers) and interpretability (based on bilateral index number theory). To remedy the sensitivity of the GEKS-Törnqvist to products with atypical prices and small quantities (clearance prices), the ABS uses filters to remove these products from index compilation. The exclusion of products at clearance prices is consistent with current practices adopted in the CPI.
15.16 The GEKS-Törnqvist method takes the geometric mean of the ratios of all bilateral Törnqvist indexes (calculated using the same index number formula) between a number of entities. For spatial indexes these entities are generally countries, while for price comparisons across time, the entities are time periods.
15.17 The bilateral index formula chosen for the Australian CPI is the Törnqvist index which can be expressed as:
= Törnqvist index between periods 0 and t
= price of item i in period t
= price of item i in period 0
= average expenditure share of item i across periods 0 and t
15.18 The GEKS-Törnqvist is calculated as the geometric mean of the ratios of all matched-model Törnqvist bilateral indexes ( and ) where each period is taken in turn as the base (de Haan 2015). The GEKS-Törnqvist method can be expressed as:
= GEKS index between periods 0 and t
= Törnqvist index between periods l and 0
= Törnqvist index between periods l and t
15.19 An example of calculating the GEKS-Törnqvist index across a three period multilateral window is provided below in Figure 15.3. Each row in the figure (or ratio term in the brackets) uses a Törnqvist index to measure price change between periods 0 and 1, where the base period changes for each row (ratio) whilst the comparison period remains constant. The GEKS then takes the geometric average of these three measures of price change between periods 0 and 1.
15.20 When multilateral methods are used to produce a temporal index, each bilateral price comparison depends on prices observed in other periods of the multilateral comparison window. As a result, incorporating a new period into the multilateral comparison window may revise previous price indexes, which is unacceptable for CPI purposes. To resolve this, researchers and NSOs have developed methods for using the latest multilateral index incorporating the latest data to update the published index series.
15.21 The ABS has considered a range of methods for extending the time series. These can be characterised into the following two groups(footnote 3) :
= price movement between the splice period s and t based on the current multilateral window
= price movement between s and t-1 based on the previous multilateral window
15.22 While each of the rolling window methods above uses one specific splice period, Diewert and Fox (2017) have endorsed a mean splice rolling window method - initially proposed by Ivancic, Diewert and Fox (2011) - which involves extending the index using the geometric mean of the indexes produced from all possible choices of splice period. Using the notation above, the mean splice extension can be expressed algebraically as:
where the multilateral window length is T+1 periods, so the current and previous periods overlap between t-T and t-1.
15.23 The ABS has chosen the mean splice motivated by the following factors:
15.24 An example of the mean splice is provided below for a rolling window (length of five periods), where the price movement between periods four and five is estimated by taking the geometric mean of all ratios of GEKS indexes where each common splice period between window one and window two is taken in turn as the base (i.e. one, two, three and four). It can be shown that the mean splice effectively makes a small implicit revision to price movements early in the current window and a large implicit revision to price movements later in the current window. This mitigates the effect of both new and disappearing products, similar to the half splice.
FIGURE 15.4 MEAN SPLICE ACROSS ROLLING MULTILATERAL WINDOWS
Multilateral Window Length
15.25 The decision to implement a multilateral method requires an NSO to specify the number of time periods used for price comparisons. Most research involving rolling window approaches has recommended a minimum of one year and one period (i.e. five quarters, 13 months) to account for products seasonal availability, though there is currently no consensus on the optimal length of the multilateral window.
15.26 The choice of multilateral window length is a trade-off between two criteria - characteristicity and transitivity. If the multilateral window is too long, then the index could suffer from a loss of characteristicity where price change in the past may disproportionally impact recent inflation estimates. If the multilateral window is too short, the index may suffer from the ‘chain drift’ problem. Empirical testing of different window sizes is necessary to assist with this decision.
15.27 The Information paper: Making Greater Use of Transactions Data to compile the Consumer Price Index (cat. no. 6401.0.60.003) presented results that used a window size of two years and one period (i.e. nine quarters) as the preferred window length - this was based on empirically testing various estimation windows compared to each other (as well as their proximity to different ‘full’ reference price series). Empirical testing by the ABS showed that varying the length of the estimation window generally made little difference to the price series generated. The multilateral window length is two years and one period.
CONSULTATION AND FUTURE DIRECTION
15.28 The ABS undertook broad consultation regarding the implementation of multilateral methods to compile the Australian CPI. This commenced with the release of the Information paper: Making Greater Use of Transactions Data to compile the Consumer Price Index (cat. no. 6401.0.60.003), published 29 November 2016. Following this paper, the ABS sought user and stakeholder input to resolve the outstanding methodological challenges.
15.29 The ABS has collaborated with international experts and NSOs to resolve outstanding methodological issues. Additionally, the ABS conducted bilateral and multilateral consultations with key stakeholders, including: the Reserve Bank of Australia; the Treasury; Department of Social Services; Department of Finance; Department of Prime Minister and Cabinet; and State Treasuries. In all instances, experts, NSOs and stakeholders were supportive of maximising the use of transactions data to compile the CPI using multilateral methods.
15.30 The ABS will continue to monitor methodological developments in the use of transactions data to compile price indexes, as well as continue to conduct research into remaining practical issues including text mining, hedonics indexes, automated text mapping and the use of multilateral methods for aggregating prices ‘web scraped’ from online.
Australian Bureau of Statistics (ABS) 2016. Making Greater use of Transactions Data to Compile the Consumer Price Index. cat. no. 6401.0.60.003. ABS, Canberra.
Chessa, A. G. 2016. A new methodology for processing scanner data in the Dutch CPI. Eurostat review of National Accounts and Macroecnomic Indicators, 1, 49-70.
Diewert, E. W. 1995. Axiomatic and Economic Approaches to Elementary Price Indexes. Discussion Paper No. 95-01; Department of Economics, University of British Columbia.
Diewert, E. W., Fox, K. J. & de Haan, J. 2016. A newly identified source of potential CPI bias: Weekly versus monthly unit value price indexes. Economics Letters, 141, 169-172.
Diewert, E.W. & Fox, K.J. 2017. Substitution Bias in Multilateral Methods for CPI Construction using Scanner Data. Discussion Paper No. 17-02; Vancouver School of Economics, University of British Columbia.
de Haan, J. 2015. A Framework for Large Scale Use of Scanner Data in the Dutch CPI. Paper presented at the fourteenth Ottawa Group meeting. Tokyo, Japan.
de Haan, J. and van der Grient, H. 2011, Eliminating Chain Drift in Price Indexes Based on Scanner Data, Journal of Econometrics 161, 36-46.
International Labour Organization (ILO) 2004. Consumer Price Index Manual: Theory and practice, International Labour Office, Geneva.
Ivancic, L., Fox, K. J. & Diewert, E. W. 2011. Scanner data, time aggregation and the construction of price indexes. Journal of Econometrics, 161, 24-35.
1 Section 2 of Information paper: Making Greater Use of Transactions Data to compile the Consumer Price Index (cat. no. 6401.0.60.003) provides a more detailed explanation of these multilateral methods. <back
2 This method is also known as CCDI attributed to the authors Caves, Christensen and Diewert (1982) and Inklaar and Diewert (2017). <back
3 Section 3 of Information paper: Making Greater Use of Transactions Data to compile the Consumer Price Index (cat. no. 6401.0.60.003) provides a more detailed explanation of these extension methods. <back
These documents will be presented in a new window.