Australian Bureau of Statistics
1504.0 - Methodological News, Sep 2003
Previous ISSUE Released at 11:30 AM (CANBERRA TIME) 27/02/2004
|Page tools: Print Page Print All RSS Search this Product|
CONVERTING MAIL SURVEYS TO CATI: FORM DESIGN AND TESTING
A testing strategy was developed to address these concerns and was implemented in a very short period. An expert review process continued throughout the development. Three different scripts were developed to address the wording and notes concerns. These scripts were tested as paper telephone interviews on randomly assigned groups of live respondents who were excluded from the main survey. The results were compared across scripts and with previous survey and testing results of the paper form. The main findings were that each option in lists did not need to be reworded into a separate question and that some basic questions could be open-ended. A final script combining the best parts of the three was tested again to ensure the new questions and notes worked.
At the same time a rough prototype was developed in Blaise. An informal user review of two different layout options was conducted. Individual users went through both versions and their behaviour and comments were recorded. The main findings emphasised the need to have layout follow a normal reading path down the screen. The final script was incorporated into the next prototype. An informal group run-through of the instrument was conducted and then formal useability testing. One by one, each operator who would be using the CATI phoned a pretend respondent and went through an entire interview. They were observed and debriefed. This allowed examination of the words, layout, navigation and sequencing all together. It was also excellent training in the instrument for the operator.
This process ensured not only an effective new data collection instrument, but a group of users who had contributed to the development of it and were therefore satisfied with the final result.
For more information, please contact: Emma Farrell on (02) 6252 7316.
These documents will be presented in a new window.
This page last updated 14 September 2007