Randomize Pages/Question Order

There are times in which the researcher may wish to display a series of pages or questions in random order. This is most often done to reduce response bias due to question order. Question order bias occurs when respondents answer differently to later questions because of the influence of previously answered questions. If questions are displayed in random order, question order bias still exists at the individual level. But, because individuals each receive a different question ordering, the bias is nearly eliminated when viewing aggregate results.

You can randomize the order that questions are asked within the same page. You can also randomize the order of pages. You cannot randomize the order of questions that span from one page to another, when there are multiple questions per page.

To randomize the order that questions are asked on a page:

1) Click Compose | Write Questionnaire and click the Randomize... | Questions on a Page button. From the Randomize Questions on a Page dialog, click the Add... button.

2) Select the beginning and ending question. All questions from the beginning to the ending question (including the beginning and ending questions) are displayed in random order when the questionnaire runs on a Web server.

To randomize the order of pages:

1) Click Compose | Write Questionnaire and click the Randomize... | Pages button. From the Randomize Pages dialog, click the Add... button.

2) Select any question from the first and last pages in the randomized sequence. All pages including and between the anchor questions are displayed in random order when the questionnaire runs on a Web server.

---

Example

Assume a questionnaire with the following natural question order: Q1, Q2, Q3a, Q3b, Q3c, Q4, Q5. Further assume that the Q3 series is on the same page. To randomize the presentation of the Q3 series (Q3a, Q3b, and Q3c):

2. Click the Randomize... | Questions on a Page button. Click Add..., and select the first and last questions in the series to be randomized (Q3a, Q3c). Click OK.

The possible outcomes for respondents are:

   Q1, Q2, Q3a, Q3b, Q3c, Q4, Q5.
   Q1, Q2, Q3a, Q3c, Q3b, Q4, Q5.
   Q1, Q2, Q3b, Q3a, Q3c, Q4, Q5.
   Q1, Q2, Q3b, Q3c, Q3a, Q4, Q5.
   Q1, Q2, Q3c, Q3a, Q3b, Q4, Q5.
   Q1, Q2, Q3c, Q3b, Q3a, Q4, Q5.

Each of these sequences has approximately an equal chance of occurrence.