Have an idea?

Visit Sawtooth Software Feedback to share your ideas on how we can improve our products.

Including an orthogonal factorial experimental design (CVA)

Dear all,
first, I have to appologize, I'm a CA newbie.

I have designed CVA with 4 attributes each of them having 2 levels.
I'm doing single concept tasks and want to reduce my 16 tasks (according to Hahn & Shapiro) to 8 questions.
Within the design settings, I can chose the number of tasks, but I'm unsure whether the idea behind the d-efficency is based on the concept of orthogonal factorial experimental design by Hahn & Shapiro.

Furthermore I want to include a practice questions, displaying the task which should not be included within the task itself (so I would create 9 questions). Any suggestions how to implement such a practice profile? Currently, I'm thinking about prohibiting one combination which should represent my practice profile.

Hope for your ideas and feedback
asked Jan 19, 2016 by sth88 (145 points)

1 Answer

0 votes
Designs with 100% D-efficiency in CVA are both perfectly orthogonal and level balanced (equal number of exposures per level within each attribute).  Note that orthogonal arrays (from Hahn and Shapiro) aren't always level balanced within each attribute (for example, with an asymmetric design where the number of levels differs across attributes).  

Note that with our latest CVA software, it by default assumes you want to generate multiple versions of the questionnaire, where each version is as close to 100% D-efficient as it can get.  This is good such that different respondents often get different concept arrays, which helps control for psychological order & context effects.

To add practice (throw-away) tasks prior to your real tasks, I suggest exporting your already generated questionnaire design with 8 tasks to .csv file (from the Design tab).  Then, modify the .csv file so that you add 1 or 2 practice tasks to the beginning of the questionnaire, meaning that your .csv file now supports 9 or 10 tasks.

Now, change your CVA project within SSI Web to have either 9 or 10 tasks total, matching your modified .CSV file.  Now, use the Import capability on the Design tab to browse to the modified .CSV file and read it into your CVA project.

Now, when you compute utilities you can omit the first 1 or 2 tasks as warm-ups, but the remaining 8 tasks are the orthogonal, highly efficient design.
answered Jan 19, 2016 by Bryan Orme Platinum Sawtooth Software, Inc. (142,815 points)
...