Dominated Pairs in ACA

How can I avoid dominated paired questions in ACA surveys?

The adaptive nature of ACA comes in part from running a regression for each paired comparison question in order to try to ask "good" trade-offs of the respondent.  Sometimes a respondent will get a dominated question (two good levels versus two bad levels) on the screen.

The two most common causes are the a priori settings for an attribute are wrong (you had 2-year, 3-year, 4-year warranty set to be Worst to Best, for example), or the person taking the survey is answering randomly.  Because of the regression, if you don't give ACA good answers, it can follow your lead and provide dominated paired comparisons.

Even with "good" answers, the rough utility estimates might be a bit noisy, so we think somewhere around 5% of the time a respondent could see a dominated paired comparison.  In these cases, the respondent can easily choose the dominated pair (probably using the extreme side of the scale), the regression will update, and it should correct the utility estimated to avoid the dominated pair in the future.  As the respondent provides more and more data, the utility estimates should get better and better and the chance for a dominated pair should go down with each (quality) answer from the respondent.

Sawtooth Software

6:30 AM to 5:30 PM Mountain Time
(GMT-6; GMT-7 Autumn/Winter)
Monday through Friday

Phone: +1 801 477 4700
Fax: +1 801 337 7410

SKIM Software

9:00 AM to 5:30 PM Central European
(GMT+2; GMT+1 Autumn/Winter)
Monday through Friday

Phone: +31 10 282 3500
Fax: +31 10 282 3560

Lighthouse Studio

Lighthouse Studio is our flagship software for producing and analyzing online and offline surveys. It contains modules for general interviewing, choice-based conjoint, adaptive choice-based conjoint, adaptive choice analysis, choice-value analysis, and maxdiff exercises.

Try Lighthouse Studio

  Buy Lighthouse Studio