Sawtooth Software: The Survey Software of Choice

ACA Paired Question Issue During Testing

I'm working with ACA and am testing out the survey but I'm noticing that in my paired questions the bests are always juxtaposed against the worst. Is this right?

It may be right, and it may not be right. There are three things you'll need to do to make sure you're testing properly.

  1. Make sure you are testing your survey and not previewing it. Only when you test the survey will it be able to pull one of the surveys created from the design algorithm. Otherwise, when you preview, it is randomly pulling in attributes and may produce the undesirable combinations you are experiencing.
  2. Ensure that your a priori relationships are set in the proper order. If your levels are (1) $50,000, (2) $75,000, and (3) $100,000, but you've defined them as best-to-worst (rather than worst to best), it may produce the undesirable combinations you are experiencing.
  3. Make sure that when you are testing the survey, you aren't just randomly picking answers. Adaptive Conjoint Analysis means that it is taking your answers into consideration when creating other questions, so if you start to randomly answer questions, it will mess up the behind-the-scenes logic and produce the undesirable combinations you are experiencing.

Sawtooth Software

6:30 AM to 5:30 PM Mountain Time
(GMT-6; GMT-7 Autumn/Winter)
Monday through Friday

Phone: +1 801 477 4700
Fax: +1 801 434 5493
Email: support@sawtoothsoftware.com

We are open!

SKIM Software

9:00 AM to 5:30 PM Central European
(GMT+2; GMT+1 Autumn/Winter)
Monday through Friday

Phone: +31 10 282 3500
Fax: +31 10 282 3560
Email: software@skimgroup.com
Online: www.skimgroup.com

Lighthouse Studio

Lighthouse Studio is our flagship software for producing and analyzing online and offline surveys. It contains modules for general interviewing, choice-based conjoint, adaptive choice-based conjoint, adaptive choice analysis, choice-value analysis, and maxdiff exercises.

Try Lighthouse Studio

  Buy Lighthouse Studio