Sawtooth Software: The Survey Software of Choice

Best Practices for Calculating Importance Scores

In reading a Sawtooth Software article, The Basics of Interpreting Conjoint Utilities, it said, “When summarizing attribute importances for groups, it is best to compute importances for respondents individually and then average them, rather than computing importances using average utilities.” I would like to understand the implications from the two procedures. I tried to calculate in both ways and found that, at least in my example, the most important and the least important attributes are the same from both procedures; however, the remaining attributes in-between have different scores and rank orders. Mathematically, it seems to me both procedures are valid, but I am not sure how to interpret the differences in the results and why one would be better than the other.

Imagine that you do a study that has two attributes: Brand and Price. Imagine the two brands are Coke and Pepsi, and the two prices are $1.00 and $2.00. Imagine that brand is critical to the respondents (more so than price) and that half the respondents love Coke and the other half love Pepsi.

Now, if you compute the importance scores based on average utilities, the average utilities for Coke and Pepsi are tied, so the importance of price will be shown to be 100% and brand 0%. This is obviously wrong, as differences in opinion regarding brand across the sample have caused the signal for brand to wash out in the average.

If utilities are computed at the individual level and the importance scores are computed at the individual level, then it will clearly capture the fact for each respondent that brand is critical (despite the differences in opinion).

Sawtooth Software

6:30 AM to 5:30 PM Mountain Time
(GMT-6; GMT-7 Autumn/Winter)
Monday through Friday

Phone: +1 801 477 4700
Fax: +1 801 434 5493

SKIM Software

9:00 AM to 5:30 PM Central European
(GMT+2; GMT+1 Autumn/Winter)
Monday through Friday

Phone: +31 10 282 3500
Fax: +31 10 282 3560

We're open!

Lighthouse Studio

Lighthouse Studio is our flagship software for producing and analyzing online and offline surveys. It contains modules for general interviewing, choice-based conjoint, adaptive choice-based conjoint, adaptive choice analysis, choice-value analysis, and maxdiff exercises.

Try Lighthouse Studio

  Buy Lighthouse Studio