Have an idea?

Visit Sawtooth Software Feedback to share your ideas on how we can improve our products.

ACBC - Covariates and Alternative Specific Designs

We've been looking into the merits of ACBC and have a couple of questions around how it stacks up to CBC:

Covariates
It appears like it is not possible to use covariates with the built in HB estimator. Would we have to export the data and run it in CBC/HB? And would we expect to see a similar 'improvement' in utilities, as when using covariates with CBC data?

Alternative Specific Designs
Are Alternative Specific Designs capable with ACBC? It appears not.

Thanks
asked Apr 15, 2013 by anonymous
edited Apr 15, 2013 by Walter Williams

1 Answer

+1 vote
I wonder what kind of "improvement" you are citing regarding CBC utilities and covariates.  Although covariates do seem to make the utilities more distinct across respondent groups based on the dimensions of the segments defined for the covariates, there is a good question about how much is true heterogeneity vs. overfitting.  I tend to hope and expect it is mainly true heterogeneity, but I don't doubt that there is some potential overfitting of heterogeneity even along spurious covariate dimensions.  Over and over again, there has been no benefit seen in terms of predictive validity of holdouts (whether within-sample or out-of-sample holdouts).  

Because ACBC captures much more information at the individual-level (than CBC), and therefore involves less smoothing to the hyperparameters, there has been less interest from the start in seeing covariates built into the HB engine within the ACBC system (they would seem to have less opportunity to do anything).  Right now, people can export ACBC results to the .CHO file if they really want to leverage covariates via the CBC/HB utility estimation software.

But, the next version of ACBC to probably be released in Q4 will support covariates within the ACBC software dialogs.  Plus, it will be able to do alternative-specific designs, whereas the current version of ACBC cannot.
answered Apr 15, 2013 by Bryan Orme Platinum Sawtooth Software, Inc. (160,585 points)
edited Apr 15, 2013 by Bryan Orme
...