Have an idea?

Visit Sawtooth Software Feedback to share your ideas on how we can improve our products.

How do I import data from Discover into Lighthouse?

Hi,

I conducted a CBC in Discover and now I'd like to analyze the data in Lighthouse (Logit, Latent Class etc.)

How do I import the data from Discover into Lighthouse?

Thanks for your help.
asked Jun 30, 2016 by anonymous

2 Answers

+1 vote
I'm sorry, but we currently don't have an easy way for you to transition data from a Discover survey to a Lighthouse Studio project.  There is a feature in Discover that will enable you to download the survey itself (with no respondent data) to a Lighthouse Studio project file.  This feature is mainly intended for users that want to use more advanced features than Discover has, but don't want to have to write the entire survey from scratch in Lighthouse Studio.

That said, you are able to download the conjoint data from Discover.  You can do this by clicking on the "Survey Data" link on the left of your Discover survey.  Then click on the "Advanced" link on the right side of the page, and then "Export CBC Data."  This file can be imported directly into our stand-alone CBC/HB product for more advanced analysis as well as Logit and Latent Class.
answered Jun 30, 2016 by David Squire Silver Sawtooth Software, Inc. (5,730 points)
How do I download my Discover survey to Lighthouse?
+1 vote
We never intended for people using Discover to transfer their data into Lighthouse Studio (previously known as “SSI Web”), but there are two ways to go about this.  The first way I’ll describe below assumes you really do want to move the data into Lighthouse Studio.  The second way is easier and assumes you are going to use the standalone versions of CBC/HB, CBC Latent Class, and the new standalone Choice Simulator (you are licensed for all the standalone versions of these software systems, not integrated within Lighthouse Studio; if you have a CBC license within Lighthouse Studio, you just need to download the standalone versions of the software from the Downloads area of our website).

To copy Discover CBC data into a new Lighthouse Studio (previously known as “SSI Web”) CBC project:

From Discover:

1.    Click “Survey Data”

2.    At the right-hand menu, click “Advanced” and then click “Export CBC Data”. A mystudy.csv file is downloaded.  The mystudy.csv file is a comma-separated file with the following columns:  RespNum, Task, Concept, Attribute1, Attribute2 (etc.), Answer.  You can open this file in Excel.  It contains only respondents who finished all the CBC tasks.
Now, you need to modify this file.  If you included a “None” concept in your survey (most researcher’s do), then you need to delete the row representing the final concept from each choice set (it’s the concept with 0s for the attribute levels).  Use the sorting capabilities of Excel to sort the file by concept # and then to delete all these rows representing the None concept.  Then, use the sorting procedure again within Excel to resort the rows by RespNum then by Task then by Concept (a multi-level sort) to get the file back into the proper order.  Then, delete the final Answer column.  Next, you need to renumber the respondents so they go in sequence: 1, 2, 3, etc. through as many respondents as you have (note this procedure will only work if you have 999 or fewer respondents, because that’s the maximum number of design versions that Lighthouse Studio’s CBC can generate).  Save the modified mystudy.csv file.

3.    Click “Download Data” and a studyname_data.csv file is downloaded.  This file is also a comma-separated file and has a number of columns in it.  Typically, you are only interested in the columns: RespNum, mystudy_Choice1 through mystudy_Choicen (where n is the total number of tasks in your CBC study).  And, you are only interested in respondents who have completed all the CBC tasks.  Delete any respondents (rows) from this .CSV file for respondents who did not complete all CBC tasks.  Also delete the not needed columns in this file (unless you want to keep some variables for segmentation and/or weighting purposes, then don’t delete the segmentation and weighting variable columns!) and save the file as a new name called studyname_choices.csv (you will use this in a later step below).  And, you need to renumber the respondents as you did with the previous file so that the run from 1, 2, 3 etc. through as many respondents as you have.  (Make sure you didn’t change the sort order of the completed respondents before renumbering so that the respondents match up between the two files you have been modifying!).
After completing these two steps, you have two .CSV formatted files: mystudy.csv which contains the information about what product concepts the respondents saw in each choice task and studyname_choices.csv which contains the answers that each respondent (who completed the CBC tasks) gave to each choice task (plus any segmentation or weighting variables if you think you’ll need them within Lighthouse Studio).  Also, you’ve renumbered the respondents to go in sequence for both files from 1, 2, 3, etc. without skipping any successive integer.

We are going to “trick” Lighthouse studio into thinking that it fielded this study via “paper-and-pencil”.  

(Continued in next comment, because this Forum is limited to 8000 characters per post)...
answered Jun 30, 2016 by Bryan Orme Platinum Sawtooth Software, Inc. (163,315 points)
(Continued from above...)


In Lighthouse Studio (previously called “SSI Web”):

1.    Click File + New Study and create a new study name in a convenient place on your hard drive.  

2.    Click Compose + Questions to bring up the Write Questionnaire dialog and then add a CBC exercise to your study that exactly matches your Discover study in terms of the attribute list, number of CBC tasks, whether a None was included, and the number of concepts per task (not counting the None).  (Use no “Fixed Tasks”; for example if you had 17 tasks in your Discover CBC project you will specify to Lighthouse that there are 17 “Random” tasks and 0 fixed tasks).  

3.    Generate a design in Lighthouse with as many respondents as you have in the Discover files you exported (it doesn’t matter what design generation method you use since we’ll be throwing this design away and importing the design from the file you previously prepared out of Discover).  

4.    Export the design to a .CSV file by clicking Import/Export Design… and clicking the Export Design button on the next dialog.  A studyname_exercisename_Design.csv file is created in your Lighthouse Studio project folder.  It records the product definitions to be displayed in each task for each version of the questionnaire.  Browse to and open that file in Excel (note that it has the same layout as the mystudy.csv you previously downloaded and modified from Discover.  Overwrite the data  within the studyname_exercisename_Design.csv file (just the values from row 2 down; not the labels) with the design from Discover as contained in the mystudy.csv file.  Save the studyname_exercisename_Design.csv file with the new design data.

5.    In Lighthouse Studio, go back to the Design tab within your CBC exercise.  Click Import/Export Design… and then click Import Design (you’ll get a warning that you are about to overwrite your existing design, which is OK to ignore).  Browse to the studyname_exercisename_design.csv file that you previously modified.  Click Open and you receive a message that the design was overwritten with the design it found in that .CSV file.  Click OK to return to the main menu in Lighthouse Studio.

6.    Next, we need to trick Lighthouse Studio into thinking that it has fielded a paper and pencil survey and needs to import the data from that survey.  Click Field + Create Paper-and-Pencil Interviews…  then click OK.  Back within Lighthouse Studio, you will see a message “Successfully created the paper-and-pencil files…”.  Click OK to retire the dialog.

7.    Next, create the “template file” for paper-and-pencil import.  To do this, click Field + Create Accumulated Data Template File… and go ahead and accept the default file name “Accumulated Data.csv” and save it in your project folder.  Click “yes” to open that file now.  It just has a single row of labels. Do NOT change these labels!  Note that the first column is “sysRespNum”.  Copy the column of respondent numbers from your studyname_choices.csv file (that is the respondent answers file you modified from Discover) into both columns A and B in the “Accumulated Data.csv” file.  Note that this records in the file that Lighthouse Studio will be importing as paper-and-pencil data that each respondent received a version of the questionnaire with the same number as their respondent ID (respondent #1 got version #1, respondent #2 got version #2, etc.).  Then, copy the respondent answers to the CBC tasks from your studyname_choices.csv file into the remaining columns (columns “C”, “D”, etc.) in the “Accumulated Data.csv” file.  Save the “Accumulated Data.csv” file after you’ve finished pasting the Discover data into it.

8.    From the Lighthouse Studio, click Field + Accumulate Paper & Pencil Data…  Then, click the “…” button to the right of the “Paper-and-Pencil data from CBC…” field to browse to and select the “Accumulated Data.csv” file that you modified.  Click Get Data.  Close out of these dialogs and you are set to go!

Note that if you want to add other variables from your Discover survey for use as segments or weights within your new Lighthouse Studio project that you can click File + Data Management and from the Get Data tab you can click the “Merge external data…” option to browse to your studyname_data.csv file (the respondent data from Discover) and import any additional segmentation variable columns from that file.

============================================

Most of this data processing and importing mess above is avoided if you just work with the CBC/HB standalone software, the CBC Latent Class Module standalone software and the standalone Choice Simulator software that you can download from http://www.sawtoothsoftware.com/support/downloads.  

If you download and install those three packages, then from the CBC/HB software or CBC Latent Class Module you just need to directly open the original “mystudy.csv” file you download from Discover (without any modifications) and estimate your utilities.  CBC/HB creates a .hbu file that you can directly open and import using the standalone Choice Simulator software package for running market simulations.  Much easier procedure without the extra data processing steps!  (But, you won’t have a Lighthouse Studio project; you’ll have a Choice Simulator project.  Note that the simulator looks the almost exactly the same whether integrated within Lighthouse Studio or running in standalone mode).
Hi Bryan,

Wow! Thank you very much for your help!
...