# Reporting RLH and Percent Certainty

Hello,

as there seem to be differences in the RLH and Percent Certainty values of the HB estimation monitor and the respective values computed from the reports, I am wondering which ones to include in my thesis as goodness of fit measures.

Can I just use the average values given on the monitor after the computation has been completed or should i rather calculate them from the reports?

Best regards,
Colin

+1 vote
The on-screen reporting of RLH and Percent Certainty use an exponential smoothed average, where the most recent iterations have more weight than earlier results.  It's useful to have the exponential moving average to plot trend and "see" where the HB results are moving to.

For final summary of fit statistics, I recommend computing RLH and Percent Certainty from the saved draws (after discarding the first, say, 5K or 10K iterations as not yet converged).
answered Jul 17, 2017 by Platinum (154,105 points)
thanks Bryan! does this mean I have to check the "Save draws" option before HB estimation and use the draws excel file? I tried this and chose 10 as a skip factor but somehow the file contains all 10,000 draws per respondent.
I think what went wrong for you is that you also need to change the "Number of draws to be used for each respondent" from 10000 to 1000.  Continue to use skip factor of 10.

But, the more I think about it, the RLH that is stored in the standard "point estimates" file is the average of the draws for each respondent.  So, since you are just trying to summarize the average RLH across the draws across the respondents, you might as well just use the RLH found in the point estimates for each respondent and average across those.  Should yield the same answer.
thanks for the answer! do you mean the individual RLH values in the exported utilities file? Should i take the normal arithmetic mean or the geometric mean of these to get the overall RLH?
Arithmetic mean.
Thanks! I want to follow the procedure outlined in your post https://sawtoothsoftware.com/forum/4035/conversions-rlh-into-percent-certainty-and-log-likelihood.
However, I have a dual response none option and 14 random tasks. You said this would be more nasty, should I take 14 or 28 as the number of tasks? Best regards!