Viewing Results of a Calibration Flow

The Calibrations page lets you see the details of any calibrations you initiated.

You can view the calibrated scores compared to the original evaluation scores, and even drill down to see the deviation/variation of specific questions.

Based on score deviations, you may decide that a form has too great a margin of error and must be edited before use, or that an evaluation was performed incorrectly.

To view the results of the calibration flow:

  1. Click the app selector icon of app selector and select My Zone. Click Calibrations.

    The calibration grid displays who initiated each calibration, and for which agent. In addition, you can see the following information:

    • Original Score: the original evaluation score. If a form was calibrated, not an agent, then the original score will be left blank.
    • Calibration Score: the average score based on all calibrated evaluations.
    • Completion Rate: how many evaluators completed their evaluations for this calibration flow out of the total distributed evaluation requests.
    • Remaining Days: the time remaining for the calibration flow to get completed.
  2. Click on a Calibration Score to view the questions for that calibration, as well as the following information:

    • Max Score: the highest possible score the question could have received.
    • Original Score: the original score for that specific question. This will be blank for form calibrations.
    • AVG Score: the average score based on all evaluations for this question. You can click on the tooltip to see a breakdown of each evaluator's score.
    • Variance: the variance displays how the average and original scores variated from the maximum score. It is calculated by comparing the baseline of the maximum score and the average and original scores of each question.