Skip to main content

Creating Evaluation Result Report Templates

Updated today

In this guide, we'll walk you through how to configure evaluation result reports for sharing evaluation results, view reports generated for each member, and set who to share those reports with and when.

On the report template settings screen, you can configure how the report shared with members will be structured and what content will be included, all while previewing an example screen.

Creating an Evaluation Result Report Template

  • Once the evaluation is closed, you can find the [+ New Report Template] button in the Results Sharing section at the bottom of the evaluation management home.

  • [+ New Report Template] Click the button, enter the title of the report template, then click the [Create] button.

    • The report template title can be up to 50 characters.

    • If a report template with the same title already exists for this evaluation, duplicate titles cannot be used.

    • The report template name is also shared with the recipients who receive the report. For more details, please refer to the FAQ below!

  • On the report template settings screen, you can configure how the report shared with members will be structured and what content will be included, all while previewing an example screen.

    • The [Example] screen shown on the report template settings screen is a sample screen unrelated to the actual evaluation content and results.

  • For evaluations that have undergone calibration, you can configure whether to expose the grade [Calibration Comments] in the evaluation overview section of the report.

    • However, since calibration comments may contain context about grade adjustments and internal discussion details, we do not recommend exposing them in member reports. Instead, we recommend configuring it so that calibration comments for member grades can only be viewed in manager reports. This is because managers need to fully understand the background behind grade decisions in order to conduct more accurate and consistent interviews and communications with members.

Evaluation Report Overview (Evaluation Result Summary and Analysis)

  • The evaluation report overview, which summarizes this evaluation's results and is analyzed by AI, is available when an overall grade has been calculated, or when competency/performance elements have been linked and scores or grades are generated.

View detailed conditions for AI Analysis Report Overview

The evaluation report overview, which summarizes this evaluation's results and is analyzed by AI, is available in the following conditions.

  • When at least one overall grade is generated from the evaluation results

  • When the evaluation includes competency evaluation elements, and evaluation forms or score/grade-type questions for competency elements are used in at least one evaluation stage (excluding self-evaluation)

  • When the evaluation includes competency or performance evaluation elements, and evaluation forms or score/grade-type questions for each element are used in two or more evaluation forms

  • By enabling [AI Draft Text Generation] in the Result Summary and Analysis settings, AI can analyze and summarize the evaluation results for each area.

  • If [AI Draft Text Generation] is disabled, after the report is generated, the administrator can manually enter the grade result interpretation content for each target's report. (Learn more)

  • You can edit the title of the evaluation report overview and enter a description.

    • The evaluation report overview title defaults to 'Evaluation Result Summary' and can be changed as needed. (The evaluation report overview title can be up to 100 characters.)

    • The evaluation report overview description field allows you to enter report-related guidance for report recipients, such as what materials to review and how to interpret them in a given situation. (The evaluation report overview description field can be up to 5,000 characters.)

Evaluation Report Overview (Evaluation Result Summary and Analysis) — Detailed Settings

  • In the evaluation report overview settings, you can configure the following:

    • Grade Disclosure

      • You can select which overall, competency, performance, and custom grades to display in the report.

      • If no grade calculation was configured when creating the evaluation, this option will not be displayed.

      • Only grades for which grade calculation was selected when creating the evaluation can be chosen as grade disclosure options.

      • For members where the selected grade result does not exist, that result will not be displayed.

    • Score by Grade

      • You can choose whether to display scores alongside the disclosed grades.

      • If grade disclosure is not configured, this option cannot be selected.

      • If scores were disabled in the grade settings when creating the evaluation, this cannot be used.

    • Grade Result Interpretation

      • You can include an evaluation interpretation for the disclosed grades.

      • If [AI Draft Text Generation] at the top of the right panel is enabled, AI will analyze the evaluation results and automatically draft the content.

      • If [AI Draft Text Generation] is disabled, the administrator can manually write the report content in the per-target report. (Learn more)

    • Calibration Comments

      • If calibration was conducted, you can configure whether to include the comments left during calibration.

      • For members without calibration comments, the calibration comments section will not be displayed separately.

      • If calibration was conducted across multiple rounds and calibration comments were entered for each session, all comments entered per session will be displayed.

      • Calibration comments can be edited by the administrator after the report is generated and before it is shared with members.

      • Since calibration comments may contain context about grade adjustments and internal discussion details, we do not recommend exposing them in member reports. Instead, we recommend configuring it so that calibration comments for member grades can only be viewed in manager reports. This is because managers need to fully understand the background behind grade decisions in order to conduct more accurate and consistent interviews and communications with members.

  • You can include additional analysis content in the detailed settings for each evaluation element.

    • However, for members who did not participate in the evaluation for a specific evaluation element, the related results may not be included in the report.

    • The content supported for each evaluation element is as follows:

      • Overall Evaluation: Comparative Analysis

      • Competency Evaluation: Comparative Analysis, Strengths and Weaknesses Diagnosis, Self-Objectification Diagnosis

      • Performance Evaluation: Comparative Analysis, Self-Objectification Diagnosis

Detailed Guide and Settings for Evaluation Result Summary and Analysis Content

For each diagnostic/analysis content item, you can choose whether to include it in the report, and additional options will be activated based on your selection. Please refer to the information below and apply only the settings you need.

Comparative Analysis

  • Include in Report: You can configure whether to include this in the report using an on/off toggle.

  • Based on the overall grade, it provides the average score of the selected comparison group and comparative analysis results.

  • Since comparison-based feedback can actually hinder growth for members, we recommend using manager reports (reports shared only with managers).

  • When including comparative analysis content in the report, you can configure the following:

    • Comparison Group Selection: You can select comparison criteria such as the overall target average (required), organization, job function, and job level (multiple selections allowed).

    • Include Result Interpretation: You can add result explanations via AI-based automatic analysis or by having the administrator manually enter them in per-target reports.

  • Detailed Conditions

    • 'All Targets' within the comparison group selection is a required default value and cannot be deselected.

    • If you want to compare only the average of a specific group among job category, job function, or job level, you can select the comparison group according to the recommended criteria and also set the scope of comparison groups to be displayed.

    • If the comparison group has fewer than 4 members (minimum 4 required), individual members may be identifiable, so comparative analysis results for that group will not be displayed.

Strengths and Weaknesses Diagnosis

  • Include in Report: You can configure whether to include this in the report using an on/off toggle.

  • Excluding self-evaluation, this compares the averaged scores/grades of competency evaluation items received across other evaluation stages.

    • It provides the member's key strengths and areas for improvement compared to the selected comparison group.

  • When including comparative analysis content in the report, you can configure the following:

    • Comparison Group Selection: You can select comparison criteria such as the overall target average (required), organization, job function, and job level (multiple selections allowed).

    • Include Result Interpretation: You can add result explanations via AI-based automatic analysis or by having the administrator manually enter them in per-target reports.

  • Detailed Conditions

    • When creating the evaluation, score/grade-type questions must be used in the competency evaluation rubric for evaluation stages other than self-evaluation.

    • 'All Targets' within the comparison group selection is a required default value and cannot be deselected.

    • If the comparison group has fewer than 4 members (minimum 4 required), individual members may be identifiable, so comparative analysis results for that group will not be displayed.

Self-Objectification Diagnosis

  • Include in Report: You can configure whether to include this in the report using an on/off toggle.

  • By analyzing the difference in perspectives between evaluators, you can see how the member perceives their own competencies and performance.

  • When including in the report, you can select which stages to compare among the evaluation stages that participated (self, peer, upward, downward, etc.). (Multiple selections required)

  • Detailed Conditions

    • At least 2 evaluation stages must be selected, and if self-evaluation is included, self-evaluation cannot be deselected.

    • This is available when evaluation forms or score/grade-type questions have been added for each evaluation element in 2 or more evaluation form stages.

Per-Stage Evaluation Summary

In the per-stage evaluation summary, the list of 'evaluation stages' configured when creating the evaluation is displayed, and you can configure whether to include or exclude each stage in the report.

  • In the per-stage evaluation summary, you can find the following settings:

    • [Include in Report]: You can configure whether to share that stage in the evaluation result report using an on/off toggle.

    • [Disclose Evaluator Name]: You can configure whether to disclose the evaluator's name using an on/off toggle. However, this setting is not available for self-evaluations.

    • [Individual Questions and Answers]: This setting controls whether scores and comments entered during the evaluation stage are disclosed. When turned on, detailed answers such as scores and comments entered by evaluators will be included in the report.

      When turned off, all individual question answers for that stage will be hidden and will not appear in the report. Additionally, answers to private questions are excluded from the result report by default.

    • [Grade Disclosure]: You can select the type of grades to disclose (competency, performance, custom, overall).

      • Only grades for which grade calculation was selected in the per-stage evaluation form when creating the evaluation will be provided as options. If no grades were calculated, this setting will not be available.

      • For members without results for the selected grade, that result will not be provided.

    • [Score by Grade]: You can display scores alongside the grades selected in 'Grade Disclosure'.
      However, if scores are not used in that grade system, scores will not be displayed.

    • [Text Answers]: This option is available when text answers were enabled in the per-stage evaluation form when creating the evaluation.

    • [Import Settings from Another Stage]: If you want to apply the same settings as another stage, you can select the stage whose settings you want to apply via [Import Settings from Another Stage].

  • For peer evaluations, the [Responses by Question] tab aggregates and generates the report from peer evaluation content.

  • Recipients who have been shared a peer evaluation report can click the [Peer Evaluation Responses] tab in the report and view the scores/grades and comments left by each evaluator for each evaluation element in [View by Question].

  • On the right side of [View by Question], you can click on an evaluator's name to view the detailed evaluation content that each evaluator left for each evaluation element.

  • On the right side, if [Individual Questions and Answers] is turned off, in the [View by Question] tab, the individual answers left by peer evaluators for each item cannot be viewed, and only the grade or score for each evaluation element can be confirmed.

  • Recipients who have been shared the report cannot view the individual answers left by peer evaluators for each item in [View by Question] as shown in the image below, but they can click on a peer evaluator's name on the right side to view the detailed evaluation content (comments) left by each evaluator.

  • If the evaluator name disclosure has been disabled (shared anonymously), the report is shared with recipients under the name [Anonymous Evaluator] as shown in the example image below.

    • In the [View by Question] table, the name [Anonymous Evaluator] is also used, and when viewing the detailed evaluation content left by each peer evaluator, it is also labeled [Anonymous Evaluator].

  • In the per-stage evaluation summary for downward N-th stages, which can adjust the grades from the downward 1st stage evaluation, you can find different settings compared to other stages.

    • [Include in Report]: You can configure whether to share that stage in the evaluation result report using an on/off toggle.

    • [Disclose Evaluator Name]: You can configure whether to disclose the evaluator's name using an on/off toggle. However, this setting is not available for self-evaluations. If the evaluator's name is set to private, the report will only provide a view by question.

    • [Grade Disclosure]: You can select the type of grades to disclose (competency, performance, custom, overall).

      • Only grades for which grade calculation was selected in the per-stage evaluation form when creating the evaluation will be provided as options. If no grades were calculated, this setting will not be available.

      • For members without results for the selected grade, that result will not be provided.

    • [Score by Grade]: You can display scores alongside the grades selected in 'Grade Disclosure'.
      However, if scores are not used in that grade system, scores will not be displayed.

    • [Comments]: This is available when comment usage was enabled in the downward N-th stage evaluation form settings. You can use this when you want to display the comments left by the evaluator along with the grade adjustment.

  • Once you have finished configuring the evaluation report template, click the [Complete] button in the bottom right to save the template.


FAQ

In what cases can I use Comparative Analysis, Strengths and Weaknesses Diagnosis, and Self-Objectification Diagnosis content?

  • Comparative Analysis

    • Comparative analysis content (charts) is provided only for grades that have been set to disclosed, and

    • For comparative analysis, the evaluation targets in the comparison group (organization, job level, job category, etc.) must be at least 4 members.

  • Strengths and Weaknesses Diagnosis

    • Strengths and weaknesses diagnosis is only available for competency evaluations, and

    • Score/grade-type questions must be added to the competency evaluation rubric for at least one evaluation stage excluding self-evaluation.

    • For comparative analysis, the evaluation targets in the comparison group (organization, job level, job category, etc.) must be at least 4 members.

  • Self-Objectification Diagnosis

    • This is available when evaluation forms or score/grade-type questions have been added for each evaluation element in 2 or more evaluation form stages.

What should I do if the report content to be shared with managers and members is different?

  • At the bottom of the evaluation management screen, click the [New Report Template] button in the Results Sharing tab to create separate reports to share with members and managers, respectively.

What exactly are text answers?

  • When grades are used for each evaluation element in the per-stage evaluation form settings, grades/scores for the evaluation element can be automatically calculated or the evaluator can directly select a grade/score. The text answer field that is enabled at this time is what we are referring to.

Can I duplicate an evaluation report template?

  • Click the three-dot button on the right side of the created template, then click [Duplicate Template] to duplicate the template you have created.

Can I delete an evaluation report template?

  • Click the three-dot button on the right side of the created template, then click [Delete Template] to delete the template you have created.
    However, since deleted templates cannot be recovered, please delete with care.

Can I edit and review the created template before sharing it with members?

  • After creating a template, click the [Settings] button in the top right,

  • After modifying the template settings, click the [Complete] button in the bottom right to edit the created template or do a final review before sharing.

In what cases is the report template name shared/displayed to members?

  • When two or more reports have been shared, members can switch between reports by selecting the one they want to view from the dropdown at the top. In this case, the template name entered by the administrator is displayed.

  • As shown in the image below, if only one evaluation result report has been shared for this evaluation, the template name will not be displayed, and it will be shared under the name of the evaluation.

If evaluator name disclosure is set to off (sharing results anonymously), how are the evaluation results shared with the member receiving the report?

  • If evaluator name disclosure is set to off, all responses for peer evaluation, upward evaluation, downward 1st, and downward 2nd evaluations are shared with the title [** evaluation written by an anonymous evaluator].

Did this answer your question?