Skip to main content

Creating Evaluations - Setting Up Grade Calculation, System & Distribution

Updated yesterday

This guide explains how to configure the grade system and other settings for calculating evaluation results.

To set up the grade system used in an evaluation, at least one evaluation element and one evaluation stage that use grades must be configured in Step 5's stage-by-stage evaluation forms.

Setting Up Grade Calculation

  • Click the [Grades to Calculate] tab to view the evaluation elements for which you enabled grade output in the stage-by-stage evaluation forms.

    • For example, if you selected to produce grades only for the [Competency] evaluation element in the Evaluation Form Settings - Top-Down Evaluation form, only [Competency Grade] will appear under Grades to Calculate.

    • Alternatively, if you selected to produce grades for the [Competency] element in the Peer Evaluation form and for the [Performance] element in the Top-Down Evaluation form, both [Competency Grade] and [Performance Grade] will appear under Grades to Calculate.

  • Under [Calculation Method Settings], you can configure how each grade will be calculated for the selected evaluation elements.

    • Reflect Top-Down Final Evaluation Grade: This means the grade result from the top-down evaluation will be used as-is, rather than calculating based on grades from each individual stage.

    • Apply Weighted Calculation to Stage Grades: Instead of using only the top-down evaluation, you can assign weights to grades from each stage (e.g., self-evaluation, peer evaluation, upward evaluation) and use the weighted result as the final evaluation outcome.

      • Note: If the evaluation does not include a top-down evaluation stage, the [Apply Weighted Calculation to Stage Grades] option is selected by default for each evaluation element.

  • If only one evaluation element exists in the stage-by-stage evaluation form, the grade from that evaluation stage is automatically selected.
    That is, as shown in the example below, if the performance evaluation is conducted only in the self-evaluation stage, the calculation method is automatically fixed to [Reflect Self-Evaluation Grade].

  • If [Grades to Calculate] is set to [Calculate Overall Grade Only], you can only configure the overall grade calculation method.

  • If you enabled the [Overall Evaluation] grade in Step 5's [Stage-by-Stage Evaluation Form] - Top-Down Evaluation Form settings, and set the overall evaluation grade to [Matrix Combination],

  • Under [Overall Grade Calculation Method Settings], you can configure whether the overall grade is calculated using weighted grades per evaluation element, or derived by combining evaluation element grades through a matrix.

Setting Up the Grade System

In the grade system, you can configure which [grades] to use when evaluating the evaluation elements and overall grade that are assessed using [grades].

If grade questions and grade usage have not been configured for even one stage in Step 5's evaluation form settings, that stage will be skipped.

  • Enable [Grade System] - [Use Different Grades per Evaluation Element] to set up a different grade system for each evaluation element.

    • For example, you can use this when you want to apply grades S/A/B/C/D for competency evaluations, and grades such as Excellent/Good/Average/Below Average/Poor for performance evaluations.

    • Note: The [Use Different Grades per Evaluation Element] feature is only available when grades are enabled for 2 or more evaluation elements in Step 5's evaluation form settings. For example, if you are evaluating both competency and performance elements but only using grades for competency and not for performance, this feature cannot be used.

  • In the grade system table, you can edit or enter grade names, descriptions, grade scores, and score ranges.

    • For example, you can use this when grade S corresponds to a score of 100, and a score of 95 or above in the evaluation results in an S grade.

    • When you enter a grade score for each grade, the grade score range is automatically filled in. If you need to modify the automatically filled score range, click on the input field and update the score.

  • If grade scores are disabled, the highest grade is treated as the maximum score.

    • For example, if a member achieves a perfect score of 5, they receive an S grade; a score of 4 or above but below 5 is treated as an A grade.

  • Click [Add Grade] at the bottom left of the grade system table to add grades for use.

  • If you want to restrict which grades are available per evaluation stage, click [Grade Settings by Evaluation Stage] at the bottom left of the grade system table.

    • For example, use this feature when you want to allow only grades A, B, C in the self-evaluation stage, and grades S through D in the top-down evaluation stage.

    • Note: If [Overall Grade] is set to be automatically calculated, an S grade may still appear as a result in the self-evaluation even if the maximum grade there is restricted to A, depending on question weights and other settings.

  • To remove a [Grade Settings by Evaluation Stage] entry you added, click the three-dot button at the top right of the grade settings by evaluation stage table, then click [Disable].

  • If the overall grade is configured to be calculated using [Matrix], you can build the matrix table in Step 7's grade system settings.

    • Check Axes: By default, the x-axis is set to 'Competency Grade' and the y-axis is set to 'Performance Grade'.

    • Grade Cell Settings: Click each cell in the table to configure the grade for that cell.

      • Grade Definition: In the grade cell settings screen, you can specifically define the grade for that cell by entering the rank, grade name, and description. For example, you can click the cell where 'Performance' is high but 'Competency' is low, and assign a specific grade name and description such as 'Challenger'.

        • Cells with the same 'rank' will share the same grade name and description.

Grade Distribution

If you want to conduct relative grading in an evaluation that uses [grades], try using the grade distribution settings feature.

The grade distribution step will not be shown in the following situations:

  • When top-down evaluation and calibration are not included in Step 2's evaluation elements and stages, or

  • When a top-down evaluation stage exists in Step 5's stage-by-stage evaluation forms, but grades are not used in the top-down evaluation

  • Enable [Use Grade Distribution] in the grade distribution step. You can set the maximum grade ratio per grade for assignment during calibration.

    • For example, use this when you want to restrict the S grade to only n% of all members in the evaluation results. Additionally, if calibration is conducted, you can restrict the S grade to only n% of all members during calibration.

  • Add a [Grade Distribution Group] within the [Grade Distribution Table] to apply different distribution criteria to members belonging to specific organizations, separate from the default group.

    • For example, while the overall S grade is set to 10% of all members, you can configure members in the [Development Division] belonging to the Technical Job Group (group name) to receive only 5% S grades.

  • Click [Distribution Table Settings] → [Distribution Applied Grade] at the top right of the grade distribution table to configure which evaluation element the grade distribution applies to.

    • For example, if you want to distribute the S grade to only 5% of all members for the overall grade distribution, select 'Overall' for the distribution applied grade.

      Grade distribution table settings screen without nth-round top-down evaluation

      Grade distribution table screen with nth-round top-down evaluation

  • When conducting N rounds of top-down evaluation, enable [Distribution Table Settings] → [Split by Stage] to apply different distribution rates per top-down stage.

  • The configuration below means that in Top-Down Round 1, only 10% will receive an S grade, and in Top-Down Round 2, only 5% will receive an S grade.

  • Turning [Split by Stage] OFF means the same grade distribution will apply across all top-down evaluation rounds. The configuration below means that both Top-Down Round 1 and Round 2 will distribute only 5% of members with an S grade.

  • If the Top-Down Round 1 toggle is turned off under [Distribution Table Settings], it means grade distribution will not be applied to Top-Down Round 1, and grades will only be distributed in Top-Down Round 2.

  • The [Adjustable Range] and [Restrict Submission When Exceeded] features within [Grade Distribution] work as follows.

    • Adjustable Range: You can configure the number of members assigned per grade to be adjustable within a ± range.

      • You can choose from options ranging from ± 1 person to ± 10 persons.

      • Refer to the FAQ below for calculation examples based on the adjustable range settings.

    • Restrict Submission When Headcount Exceeds Limit

      • When this feature is enabled, evaluators must strictly adhere to the headcount determined by the grade distribution rate in order to submit the evaluation.

      • When this feature is disabled, evaluators can still submit the evaluation even if they do not strictly follow the headcount determined by the grade distribution rate — they will only see a [Warning] pop-up notifying them of the discrepancy.


FAQ

When adding a group and configuring conditions in [Grade Distribution Table], can grades only be distributed based on 'Organization'?

  • In [Grade Distribution Table], grade distribution groups can only be set based on 'Organization' when adding a group.
    This is because most companies either

    • apply the same grade ratio to all members based on company-wide performance, or

    • apply different grade ratios by organization based on each organization's performance.

Therefore, the grade distribution table is designed to allow you to divide groups by 'Organization' when setting grade ratios.

How is the grade distribution adjustable range calculated?

  • For example, if there are 17 evaluation targets, the S grade is configured to be awarded to only 15%, and the adjustable range is set to ± 1, the calculation is as follows:

    • 17 × 0.15 = 2.25, using the integer value of 2 as the base, ± 1 gives a range of 1 to 3 people who can receive an S grade. That is, a minimum of 1 and a maximum of 3 people can be awarded an S grade.

Did this answer your question?