Co-evaluation and Weighting

The evaluation process allows for evaluators from multiple institutions to participate (co-evaluation). Therefore, the calculation of evaluation scores involves several steps to weight the final score based on the number of evaluators from each institution.

If the final score calculation is not weighted, the scores from the institution with the most evaluators will have more influence on the final evaluation score of a proposal.

To avoid this bias and ensure that each institution has the same weight in the final score calculation regardless of the number of evaluators, the application proceeds in three steps.

For each proposal:

1. Calculation of the average scores for each evaluation question.

This results in an average score per evaluator.

2. Calculation of the average scores of all evaluators from an institution.

This results in an average score per institution.

3. Calculation of the average scores of each institution.

This results in a final weighted average score.