This article outlines new question options which you can apply to number scale questions. These new options, which are not applied by default, enable you to specify who should see and can answer questions. In addition, we have also enabled support for external calibration of ratings which can then be imported into Perform. This is a big step forward for review template creation.
What is the impact of these changes?
This release contains some major new functionality for the review template. These new question options are not switched on by default and can be added into your review templates if you wish.
We assess the impact of this release as Low.
The new options are located in the ‘Advanced options’ area of number scale questions. Click on this to expand the section and see the options available.
The new options are shown alongside some pre-existing settings:
You can adjust the options to enable either only the reviewer or the reviewee to answer the question. Simply adjust the radio buttons.
You can hide questions from either the reviewer or reviewee if they are not required to complete a question.
Setting a question to be completed by an imported answer (using calibration as part of your process)
As an organisation you may calibrate performance ratings as part of your performance management process. Our new question options enable you to do this.
There are complexities to be considered here in terms of which ratings are seen and by whom. Calibration of scores, especially if they move downwards, can be difficult to manage and you might wish to avoid this situation being visible through your question configuration:
- Setting a question to be only visible to the reviewer to give their rating – this avoids the initial rating being seen by the reviewee when it is subject to change.
2. Setting a separate question to ask the reviewee to give their rating and setting the reviewer rating to be imported – this means the reviewee can rate their own performance and then they see the calibrated answer once this has been imported.
Top tip – it is important to remember which settings are applied to which questions. You can look this up later but it is worth noting down for your reference.
You can set any combination of settings. The system will tell you if the combination you have selected is not possible.
To get the data you need, go to your Perform reports (these are located in your version of Learn). Go to the Reports and analysis section.
Scroll down to the bottom of the reports page and you will see the Perform reports section. Select the Review Answers report. This will load.
A prompt box will load. You can choose to filter down information here or, if you prefer, filter down the information once you have it in Excel.
When you are happy with your selection press OK. The report will load.
Now you need to export the data to Excel – this will enable people in your organisation to alter the ratings to questions as per your process.
To export the data to Excel select the icon below within the report:
Now you have the data in Excel you can get people to record their calibrated ratings which they can overwrite into the spreadsheet. These are the ratings for the question where the reviewer was the only person able to give a score.
This is an example:
You can see the answers from the reviewers in the Review answer column. This will be the rating to be overwritten.
Once the updated ratings have been input and saved into the spreadsheet then you are close to completion. Make sure you change the question name in the spreadsheet to the question to which you want to the new ratings to relate.
The final step is to create a ticket on the Kallidus Help Centre with the attached spreadsheet. This can then be imported for you and the altered ratings used going forward.
Previewing your form from the reviewer and reviewee viewpoint
If you have setup a form on which certain questions can only be seen/answered by either the reviewer or the reviewee then you might want to preview this form to check it is setup as you expect.
To preview a review form select the Preview template button.
The preview shows you if you have questions set which are set to be answered/seen by either the reviewer or reviewee.
You can use the dropdown to view the form from each viewpoint. As you preview additional information is shown against those questions which are set to be answered by only one party or are to be imported. These won’t be shown to the individuals but help you understand your settings.
Examples of these include:
Please contact us with any questions on this new functionality.