Skip to main content

Second review

Brooke Henshall
  • Updated
error_outline
At this moment, this option is only available through closed beta. An administrator from your school can contact support to make a request to enable this feature.

In the review overview, there is the option to review the students for a second time. In the points and mark calculation you will see a range indicating the reviews given by the first and second reviewer. Upon publishing the results students will also see the scores given by both reviewers. However, when exporting, only the grade obtained during the first review will be shown.

Some benefits of a second review include:

  • Review each student twice
  • Discover grade differences
  • Insights in agreement

To enable this setting, follow the steps below.

  1. Click the domain School name in the menu on the left.
  2. Click on label_importantCourses in the menu at the top.
  3. Click on your course or use the search bar. 
  4. Click on your assignment or use the search bar. 
  5. Click settings Settings in the menu at the top.
  6. Click Review options in the menu on the left.
  7. Enable Second review.
  8. Click content_paste_search Review in the menu at the top.
  9. Click the drop down menu First review and select Second review.
  10. You can then start a second review.

Screenshot_2022-05-04_at_11.42.42.png

When a reviewer grades an exercise, they are not able to grade this exercise during the second review. Only (department) administrators can do this.

Reviewer reliability

If you use the second review, Ans will show an additional option in the Insights menu: Reviewer reliability. In this menu, a matrix of all reviewers is shown. Per combination of reviewers, Ans shows the reliability in percentages. Ans compares the scores given by a reviewer and these are compared with the scores of each other reviewer. When the percentage is 100%, both reviewers gave the same scores in all cases. When the percentage is 0%, none of the given scores was the same.

lightbulb_outline
This feature is currently in development. You can stay up to date with the progress by visiting our roadmap. If you are already using this feature, we would love to hear your thoughts. You can leave them here. After ranking how important the feature is to you, you can leave a comment.

Related articles

Comments

0 comments

Please sign in to leave a comment.