Skip to main content

Alignment insights

Brooke Henshall
  • Updated

Analysing the alignment of reviewers can provide different insights in regards to an assignment after it has been graded. Using this feature achieves fair and transparent grading.

To view insights into the alignment of reviewers, follow the steps below.

  1. Click the domain  School name in the menu on the left.
  2. Click on label_importantCourses in the menu at the top.
  3. Click on your course or use the search bar. 
  4. Click on your assignment or use the search bar. 
  5. Click Alignment in the menu on the left.


What the reviewer alignment shows

  • The alignment of the grading by different reviewers
  • The number of results
  • The number of minutes spent reviewing each question
  • The average number of points given

How we calculate the reviewer alignment

((average_question_score - grader_average) / points).abs > DEVIATION_THRESHOLD

We use a DEVIATION_THRESHOLD of 0.2

For example:cv
average_question_score = 1.0
grader_average for a reviewer is 1.5
points = 5
(1.0 - 1.5) / 5 = 0.1 which is smaller than 0.2 so there is no deviation detected.

Related articles

Comments

0 comments

Please sign in to leave a comment.