With the peer review function students have to grade each other.
How to set up a peer review
- Sign in to Ans.
- Create a hand-in assignment, and at the grading options, select Peer review in the drop-down menu.
- Set the number of students that have to review one students work. Later on you can change this option by going to About in the assignment menu and clicking the tab Grading.
- Set the deadline for students to hand in the assignment and set the deadline for students to review each other. This can later on be changed as well by going to About in the assignment menu and clicking the tab Availability.
- Create the criteria for the assignment and let the students work on the assignment and do the peer reviewing.
- To see if every student has done the peer reviewing, you can go to Results in the assignment menu, and check the percentages in the column Progress. The student will be put into this list once he has submitted his work and the progress indicates how much work he has reviewed.
- Once all students are graded by the other students (or the deadline has past), the grades for all students are in and you can choose to publish them.
There is the possibility to compare the review results from all the students. This can be found at the Results tab.
- Click Results in the assignment menu.
- Reliability: Reliability indicates how realistic it is that a student's grade is correct. The results of the reviews other students have made for his submitted work are compared. If there is a big difference in reviews given, the reliability is small.
The reliability is calculated as follows: the grades are ordered from lowest to highest. For example, 5.0, 7.0, 10.0. Then the first digit is divided by all subsequent digits, the second digit is divided by all subsequent digits, and so on. Then the average of all those fractions is taken. In the example, that is (5/7), (5/10) and (7/10). The result is 63.8% reliability.
- Consensus: Peer consensus indicates how well the grades given by this student match the grades given to those results by other students. The peer consensus of this reviewer is calculated for each result, the average of the peer consensuses of all the results is shown in the results index overview. The consensus is calculated with the following formula:
Consensus = (1 - (deviation / average given points) ) * 100
- Deviation = Absolute value of the difference in given points between this student and the other peers
- Average given points = average number of points given by all the peers for the submitted work
The consensus will be a number between 0 and 100. If the student gave exactly the average number of points, the consensus will be 100. If the deviation is as great as (or greater than) the average, the consensus will be 0.
For example, the work is reviewed by 3 peers. A gives 0 points, B gives 3 points and C gives 6 points. The consensus for the peers A and C will be 0 and the consensus for peer B will be 100.