Next to the question names, the progress bar is shown. When no questions are reviewed, the bar is light-green. When questions are reviewed the bar will fill up with a dark-green color. When the bar is completely dark-green, all questions are reviewed. The check mark left of the question name will now show green.
Under the progress bar, the initials of the reviewers that have the right to grade this question are shown. When a reviewer did not review any questions, the initials will be grey. When a reviewer participated in reviewing the question, their icon will turn bright.
When you want to assign a reviewer to a question, first, add reviewers to your course. How this is done can be read in this article. Next, click the button Assign reviewers below Review. This will show a pop-up, where you can assign questions and/or groups to the reviewers. More about reviewing together can be found in the article mentioned before.
Different modes for reviewing are available.
When you want to review a question that has not been reviewed yet, click the question name. A question of a randomly chosen student opens.
- When you want to review only the flagged questions, you can directly access the flagged question by clicking the red text box under the question title, or click the three dots right of the progress bar, and choose the option 'Review flagged questions'. These options are only available if there are flagged questions.
- When you want to review a question, including the work that has already been reviewed, click drop-down that says 'Review unmarked', and click the option 'Review sequentially'.
- When you want to review only a question of n exercise, you can cancel the selection of the questions you do not want to review by clicking the blue/green blocks containing a, b, c etc. When the block turns grey, they are turned off and you will not review these questions when you start reviewing this exercise. This is shown in the question 'Question 1' of the first image of this article. This is only in possible in the bars below 'Review per exercise'.
- When you want to review all exams or questions per student, click the top bar of the page, which says 'Review per students'.
- Review per class: Reviewing per class is possible by selecting the class(es) you want to review from the drop-down menu 'Classes'.
- Review per group: Reviewing per group is possible by selecting the group(s) you want to review from the drop-down menu 'Groups'.
Reviewing a question
- First the left arrow, which gets you back to the review overview.
- In the middle a progress bar is shown. This progress bar shows the progress of the question which you are reviewing. In the example above, all questions are selected for reviewing, so here the progress bar shows the progress of reviewing of all questions.
- On the right of this bar a blue flag is shown. When this flag is checked, it will turn red and the question will be marked with a red flag. This means that the instructor of the course should look at this question, and solve the red flag by clicking it so it turns blue again. Also a comment can be attached to this red flag so the instructor will know what dilemma the reviewer was facing.
When navigating to a question from the review overview, the scan of the question for a student is shown. The box that needs to contain the answer to the question is marked with a blue outline. Scrolling up and down is possible by the scroll wheel as well as the up and down arrows on your keyboard so you can see the whole scan. In the top-left of the scan a couple of tools can be found:
- When clicking the mouse icon, drawings and comments can be moved or deleted when clicked. For hand-in assignments: by selecting words with the mouse, the number of words selected can be found in the bottom bar. As well the total number of words as the selected number of words can be found there.
- When clicking the pencil icon, drawings can be made on the scanned work.
- When clicking the text balloon icon, typed comments can be added on the scanned work. Comments can be edited in the sidebar when clicked in mouse mode. Click the three dots on the right side of the comment. You can now edit, delete, hide for the student, and save the question as a shortcut for reuse for other students.
Below the exam scan
Below the exam scan, three options can be found.
- Previous question on the left lets you go back to the previous reviewed question.
- Next question on the right lets you go to the next question, click this button after the question is reviewed or a red flag is selected. You can also click this button when the question is not reviewed yet, then the question will have to be reviewed later on and will not be marked as reviewed.
- In the middle, the questions of this exercise (or if review all questions is selected, of all questions) of this one student can be selected. Clicking one of them lets you go to this particular question. When a question is marked blue, as 1b in the example above, it is already reviewed. When a question has a red dot above it, a red flag is attached to that question, which can be seen in the example below.
The sidebar on the right of the screen allows for the reviewing according to the specified criteria of the question, and adding comments:
- On top of the side bar, four options can be found:
- Student (or the name of a student) is a button which gets you to the result page of a student. This button only works for an instructor, reviewers can not use this function.
- 2 of 2, lets you navigate between students. In the example given, there are only two students, so when there are more students, a higher number will be shown here. In the pop-up that appears, all questions of all students are shown.
- The arrows to the right of '2 of 2', gives you the ability to get to the next student.
- Below these three options, the grade of the student, total amount of points and 'Approved' or 'Disapproved' is shown. By clicking either 'Approved' or 'Disapproved', an instructor can choose to disapprove the work of a student. These numbers will only be visible for the instructor, a reviewer will not be able to see this.
- All criteria are uncoloured when reviewing starts, this is an unsaved state. If a criterion has been met, click the criterion to let Ans know that the student should get the points for this criterion and the system will automatically save your changes. The criterion will turn green when clicked. When no criteria are met, make sure to click 'none of the above', to save the reviewing as in the example below. When grading with a slider or rubrics, it is possible to click UNDO GRADING to set your grading back to zero points. It is also possible to check the criteria with the help of the keyboard. Press 1 to mark the first criteria green, 2 to mark the second criteria green, etc. For marking all criteria green at once, press the space bar.
- There are multiple types of comments:
- Comments per criteria - When clicking the dialogue balloon on a criterion, a comment can be left that is attached only to this criterion of this question. This comment will be visible for the student to see after publishing the exam.
- Comments per question - On the top of the sidebar you can switch between 'criteria' and 'comments'. Here an overview is given of all the comments that are added to the scan (see 'exam scan'). These contain the comments which are written in the left screen (the exam scan), and they can only be added in the exam screen.
- Specific adjustments can be made to alter the score for a student, without relating this to specific criteria. This is done by typing in the number of points you want to subtract or add behind Specific adjustment. The arrows can also be used for this.
- A grading description is shown when this is added to the criteria. This description may contain information on the way a question is scored.
- A solution image is shown when this is added to the criteria. This option can be useful when an answer to the question contains, for example, a drawing.
- Through scrolling is possible to go to all other questions in the exam. Only the first page of the exam, containing the student information, is unavailable to ensure anonymity. More scrolling options can be found by clicking the double arrow icon in the top bar of the exam scan.
- Zooming is possible using the plus and minus in the top bar of the exam scan. Also, spreads can be used by clicking the double arrow icon in the top bar of the exam scan.
- Navigating to a specific page is possible by typing in the page number in the right part of the top bar of the exam scan, or selecting a page in the sidebar on the left of the exam scan that can be shown when clicking the most left icon in the same bar, below the 'back to overview' button.
- Navigating to the first and last page can be done by clicking the double arrow icon in the top bar of the exam scan and selecting 'go to first/last page'. More options to set the pdf to your liking are here as well.
- Selecting another question will automatically navigate to reviewing the selected question. Review criteria of this question will become visible in the sidebar.
- Clicking a subquestion in the bottom bar will navigate you to this subquestion.
- Navigating to a question of another student is possible by clicking the student overview icon, right of the flag in the top bar.
- Navigating to the next student by clicking 'skip' in the bottom bar, or pressing the right arrow on your keyboard.
- Navigating to the previous student by clicking 'back' in the bottom bar, or pressing the left arrow on your keyboard.
- Navigating to a specific word or group of words by clicking the magnifying-glass icon in the top bar.
Reviewing questions with the same answer
*Online tests only*
For students that have exactly the same answer, the same judgement should be provided. Therefore, if the system recognises two answers as equal, and a number of points is given to the question, all equal answers are judged equally, so with the same amount of points. If the system recognises other answers as equal, it will be shown underneath the answer box of the question in the review window as shown below. In this example, 3 students have given the same answer to a question. When a judgement is given, so a number of points is given, all students with the same answer will receive the same number of points. This way everyone is treated equally.