Order question

To create a an order question, follow the steps below.

1. Navigate to your question bank or your course assignment. 
2. Click New exercise, fill in a name and click Save.
3. Click New question and select Order question.
4. Formulate the question in the question content field.
5. Fill in the number of points the question is worth.
6. Click the dropdown menu Order type* and select Horizontal or Vertical. 
7. Click Add alternative and fill in the alternatives. Repeat this for all alternatives. The order in which you add your alternatives is the same order the participants will be required to rank the alternatives.
8. If preferred, you can also click on the box Fixed starting position. This allows you to fill in the position of the alternatives when shuffling the answer options is enabled.
9. Click the more_vert-icon for more options.
10. Click Save.

For additional options, click the more_horiz-icon and click Edit. Then click on the more_vert-icon. You will see the following:

• Bonus
  This marks the question as a bonus question, which means that its points are not included in the maximum amount of points achievable for that assignment. If a student answers the question incorrectly, this will not be detracted from the number of points and the mark. However, when awarding points, it is possible to achieve more points that the maximum points achievable for the assignment.
  
  
• Partial scoring
  Participants will receive points for partially correct answers. For example, if the total number of points for a question is 2 and their answer is half correct, they will receive 1 point. Without this option, they would only be able to receive either 0 or the maximum number of points.
  Enabling partial scoring can increase the applied guess correction. Since students can earn points for partially correct answers instead of an all-or-nothing approach, they may be more likely to guess additional answers. This article provides a more detailed explanation of how the guess correction is calculated. 

To add a grading scheme to an order question, follow the steps below.

1. Click the Grading scheme tab at the top of the assignment or question bank exercise.
2. Go to the question for which you want to set the grading scheme.
3. It is optional to fill in feedback that is shown to students when:
   
   • the question is answered correctly
   • the question is answered partially correctly
   • the question is answered incorrectly
4. Click the more_vert-icon for more grading options.
5. Click Save.

• Model answer
  A solution for the reviewers (and for participants when published). The model answer can be an extensive elaboration, an image, or a file.
  
  
• Use automatic scoring
  When using automatic scoring to grade an order question, the product rule is applied to calculate the points achieved. Every element ordered in the learner's answer is compared to the subsequent elements to determine whether that pair is correctly placed compared to each other. This way, every pair in the answer is checked.

  The ratio of the number of correct pairs to the total possible pairs is calculated. For regular grading, this ratio is multiplied by the total available points for the question. 
  
  

• Limit minimum to zero points
  With this option enabled, it’s impossible to go below zero points when selecting the different criteria. It is still possible to manually adjust the number of points to go below zero with the adjustment option during the reviewing.
  
  
• Limit maximum to total points
  In the grading settings it’s possible to set the maximum amount of points achievable with the question, separate from the points per criteria When this number deviates from the maximum amount achievable by adding up the criteria points, this option will cap the maximum amount of points to this manually set number.

If you have not used the product rule option ('Use automatic scoring'), an order question will be graded as follows:  

We determine the number of correct ‘pairs’. For example, 4 options for the following pairs are used:

1-2 ; 1-3 ; 1-4 ; 2-3 ; 2-4 ; 3-4

We compare this with the student's answer and if for example, the student identified 4 correct pairs, the student receives a score of 4/6 * the number of points.

So, in general: grade = (number of correct pairs set by the student / total number of correct pairs) * number of points set for this question.